-- Logs begin at Thu 2022-07-28 04:39:13 UTC, end at Thu 2022-07-28 05:52:23 UTC. -- Jul 28 05:11:40.661203 dv-cinder-799871-48-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 05:11:40.673622 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 05:11:40 2022] *** Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: nodename: dv-cinder-799871-48-iscsi Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: machine: x86_64 Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: clock source: unix Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: pcre jit disabled Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: detected number of CPU cores: 4 Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: current working directory: / Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: detected binary path: /usr/bin/uwsgi-core Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: your processes number limit is 47680 Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: your memory page size is 4096 bytes Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: detected max file descriptor number: 2048 Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: lock engine: pthread robust mutexes Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: thunder lock: enabled Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 05:11:40.676401 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 05:11:40.716949 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: Python main interpreter initialized at 0x563623a609c0 Jul 28 05:11:40.716949 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: python threads support enabled Jul 28 05:11:40.716949 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: your server socket listen backlog is limited to 100 connections Jul 28 05:11:40.716949 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: your mercy for graceful operations on workers is 90 seconds Jul 28 05:11:40.717305 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 05:11:40.717381 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: *** Operational MODE: preforking *** Jul 28 05:11:40.717677 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: *** uWSGI is running in multiple interpreter mode *** Jul 28 05:11:40.717677 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: spawned uWSGI master process (pid: 80255) Jul 28 05:11:40.722175 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: spawned uWSGI worker 1 (pid: 80267, cores: 1) Jul 28 05:11:40.722175 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: spawned uWSGI worker 2 (pid: 80268, cores: 1) Jul 28 05:11:40.722175 dv-cinder-799871-48-iscsi devstack@keystone.service[80255]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 05:11:40.717928 dv-cinder-799871-48-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 28 05:11:46.345443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:11:46.345443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: from cryptography.utils import int_from_bytes Jul 28 05:11:46.346269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:11:46.346269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: from cryptography.utils import int_from_bytes Jul 28 05:11:46.346382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:11:46.346382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: from cryptography.utils import int_from_bytes Jul 28 05:11:46.346382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:11:46.346382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: from cryptography.utils import int_from_bytes Jul 28 05:11:46.398445 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 05:11:46.398639 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 05:11:46.398828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 05:11:46.398925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] command line args: [] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 05:11:46.399033 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 05:11:46.399119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 05:11:46.399229 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] command line args: [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 05:11:46.399314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ================================================================================ {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 05:11:46.399504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 05:11:46.399590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] admin_token = **** {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.399667 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ================================================================================ {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 05:11:46.399739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] config_dir = [] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.399927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.400006 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] admin_token = **** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.400117 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] config_source = [] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.400200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] config_dir = [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.400299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] debug = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.400383 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.400499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.400756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] config_source = [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.400756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] debug = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.400877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.400937 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.401028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.401190 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.401298 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.401399 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.401533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.401651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.401753 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] list_limit = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.401853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.401954 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] log_config_append = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.402047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] list_limit = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.402146 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.402249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] log_config_append = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.402349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] log_dir = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.402448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.402553 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] log_file = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.402652 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] log_dir = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.402752 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.402865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] log_file = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.402978 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.403052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.403163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.403243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.403353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.403441 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.403533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.403617 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.403713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.403797 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.403958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.404035 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.404205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.404288 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.404442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.404795 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.404887 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.404960 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.405077 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.405157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.405233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.405347 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.405347 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.405566 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.405657 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.405734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.405848 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.405926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.406126 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.406364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.406547 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] publish_errors = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.406674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.406782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.406859 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] publish_errors = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.407014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.407136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.407219 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.407296 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.407412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.407488 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.407650 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.407735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.407887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.407969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] standard_threads = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.408116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.408191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] standard_threads = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.408348 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.408431 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.408507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.408576 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.408687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] use_journal = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.408763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.408865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] use_json = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.408943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] use_journal = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.409040 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] use_stderr = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.409117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] use_json = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.409217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] use_syslog = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.409300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] use_stderr = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.409484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] use_syslog = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.409560 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.409667 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:11:46.409746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.409925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.410002 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.410168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.410247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.410436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.410514 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.410681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.410756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.410919 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.410996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.411163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.411238 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.411400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.411475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.411643 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.411720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.411887 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.411963 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.412136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.412219 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.412372 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.412449 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.412614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.412695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.412850 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.412940 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.413798 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.413902 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.414072 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.414149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.414317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.414406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.414577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.414655 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.414835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.414913 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.415084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.415168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.415323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.415399 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.415566 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.415641 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.415826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.415979 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.416065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.416136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.416318 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.416403 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.416554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.416640 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.416787 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.416864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.417020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.417096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.417254 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.417338 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.417514 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.417595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.417766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.417841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.418000 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.418089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.418235 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.418318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.418470 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.418545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.418720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.418804 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.418958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.419035 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.419196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.419296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.419427 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.419538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.419666 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.419776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.419902 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.420041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.420166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.420249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.420361 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.420480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.420593 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.420672 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.420825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.420915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.421061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.421138 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.421302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.421387 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.421559 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.421696 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.421801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.421888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.422035 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.422113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.422270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.422350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.422507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.422623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.422746 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.422822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.422978 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.423054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.423219 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.423306 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.423457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.423534 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.423695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.423811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.423933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.424012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.424169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.424246 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.424401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.424474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.424634 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.424711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.424876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.424953 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.425115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.425203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.425347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.425425 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.425607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.425695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.425861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.425937 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.426095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.426174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.426331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.426413 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.426567 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.426642 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.426806 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.426883 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.427065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.427141 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.427307 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.427417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.427571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.427646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.427777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.427855 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.428014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.428092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.428251 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.428330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.428488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.428564 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.428752 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.428829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.428994 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.429084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.429235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.429312 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.429489 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.429570 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.429736 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.429829 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.429975 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.430053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.430220 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.430297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.430455 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.430540 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.430695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.430771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.430949 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.431026 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.431192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.431278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.431431 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.431509 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.431672 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.431748 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.431908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.431995 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.432144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.432230 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.432380 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.432458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.432612 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.432700 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.432844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.432921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.433076 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.433153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.433307 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.433392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.433571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.433652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.433808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.433885 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.434053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.434143 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.434295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.434373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.434548 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.434626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.434789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.434874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.435047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.435174 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.435291 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.435369 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.435525 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] auth.external = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.435613 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.435758 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.435836 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] auth.external = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.435996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.436072 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.436278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.436365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.436513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] auth.password = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.436600 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.436748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] auth.password = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.436825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] auth.token = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.436984 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] auth.token = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.437062 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.437222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.437307 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.437462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.437601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.437719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.437796 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.437957 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.438042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.438205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.438283 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.438439 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.438517 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.438676 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] credential.caching = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.438764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.439166 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] credential.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.439249 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.439414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.439502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.439665 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.439751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.439902 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.439982 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.440147 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.440227 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.440388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.440475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.440625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.440702 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.440899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.440976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.441139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.441226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.441386 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.441480 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.441668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.441747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.441940 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.442021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.442192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.442270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.442451 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.442528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.442698 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.442778 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.442936 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] federation.caching = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.443013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.443175 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.443256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] federation.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.443418 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.443497 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.443663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.443740 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.443896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.443975 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.444137 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.444215 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.444388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.444467 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.444631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.444716 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.444934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.445028 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.445187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.445375 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.445455 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.445702 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.445797 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.445942 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity.caching = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.446029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.446194 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.446347 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.446446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.446782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.446944 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.447022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.447195 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.447281 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.447431 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.447511 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.447671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.447749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.447921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.448004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.448159 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.448237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.448395 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.448472 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.448628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.448706 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.448862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.448948 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.449109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.449188 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.449345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.449422 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.449619 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.449698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.449846 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.449925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.450102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.450180 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.450353 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.450432 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.450608 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.450685 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.450847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.450925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.451081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.451160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.451319 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.451398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.451552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.451640 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.451786 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.451865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.452028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.452106 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.452263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.452349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.452505 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.452584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.452735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.452812 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.452981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.453070 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.453225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.453303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.453458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.453568 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.453729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.453814 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.453976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.454055 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.454209 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.454287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.454449 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.454539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.454682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.454761 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.454921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.455034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.455156 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.455245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.455391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.455469 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.455628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.455712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.455866 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.455953 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.456111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.456195 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.456355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.456433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.456586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.456671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.456820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.456899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.457070 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.457149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.457304 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.457390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.457570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.457651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.457817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.457934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.458054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.458147 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.458290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.458369 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.458530 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.458771 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.458859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.459008 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.459087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.459253 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.459332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.459498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.459584 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.459744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.459821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.460502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.460593 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.460743 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.460835 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.460999 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.461076 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.461240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.461319 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.461525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.461623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.461740 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.461819 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.461980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.462065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.462222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.462310 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.462458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.462537 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.462709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.462829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.462961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.463082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.463211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.463316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.463566 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.463643 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.463807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.463895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.464044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.464126 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.464281 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.464359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.464519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.464606 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.464760 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.464838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.465001 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.465080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.465238 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.465324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.465504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.465586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.465742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.465820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.465990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.466143 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.466220 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.466290 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.466451 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.466536 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.466690 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.466777 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.466938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.467016 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.467178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.467256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.467412 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.467493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.467650 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.467729 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.467892 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] resource.caching = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.467971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.468129 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.468208 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.468371 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.468450 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.468607 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.468684 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] resource.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.468857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.468937 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.469106 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.469185 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.469342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.469421 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.469615 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.469698 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.469854 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.469933 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.470097 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.470183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.470336 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] role.caching = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.470417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.470576 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.470656 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] role.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.470811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.470888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.471050 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] role.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.471130 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.471298 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.471376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] role.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.471533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.471610 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.471780 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.471859 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.472028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.472106 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.472274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.472352 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.472521 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.472601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.472767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.472845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.473001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.473079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.473249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.473328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.473511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.473593 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.473751 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.473828 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.473995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.474074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.474244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.474404 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.474483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.474641 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.474728 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.474890 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.475129 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.475207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.475368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.475455 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.475655 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.476295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.476487 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.476567 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.476743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.476831 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.476998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.477077 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.477238 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.477316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.477574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.477667 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.477818 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.477897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.478057 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.478135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.478310 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.478398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.478564 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.478641 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.478803 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.478885 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.479040 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.479200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.479280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.479463 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.479542 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.479717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.479795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] token.caching = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.479952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.480030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.480194 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.480270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.480429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.480507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.480670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] token.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.480750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.480911 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.480990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.481149 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.481227 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.481391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.481488 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.481657 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.481735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.481909 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.481987 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.482148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.482229 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.482389 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.482468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.482626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.482705 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.482874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.482954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.483115 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.483192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.483345 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.483422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.483587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.483665 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.483838 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.483916 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.484090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.484168 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.connection = **** {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.484327 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.484420 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.484574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.484653 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.484820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.484897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.485063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.485150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.connection = **** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.485300 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.485397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.485561 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.485644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.485801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.485881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.486039 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.486195 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.486273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.486345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.486509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.486589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.486754 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.486842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.486991 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.487069 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.487237 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.487314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.487470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.487556 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.487715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.487795 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.487948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.488027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.488188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.488277 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.488423 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.488503 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.488594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 05:11:46.488673 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.488892 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.489137 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.489377 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:11:46.489577 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 05:11:46.517748 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.517981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.518204 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.518842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.519078 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.519303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.527243 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.528312 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.563654 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.564132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.564222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.564405 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.617214 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.617842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.667629 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.667859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.669656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.669899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.732820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.733046 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.733133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.733272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.733356 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.733513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.733601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.733739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.733822 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.733955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.734051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.734220 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.757639 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.757959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.758084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.758084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.758244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.758318 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.758398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.758501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.758584 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.758714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.758798 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.758926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.759008 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.759143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.769932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.770310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.783087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.783325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.783506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.783608 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.783741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.783825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.783961 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.784042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.784176 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.784267 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.784390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.784474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.784604 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.784822 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:11:46.801352 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.801593 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 05:11:46.801688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.801888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 05:11:46.801974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.802117 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 05:11:46.802230 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.802388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.802472 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 05:11:46.802651 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.802736 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.802910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.802996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.803165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.803248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.803436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.812980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.813258 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.813345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.813550 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.813639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.813837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.814187 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.814438 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.821744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.822080 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.826446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.826729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.826815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.827012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.827097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.827294 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.827388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.827574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.827660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.827846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.827998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.828078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.828164 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.828355 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.828440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.828623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.828708 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.828896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.828980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.829162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.829245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.829429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.853060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.853156 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.854581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.854696 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.854862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.854981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.859500 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.859714 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.859800 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.859995 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.860080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.860282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.866788 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.866999 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.867113 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.867287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.871240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.871529 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.871647 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.871827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.871939 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.872109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.872230 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.872386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.872522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.872677 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.872801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.872949 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.873079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.873233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.873364 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.873678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.889889 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.890170 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.890254 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.890528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.894129 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.894489 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.897278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.898209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.898349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.898623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.902693 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.903069 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.905894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.906292 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.909063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.909360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.909730 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.909825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.909902 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.909965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.910038 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.910233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.910331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.910527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.910623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.910851 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.926573 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.926857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.926956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.927125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.927220 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.927392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.927477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.927709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.934346 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.934942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.935882 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.936158 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.936500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.936779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.939249 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.939527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.939829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.939913 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.940121 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.940206 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.940410 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.940496 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.940718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.941018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.952644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.952925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.953060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.953209 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.953344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.953512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.953656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.953798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.953944 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.954075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.954232 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.954355 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.954514 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.954806 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.970576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.971152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.973559 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.974178 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.976832 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.977246 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.979323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.979725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.980829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.981121 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.981242 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.981426 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.981581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.981889 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.987959 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.988361 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.989578 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.989985 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:46.992666 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.992919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.993052 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.993212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.993297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.993516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.993615 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:46.993816 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.001602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:47.001876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:47.001962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.002159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.002244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.002440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.009704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:47.009985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.010083 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:11:47.010270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.010355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.010554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.010665 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.010827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.010939 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.011103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.011186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.011379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.011460 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.011665 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.011748 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.011942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.012024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.012306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.012396 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.012590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.012671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.012855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.012937 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.013138 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.013226 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.013407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.013508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.013709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:11:47.047480 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x563623a609c0 pid: 80268 (default app) Jul 28 05:11:47.047996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x563623a609c0 pid: 80267 (default app) Jul 28 05:11:47.050703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8acb55-3246-4721-beb3-04d32e0b7658 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:11:47.050998 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8acb55-3246-4721-beb3-04d32e0b7658 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:11:47.051274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8acb55-3246-4721-beb3-04d32e0b7658 None None] PATH_INFO: `/v3` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:11:47.055622 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Thu Jul 28 05:11:47 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:11:55.475409 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182b93-46aa-4b24-b799-dc41c2cbd6b0 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:11:55.475962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182b93-46aa-4b24-b799-dc41c2cbd6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:11:55.475962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182b93-46aa-4b24-b799-dc41c2cbd6b0 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:11:55.480432 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:11:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:11:55.486104 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3bf72-e1d5-41b7-8d56-b4cd635b5bcc None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:11:55.486521 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3bf72-e1d5-41b7-8d56-b4cd635b5bcc None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:11:55.486658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3bf72-e1d5-41b7-8d56-b4cd635b5bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:11:55.557928 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: INFO dbcounter [None req-e8f3bf72-e1d5-41b7-8d56-b4cd635b5bcc None None] Registered counter for database keystone Jul 28 05:11:55.579774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG oslo_db.sqlalchemy.engines [None req-e8f3bf72-e1d5-41b7-8d56-b4cd635b5bcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:11:55.585893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writer thread running {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:11:55.764179 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG passlib.handlers.bcrypt [None req-e8f3bf72-e1d5-41b7-8d56-b4cd635b5bcc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80268) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 05:11:55.765412 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG passlib.handlers.bcrypt [None req-e8f3bf72-e1d5-41b7-8d56-b4cd635b5bcc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80268) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 05:11:55.818788 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e8f3bf72-e1d5-41b7-8d56-b4cd635b5bcc None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:11:55.820862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e8f3bf72-e1d5-41b7-8d56-b4cd635b5bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:11:55.946521 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:11:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 28 05:11:56.095446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25182b93-46aa-4b24-b799-dc41c2cbd6b0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:11:56.163546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: INFO dbcounter [None req-25182b93-46aa-4b24-b799-dc41c2cbd6b0 None None] Registered counter for database keystone Jul 28 05:11:56.182948 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG oslo_db.sqlalchemy.engines [None req-25182b93-46aa-4b24-b799-dc41c2cbd6b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:11:56.189451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writer thread running {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:11:56.309463 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25182b93-46aa-4b24-b799-dc41c2cbd6b0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:11:56.313804 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2a4cd-a41b-462b-a526-ccd039149525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:11:56.314707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2a4cd-a41b-462b-a526-ccd039149525 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:11:56.314987 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2a4cd-a41b-462b-a526-ccd039149525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:11:56.315266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2a4cd-a41b-462b-a526-ccd039149525 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:11:56.323545 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2a4cd-a41b-462b-a526-ccd039149525 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:11:56.375217 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: WARNING keystone.common.rbac_enforcer.enforcer [None req-deb2a4cd-a41b-462b-a526-ccd039149525 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 05:11:56.375512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2a4cd-a41b-462b-a526-ccd039149525 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:11:56.385226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Thu Jul 28 05:11:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:11:56.391200 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3bf72-e1d5-41b7-8d56-b4cd635b5bcc None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:11:56.406290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3bf72-e1d5-41b7-8d56-b4cd635b5bcc None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:11:56.410703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a2a57-c732-4e5b-af57-063f09c46404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:11:56.411805 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a2a57-c732-4e5b-af57-063f09c46404 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:11:56.412089 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a2a57-c732-4e5b-af57-063f09c46404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:11:56.412373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a2a57-c732-4e5b-af57-063f09c46404 admin admin] PATH_INFO: `/v3/projects/44e83cd79a56499f92e288b2c69de397` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:11:56.413877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a2a57-c732-4e5b-af57-063f09c46404 admin admin] RBAC: Authorizing `identity:get_project(project_id=44e83cd79a56499f92e288b2c69de397)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:11:56.464437 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b72a2a57-c732-4e5b-af57-063f09c46404 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 05:11:56.464781 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a2a57-c732-4e5b-af57-063f09c46404 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:11:56.469367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Thu Jul 28 05:11:56 2022] GET /identity/v3/projects/44e83cd79a56499f92e288b2c69de397 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:11:58.459868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcc428-8262-4185-85ac-c593391335cc None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:11:58.460391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcc428-8262-4185-85ac-c593391335cc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:11:58.460391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcc428-8262-4185-85ac-c593391335cc None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:11:58.464551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:11:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:11:58.469873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb4376-8fe5-4fc3-b938-810b4ff6526f None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:11:58.470337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb4376-8fe5-4fc3-b938-810b4ff6526f None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:11:58.471414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb4376-8fe5-4fc3-b938-810b4ff6526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:11:58.490217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-d4cb4376-8fe5-4fc3-b938-810b4ff6526f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:11:58.491726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d4cb4376-8fe5-4fc3-b938-810b4ff6526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:11:58.500214 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:11:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 05:11:58.522367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcc428-8262-4185-85ac-c593391335cc None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:11:58.534735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcc428-8262-4185-85ac-c593391335cc None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:11:58.539011 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc895bfc-5da3-422d-80d5-c3b6339b18ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:11:58.539646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc895bfc-5da3-422d-80d5-c3b6339b18ff admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:11:58.539928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc895bfc-5da3-422d-80d5-c3b6339b18ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:11:58.540211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc895bfc-5da3-422d-80d5-c3b6339b18ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:11:58.547939 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc895bfc-5da3-422d-80d5-c3b6339b18ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:11:58.549750 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc895bfc-5da3-422d-80d5-c3b6339b18ff admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:11:58.559069 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Thu Jul 28 05:11:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:11:58.564502 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb4376-8fe5-4fc3-b938-810b4ff6526f None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:11:58.574016 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb4376-8fe5-4fc3-b938-810b4ff6526f None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:11:58.578331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18b95-6738-4b3b-a71d-6b6a8e2688cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:11:58.578952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18b95-6738-4b3b-a71d-6b6a8e2688cd admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:11:58.579231 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18b95-6738-4b3b-a71d-6b6a8e2688cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:11:58.579505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18b95-6738-4b3b-a71d-6b6a8e2688cd admin admin] PATH_INFO: `/v3/users/40170d20cf2e4d67929f88ba378a2373` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:11:58.580857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d18b95-6738-4b3b-a71d-6b6a8e2688cd admin admin] RBAC: Authorizing `identity:get_user(user_id=40170d20cf2e4d67929f88ba378a2373)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:11:58.582678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d18b95-6738-4b3b-a71d-6b6a8e2688cd admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:11:58.584193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Thu Jul 28 05:11:58 2022] GET /identity/v3/users/40170d20cf2e4d67929f88ba378a2373 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:00.632661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d4a3a-3d74-48d6-9d48-c22a732086d3 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:00.633918 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d4a3a-3d74-48d6-9d48-c22a732086d3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:00.633918 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d4a3a-3d74-48d6-9d48-c22a732086d3 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:00.635333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:00.640193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e2ac4-145c-44ec-ba5f-8635aa997642 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:00.640591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e2ac4-145c-44ec-ba5f-8635aa997642 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:00.640873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e2ac4-145c-44ec-ba5f-8635aa997642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:00.659918 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-da3e2ac4-145c-44ec-ba5f-8635aa997642 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:00.661107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-da3e2ac4-145c-44ec-ba5f-8635aa997642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:00.673710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af0828-7d60-4849-a577-3176c99e6c58 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:00.673994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af0828-7d60-4849-a577-3176c99e6c58 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:00.674275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af0828-7d60-4849-a577-3176c99e6c58 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:00.675596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:12:00.681199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fce91-2b65-4838-86a3-ccc8b663e4c8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:00.681506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fce91-2b65-4838-86a3-ccc8b663e4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:00.681785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fce91-2b65-4838-86a3-ccc8b663e4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:00.724008 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG passlib.handlers.bcrypt [None req-a58fce91-2b65-4838-86a3-ccc8b663e4c8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80267) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 05:12:00.724472 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG passlib.handlers.bcrypt [None req-a58fce91-2b65-4838-86a3-ccc8b663e4c8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80267) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 05:12:00.740799 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:00.764314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e2ac4-145c-44ec-ba5f-8635aa997642 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:00.771002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a58fce91-2b65-4838-86a3-ccc8b663e4c8 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:00.772595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a58fce91-2b65-4838-86a3-ccc8b663e4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:00.786896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:00.867895 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e2ac4-145c-44ec-ba5f-8635aa997642 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:00.872715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:00.894960 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fce91-2b65-4838-86a3-ccc8b663e4c8 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:00.901210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a82f6-a71b-429f-9cff-fabd4b664a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:00.901895 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a82f6-a71b-429f-9cff-fabd4b664a95 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:00.902180 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a82f6-a71b-429f-9cff-fabd4b664a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:00.902456 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a82f6-a71b-429f-9cff-fabd4b664a95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:00.913608 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a82f6-a71b-429f-9cff-fabd4b664a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:00.922724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-c79a82f6-a71b-429f-9cff-fabd4b664a95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:00.922724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:00.922724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:00.922724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:00.922724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:00.922724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:00.922724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:00.922724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:00.922724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:00.922724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:00.922724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:00.922724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:00.922724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:00.922724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:00.922724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:00.922724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:00.923655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:00.923655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:00.923655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:00.923655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:00.923655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:00.923655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:00.923655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:00.923655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:00.923655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:00.923655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:00.923655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:00.923655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:00.923655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:00.923655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:00.923655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:00.923655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:00.924760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:00.924760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:00.924760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:00.924760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:00.924760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:00.924760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:00.924760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:00.924760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:00.924760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:00.924760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:00.924760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:00.924760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:00.924760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:12:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:12:00.929612 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a82f6-a71b-429f-9cff-fabd4b664a95 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:00.997701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fce91-2b65-4838-86a3-ccc8b663e4c8 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:00.999940 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:01.011030 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:01.028549 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a82f6-a71b-429f-9cff-fabd4b664a95 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:01.033657 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648d438-e9b1-41ff-8da8-9c58d32a0b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:01.034528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648d438-e9b1-41ff-8da8-9c58d32a0b1e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:01.034811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648d438-e9b1-41ff-8da8-9c58d32a0b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:01.035083 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648d438-e9b1-41ff-8da8-9c58d32a0b1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:01.064407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcc88a-da78-4812-b5dc-3669d09396a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:01.065035 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcc88a-da78-4812-b5dc-3669d09396a6 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:01.065322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcc88a-da78-4812-b5dc-3669d09396a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:01.065635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcc88a-da78-4812-b5dc-3669d09396a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:01.066370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcc88a-da78-4812-b5dc-3669d09396a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:01.066681 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcc88a-da78-4812-b5dc-3669d09396a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:01.068080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcc88a-da78-4812-b5dc-3669d09396a6 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:01.080120 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 8/15] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:01.085618 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcc88a-da78-4812-b5dc-3669d09396a6 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:01.105228 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648d438-e9b1-41ff-8da8-9c58d32a0b1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:01.106809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648d438-e9b1-41ff-8da8-9c58d32a0b1e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:01.185916 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcc88a-da78-4812-b5dc-3669d09396a6 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:01.205943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 8/16] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:12:01.212428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648d438-e9b1-41ff-8da8-9c58d32a0b1e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:01.215683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:01.318640 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648d438-e9b1-41ff-8da8-9c58d32a0b1e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:01.326382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12984706-018b-407e-abfa-99738a34fb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:01.327032 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12984706-018b-407e-abfa-99738a34fb04 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:01.327320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12984706-018b-407e-abfa-99738a34fb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:01.327938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12984706-018b-407e-abfa-99738a34fb04 None admin] PATH_INFO: `/v3/users/40170d20cf2e4d67929f88ba378a2373` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:01.328781 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12984706-018b-407e-abfa-99738a34fb04 None admin] RBAC: Authorizing `identity:get_user(user_id=40170d20cf2e4d67929f88ba378a2373)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:01.330246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12984706-018b-407e-abfa-99738a34fb04 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:01.331830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 9/17] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:01 2022] GET /identity/v3/users/40170d20cf2e4d67929f88ba378a2373 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:01.337431 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12984706-018b-407e-abfa-99738a34fb04 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:01.352033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:01.356346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5bad-4522-403a-85cb-60a4508a03df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:01.357208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5bad-4522-403a-85cb-60a4508a03df None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:01.357521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5bad-4522-403a-85cb-60a4508a03df None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:01.357806 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5bad-4522-403a-85cb-60a4508a03df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:01.376607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c5bad-4522-403a-85cb-60a4508a03df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:01.378114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c5bad-4522-403a-85cb-60a4508a03df None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:01.396439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-279c5bad-4522-403a-85cb-60a4508a03df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:12:01.396439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:01.396439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:01.396439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:01.396439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:01.396439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:01.396439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:01.396439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:01.396439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:01.396439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:01.396439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:01.396439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:01.396439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:12:01.396439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:12:01.396439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:01.397269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:01.399632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:12:01.399632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:12:01.399632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:12:01.399632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:01.399632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 9/18] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:12:01.404038 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5bad-4522-403a-85cb-60a4508a03df None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:01.440115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12984706-018b-407e-abfa-99738a34fb04 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:01.458732 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:01.474266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cc778-b520-4683-b9d1-d19163055324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:01.474916 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cc778-b520-4683-b9d1-d19163055324 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:01.475204 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cc778-b520-4683-b9d1-d19163055324 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:01.475484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cc778-b520-4683-b9d1-d19163055324 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:01.477269 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cc778-b520-4683-b9d1-d19163055324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:01.478967 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cc778-b520-4683-b9d1-d19163055324 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:01.480558 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 10/19] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:01.486308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cc778-b520-4683-b9d1-d19163055324 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:01.503698 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5bad-4522-403a-85cb-60a4508a03df None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:01.537113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f185a3b-eeb0-46b7-9995-1bdc091427ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:01.537770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f185a3b-eeb0-46b7-9995-1bdc091427ad None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:01.538057 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f185a3b-eeb0-46b7-9995-1bdc091427ad None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:01.538340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f185a3b-eeb0-46b7-9995-1bdc091427ad None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:01.539053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f185a3b-eeb0-46b7-9995-1bdc091427ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:01.539898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f185a3b-eeb0-46b7-9995-1bdc091427ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:01.541282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f185a3b-eeb0-46b7-9995-1bdc091427ad None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:01.558384 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 10/20] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:01.567586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:01.588846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cc778-b520-4683-b9d1-d19163055324 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:01.626933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427920ec-e77b-4d52-b1bd-e06b9abd15b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:01.627581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427920ec-e77b-4d52-b1bd-e06b9abd15b5 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:01.627864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427920ec-e77b-4d52-b1bd-e06b9abd15b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:01.628140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427920ec-e77b-4d52-b1bd-e06b9abd15b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:01.628946 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427920ec-e77b-4d52-b1bd-e06b9abd15b5 None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.domain.id=default, user.id=40170d20cf2e4d67929f88ba378a2373) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:01.629261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427920ec-e77b-4d52-b1bd-e06b9abd15b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:01.630769 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427920ec-e77b-4d52-b1bd-e06b9abd15b5 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:01.638860 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 11/21] 10.222.0.33 () {56 vars in 1322 bytes} [Thu Jul 28 05:12:01 2022] GET /identity/v3/role_assignments?user.id=40170d20cf2e4d67929f88ba378a2373&scope.domain.id=default&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:03.914704 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8650e5d-4f86-4036-8cd7-f7be0da40332 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:03.915348 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8650e5d-4f86-4036-8cd7-f7be0da40332 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:03.915348 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8650e5d-4f86-4036-8cd7-f7be0da40332 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:03.916792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 11/22] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:03.922624 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8704c-5f43-4e11-b2db-6de32c64848f None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:03.923036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8704c-5f43-4e11-b2db-6de32c64848f None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:03.923218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8704c-5f43-4e11-b2db-6de32c64848f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:03.951343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-27f8704c-5f43-4e11-b2db-6de32c64848f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:03.952544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-27f8704c-5f43-4e11-b2db-6de32c64848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:04.054844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 12/23] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:04.090964 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8650e5d-4f86-4036-8cd7-f7be0da40332 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:04.207613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab2707-6153-4396-a584-0215b2fcd92d None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:04.207897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab2707-6153-4396-a584-0215b2fcd92d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:04.208080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab2707-6153-4396-a584-0215b2fcd92d None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:04.209414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:12:04.219154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919577b-cf71-4c48-a7b3-c8e530fffae9 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:04.219436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919577b-cf71-4c48-a7b3-c8e530fffae9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:04.219711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919577b-cf71-4c48-a7b3-c8e530fffae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:04.244986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e919577b-cf71-4c48-a7b3-c8e530fffae9 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:04.246717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e919577b-cf71-4c48-a7b3-c8e530fffae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:04.255144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8650e5d-4f86-4036-8cd7-f7be0da40332 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:04.288523 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:04.322032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64532ec2-fe88-4ac3-87dc-bb8e59002f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:04.322735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64532ec2-fe88-4ac3-87dc-bb8e59002f1f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:04.324083 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64532ec2-fe88-4ac3-87dc-bb8e59002f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:04.324362 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64532ec2-fe88-4ac3-87dc-bb8e59002f1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:04.341851 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64532ec2-fe88-4ac3-87dc-bb8e59002f1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:04.351367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-64532ec2-fe88-4ac3-87dc-bb8e59002f1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:04.351367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:04.351367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:04.351367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:04.351367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:04.351367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:04.351367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:04.351367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:04.351367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:04.351367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:04.351367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:04.351367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:04.351367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:04.351367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:04.351367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:04.351367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:04.352252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:04.352252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:04.352252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:04.352252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:04.352252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:04.352252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:04.352252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:04.352252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:04.352252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:04.352252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:04.352252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:04.352252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:04.352252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:04.352252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:04.352252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:04.352252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:04.352986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:04.352986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:04.352986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:04.352986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:04.352986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:04.352986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:04.352986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:04.352986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:04.352986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:04.352986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:04.352986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:04.352986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:04.354765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 12/25] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:12:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:04.356110 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1fa0e-c251-43e1-aa88-f386a0a53176 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:04.356559 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1fa0e-c251-43e1-aa88-f386a0a53176 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:04.357000 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1fa0e-c251-43e1-aa88-f386a0a53176 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:04.358437 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 13/26] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:04.359714 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136653af-c9b1-4208-b008-a31811601153 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:04.360156 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136653af-c9b1-4208-b008-a31811601153 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:04.360575 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136653af-c9b1-4208-b008-a31811601153 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:04.361935 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 14/27] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:04.366925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590f1b5-cb8d-4beb-8e83-e831d79e6564 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:04.366925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590f1b5-cb8d-4beb-8e83-e831d79e6564 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:04.366925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590f1b5-cb8d-4beb-8e83-e831d79e6564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:04.378945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 14/28] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:04.380271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919577b-cf71-4c48-a7b3-c8e530fffae9 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:04.391565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-7590f1b5-cb8d-4beb-8e83-e831d79e6564 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:04.393005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7590f1b5-cb8d-4beb-8e83-e831d79e6564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:04.395482 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:04.483388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 15/29] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:04.484854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f8859-9b34-481a-afc2-afc1b3d80d48 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:04.485352 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f8859-9b34-481a-afc2-afc1b3d80d48 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:04.486403 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f8859-9b34-481a-afc2-afc1b3d80d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:04.513005 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919577b-cf71-4c48-a7b3-c8e530fffae9 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:04.515050 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-da3f8859-9b34-481a-afc2-afc1b3d80d48 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:04.516674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-da3f8859-9b34-481a-afc2-afc1b3d80d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:04.563036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5f466-e43a-4dc1-943a-10e653c74df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:04.564277 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5f466-e43a-4dc1-943a-10e653c74df4 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:04.564741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5f466-e43a-4dc1-943a-10e653c74df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:04.565195 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5f466-e43a-4dc1-943a-10e653c74df4 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:04.566167 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5f466-e43a-4dc1-943a-10e653c74df4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:04.566672 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5f466-e43a-4dc1-943a-10e653c74df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:04.568301 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5f466-e43a-4dc1-943a-10e653c74df4 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:04.579940 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 15/30] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:04.581185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5f466-e43a-4dc1-943a-10e653c74df4 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:04.665299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:04.704870 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 16/31] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:04.705519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5f466-e43a-4dc1-943a-10e653c74df4 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:04.706079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f8859-9b34-481a-afc2-afc1b3d80d48 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:04.750013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:04.756894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bbedc-5529-4721-a75a-c2428dea9035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:04.758573 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bbedc-5529-4721-a75a-c2428dea9035 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:04.759290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bbedc-5529-4721-a75a-c2428dea9035 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:04.762784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bbedc-5529-4721-a75a-c2428dea9035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:04.771040 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bbedc-5529-4721-a75a-c2428dea9035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:04.772751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bbedc-5529-4721-a75a-c2428dea9035 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:04.795042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-ee2bbedc-5529-4721-a75a-c2428dea9035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:12:04.795042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:04.795042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:04.795042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:04.795042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:04.795042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:04.795042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:04.795042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:04.795042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:04.795042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:04.795042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:04.795042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:04.795042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:12:04.795042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:12:04.795042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:04.795861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:04.796631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:12:04.796631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:12:04.796631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:12:04.796631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:04.798538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 16/32] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:04.799528 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bbedc-5529-4721-a75a-c2428dea9035 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:04.835701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f8859-9b34-481a-afc2-afc1b3d80d48 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:04.878613 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bae9b7-6708-4916-ace7-94e273f586a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:04.879577 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bae9b7-6708-4916-ace7-94e273f586a2 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:04.880049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bae9b7-6708-4916-ace7-94e273f586a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:04.880761 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bae9b7-6708-4916-ace7-94e273f586a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:04.882265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bae9b7-6708-4916-ace7-94e273f586a2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:04.884173 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bae9b7-6708-4916-ace7-94e273f586a2 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:04.918705 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bbedc-5529-4721-a75a-c2428dea9035 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:04.937356 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:04.954677 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f636fb-882c-42a7-88ee-6ab7029784c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:04.955388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f636fb-882c-42a7-88ee-6ab7029784c3 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:04.955716 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f636fb-882c-42a7-88ee-6ab7029784c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:04.955997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f636fb-882c-42a7-88ee-6ab7029784c3 None admin] PATH_INFO: `/v3/users/40170d20cf2e4d67929f88ba378a2373` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:04.957198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f636fb-882c-42a7-88ee-6ab7029784c3 None admin] RBAC: Authorizing `identity:get_user(user_id=40170d20cf2e4d67929f88ba378a2373)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:04.958683 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f636fb-882c-42a7-88ee-6ab7029784c3 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:04.964886 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 17/33] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:04 2022] GET /identity/v3/users/40170d20cf2e4d67929f88ba378a2373 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:04.964886 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f636fb-882c-42a7-88ee-6ab7029784c3 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:05.078934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f636fb-882c-42a7-88ee-6ab7029784c3 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:05.116350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc52b1-1472-4ca8-91ec-34eba6941760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:05.117027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc52b1-1472-4ca8-91ec-34eba6941760 None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:05.117425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc52b1-1472-4ca8-91ec-34eba6941760 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:05.117734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc52b1-1472-4ca8-91ec-34eba6941760 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:05.118460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc52b1-1472-4ca8-91ec-34eba6941760 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:05.119838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc52b1-1472-4ca8-91ec-34eba6941760 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:05.141975 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 17/34] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Jul 28 05:12:04 2022] POST /identity/v3/roles => generated 225 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:12:05.143693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bae9b7-6708-4916-ace7-94e273f586a2 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:05.257740 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:05.273907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bae9b7-6708-4916-ace7-94e273f586a2 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:05.352603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc49df9-0c6a-484a-81d0-8a66c7b8d836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:05.353212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49df9-0c6a-484a-81d0-8a66c7b8d836 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:05.353568 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49df9-0c6a-484a-81d0-8a66c7b8d836 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:05.353802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49df9-0c6a-484a-81d0-8a66c7b8d836 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:05.354575 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc49df9-0c6a-484a-81d0-8a66c7b8d836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:05.354888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc49df9-0c6a-484a-81d0-8a66c7b8d836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:05.356428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc49df9-0c6a-484a-81d0-8a66c7b8d836 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:05.370174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 18/35] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:05.371021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc49df9-0c6a-484a-81d0-8a66c7b8d836 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:05.372439 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 18/36] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Jul 28 05:12:04 2022] POST /identity/v3/roles => generated 219 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:12:05.374176 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03e1a4-bd77-40cd-b734-bd939b9997db None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:05.374466 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03e1a4-bd77-40cd-b734-bd939b9997db None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:05.374750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03e1a4-bd77-40cd-b734-bd939b9997db None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:05.376126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 19/37] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:05.376640 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03e1a4-bd77-40cd-b734-bd939b9997db None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:05.453893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:05.515164 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc49df9-0c6a-484a-81d0-8a66c7b8d836 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:05.536556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03e1a4-bd77-40cd-b734-bd939b9997db None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:05.560995 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637cfe99-f818-4c8e-b357-e77cf4af11dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:05.561733 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637cfe99-f818-4c8e-b357-e77cf4af11dc None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:05.562015 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637cfe99-f818-4c8e-b357-e77cf4af11dc None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:05.562671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637cfe99-f818-4c8e-b357-e77cf4af11dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:05.564545 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637cfe99-f818-4c8e-b357-e77cf4af11dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:05.566033 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637cfe99-f818-4c8e-b357-e77cf4af11dc None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:05.569545 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 19/38] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:05.571495 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c62067-f7de-4f0f-a3fb-fa679c844d08 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:05.572131 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c62067-f7de-4f0f-a3fb-fa679c844d08 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:05.572923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c62067-f7de-4f0f-a3fb-fa679c844d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:05.585260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2d780-fab1-4111-a867-021ad1c774cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:05.585997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2d780-fab1-4111-a867-021ad1c774cd None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:05.586284 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2d780-fab1-4111-a867-021ad1c774cd None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:05.586565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2d780-fab1-4111-a867-021ad1c774cd None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:05.587459 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2d780-fab1-4111-a867-021ad1c774cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:05.589064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2d780-fab1-4111-a867-021ad1c774cd None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:05.597260 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-62c62067-f7de-4f0f-a3fb-fa679c844d08 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:05.599076 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-62c62067-f7de-4f0f-a3fb-fa679c844d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:05.624627 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:05.674027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 20/39] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:05.674850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c62067-f7de-4f0f-a3fb-fa679c844d08 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:05.719548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 20/40] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jul 28 05:12:05 2022] POST /identity/v3/projects => generated 301 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:12:05.721079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81e28a-ad24-405d-b722-76253225b69d None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:05.721457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81e28a-ad24-405d-b722-76253225b69d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:05.721835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81e28a-ad24-405d-b722-76253225b69d None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:05.723424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 21/41] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:05.724094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81e28a-ad24-405d-b722-76253225b69d None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:05.788249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c62067-f7de-4f0f-a3fb-fa679c844d08 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:05.832451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33aedec-1915-497b-ba2a-63d0ff8e2b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:05.833531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aedec-1915-497b-ba2a-63d0ff8e2b3d None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:05.834263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aedec-1915-497b-ba2a-63d0ff8e2b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:05.834558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aedec-1915-497b-ba2a-63d0ff8e2b3d None admin] PATH_INFO: `/v3/domains/default/users/40170d20cf2e4d67929f88ba378a2373/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:05.836986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:05.839663 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33aedec-1915-497b-ba2a-63d0ff8e2b3d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=40170d20cf2e4d67929f88ba378a2373, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:05.841175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33aedec-1915-497b-ba2a-63d0ff8e2b3d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:05.842036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81e28a-ad24-405d-b722-76253225b69d None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:05.880932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31de718-bb3a-4e23-bee8-e6d8598990bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:05.881512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31de718-bb3a-4e23-bee8-e6d8598990bd None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:05.881803 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31de718-bb3a-4e23-bee8-e6d8598990bd None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:05.882080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31de718-bb3a-4e23-bee8-e6d8598990bd None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:05.882927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31de718-bb3a-4e23-bee8-e6d8598990bd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:05.884328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31de718-bb3a-4e23-bee8-e6d8598990bd None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:05.929420 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 21/42] 10.222.0.33 () {58 vars in 1361 bytes} [Thu Jul 28 05:12:05 2022] PUT /identity/v3/domains/default/users/40170d20cf2e4d67929f88ba378a2373/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:12:05.931819 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece79d1-431a-4580-ae88-f76049e8dd2e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:05.932117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece79d1-431a-4580-ae88-f76049e8dd2e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:05.932398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece79d1-431a-4580-ae88-f76049e8dd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:05.947920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 22/43] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Jul 28 05:12:05 2022] POST /identity/v3/roles => generated 223 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:12:05.956570 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1ece79d1-431a-4580-ae88-f76049e8dd2e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:05.957961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1ece79d1-431a-4580-ae88-f76049e8dd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:05.971615 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:06.042683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 22/44] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:06.066758 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31de718-bb3a-4e23-bee8-e6d8598990bd None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:06.179222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31de718-bb3a-4e23-bee8-e6d8598990bd None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:06.216147 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826bdd6-c8bc-4fc0-98e2-7995e08d9660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:06.216798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826bdd6-c8bc-4fc0-98e2-7995e08d9660 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:06.217087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826bdd6-c8bc-4fc0-98e2-7995e08d9660 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:06.217365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826bdd6-c8bc-4fc0-98e2-7995e08d9660 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:06.218569 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826bdd6-c8bc-4fc0-98e2-7995e08d9660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:06.220020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826bdd6-c8bc-4fc0-98e2-7995e08d9660 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:06.221816 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 23/45] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:06.228118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece79d1-431a-4580-ae88-f76049e8dd2e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:06.330497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece79d1-431a-4580-ae88-f76049e8dd2e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:06.364082 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c68205-24ea-4e19-8b4c-a71264c7bfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:06.364714 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c68205-24ea-4e19-8b4c-a71264c7bfb0 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:06.364995 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c68205-24ea-4e19-8b4c-a71264c7bfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:06.365273 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c68205-24ea-4e19-8b4c-a71264c7bfb0 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:06.365985 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c68205-24ea-4e19-8b4c-a71264c7bfb0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:06.367475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c68205-24ea-4e19-8b4c-a71264c7bfb0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:06.384238 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:06.461384 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jul 28 05:12:06 2022] POST /identity/v3/projects => generated 312 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:12:07.968080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beea2b-f3b7-4246-842d-7435e03ee2ac None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:07.968592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beea2b-f3b7-4246-842d-7435e03ee2ac None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:07.968676 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beea2b-f3b7-4246-842d-7435e03ee2ac None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:07.970104 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 24/47] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:07.975421 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b921d3-3ff7-4f01-bdb8-61da2a488fcf None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:07.975856 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b921d3-3ff7-4f01-bdb8-61da2a488fcf None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:07.976073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b921d3-3ff7-4f01-bdb8-61da2a488fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:07.994263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-33b921d3-3ff7-4f01-bdb8-61da2a488fcf None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:07.995435 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-33b921d3-3ff7-4f01-bdb8-61da2a488fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:08.061147 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 24/48] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:08.083810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beea2b-f3b7-4246-842d-7435e03ee2ac None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:08.111665 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:08.186841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beea2b-f3b7-4246-842d-7435e03ee2ac None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:08.221107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d84f4-4199-43d0-b9ae-e303ca7c5af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:08.221736 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d84f4-4199-43d0-b9ae-e303ca7c5af8 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:08.222026 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d84f4-4199-43d0-b9ae-e303ca7c5af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:08.222308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d84f4-4199-43d0-b9ae-e303ca7c5af8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:08.232955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d84f4-4199-43d0-b9ae-e303ca7c5af8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:08.238014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-3a1d84f4-4199-43d0-b9ae-e303ca7c5af8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:08.238014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:08.238014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:08.238014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:08.238014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:08.238014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:08.238014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:08.238014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:08.238014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:08.238014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:08.238014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:08.238014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:08.238014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:08.238014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:08.238014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:08.238014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:08.238993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:08.238993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:08.238993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:08.238993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:08.238993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:08.238993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:08.238993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:08.238993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:08.238993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:08.238993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:08.238993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:08.238993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:08.238993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:08.238993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:08.238993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:08.238993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:08.239747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:08.239747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:08.239747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:08.239747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:08.239747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:08.239747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:08.239747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:08.239747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:08.239747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:08.239747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:08.239747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:08.239747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:08.239747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 25/49] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:12:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:08.245066 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b921d3-3ff7-4f01-bdb8-61da2a488fcf None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:08.345248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b921d3-3ff7-4f01-bdb8-61da2a488fcf None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:08.370567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:08.378665 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd831b29-25c9-4ba9-83dc-6afda7aad942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:08.379306 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd831b29-25c9-4ba9-83dc-6afda7aad942 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:08.379594 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd831b29-25c9-4ba9-83dc-6afda7aad942 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:08.379874 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd831b29-25c9-4ba9-83dc-6afda7aad942 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:08.380604 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd831b29-25c9-4ba9-83dc-6afda7aad942 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:08.380915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd831b29-25c9-4ba9-83dc-6afda7aad942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:08.382365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd831b29-25c9-4ba9-83dc-6afda7aad942 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:08.394344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 25/50] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:08.400587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d84f4-4199-43d0-b9ae-e303ca7c5af8 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:08.462438 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a9080-4c7d-4171-86a7-522ea8980548 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:08.462728 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a9080-4c7d-4171-86a7-522ea8980548 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:08.463009 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a9080-4c7d-4171-86a7-522ea8980548 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:08.464356 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 26/51] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:12:08.469200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f594998-7200-4dbc-bb63-6c8765eeaa06 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:08.469519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f594998-7200-4dbc-bb63-6c8765eeaa06 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:08.469809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f594998-7200-4dbc-bb63-6c8765eeaa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:08.486393 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:08.488235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3f594998-7200-4dbc-bb63-6c8765eeaa06 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:08.489442 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3f594998-7200-4dbc-bb63-6c8765eeaa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:08.501237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d84f4-4199-43d0-b9ae-e303ca7c5af8 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:08.538594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7945b-df6e-4371-8a75-92226083b93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:08.539376 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7945b-df6e-4371-8a75-92226083b93a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:08.539749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7945b-df6e-4371-8a75-92226083b93a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:08.540046 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7945b-df6e-4371-8a75-92226083b93a None admin] PATH_INFO: `/v3/users/40170d20cf2e4d67929f88ba378a2373` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:08.541262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7945b-df6e-4371-8a75-92226083b93a None admin] RBAC: Authorizing `identity:get_user(user_id=40170d20cf2e4d67929f88ba378a2373)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:08.542768 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7945b-df6e-4371-8a75-92226083b93a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:08.544380 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 26/52] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:08 2022] GET /identity/v3/users/40170d20cf2e4d67929f88ba378a2373 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:08.549892 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7945b-df6e-4371-8a75-92226083b93a None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:08.558426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 27/53] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:08.581373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f594998-7200-4dbc-bb63-6c8765eeaa06 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:08.651742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7945b-df6e-4371-8a75-92226083b93a None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:08.680446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f594998-7200-4dbc-bb63-6c8765eeaa06 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:08.685794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e0d18-9abf-491a-81f1-c59968c2ce24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:08.686446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e0d18-9abf-491a-81f1-c59968c2ce24 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:08.686733 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e0d18-9abf-491a-81f1-c59968c2ce24 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:08.687014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e0d18-9abf-491a-81f1-c59968c2ce24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:08.688193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e0d18-9abf-491a-81f1-c59968c2ce24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:08.689944 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e0d18-9abf-491a-81f1-c59968c2ce24 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:08.691534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 27/54] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:08.697478 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e0d18-9abf-491a-81f1-c59968c2ce24 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:08.697976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:08.714913 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790414b-4718-4ce6-bd8e-d66d55b12fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:08.715771 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790414b-4718-4ce6-bd8e-d66d55b12fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:08.715887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790414b-4718-4ce6-bd8e-d66d55b12fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:08.716124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790414b-4718-4ce6-bd8e-d66d55b12fe4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:08.717319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790414b-4718-4ce6-bd8e-d66d55b12fe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:08.718807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790414b-4718-4ce6-bd8e-d66d55b12fe4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:08.720400 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 28/55] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:08.721010 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:08.725840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790414b-4718-4ce6-bd8e-d66d55b12fe4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:08.796941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e0d18-9abf-491a-81f1-c59968c2ce24 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:08.824969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790414b-4718-4ce6-bd8e-d66d55b12fe4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:08.831919 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccca8c-b74b-4bd1-9392-5cdf0d41eeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:08.833234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccca8c-b74b-4bd1-9392-5cdf0d41eeb0 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:08.833234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccca8c-b74b-4bd1-9392-5cdf0d41eeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:08.833234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccca8c-b74b-4bd1-9392-5cdf0d41eeb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:08.833941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccca8c-b74b-4bd1-9392-5cdf0d41eeb0 None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.domain.id=default, user.id=40170d20cf2e4d67929f88ba378a2373) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:08.834261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccca8c-b74b-4bd1-9392-5cdf0d41eeb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:08.835700 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccca8c-b74b-4bd1-9392-5cdf0d41eeb0 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:08.842028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 28/56] 10.222.0.33 () {56 vars in 1322 bytes} [Thu Jul 28 05:12:08 2022] GET /identity/v3/role_assignments?user.id=40170d20cf2e4d67929f88ba378a2373&scope.domain.id=default&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:08.861956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1749cda-51c1-4146-a977-250f04af8a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:08.862684 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1749cda-51c1-4146-a977-250f04af8a6d None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:08.862971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1749cda-51c1-4146-a977-250f04af8a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:08.863252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1749cda-51c1-4146-a977-250f04af8a6d None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:08.863959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1749cda-51c1-4146-a977-250f04af8a6d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:08.865638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1749cda-51c1-4146-a977-250f04af8a6d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:08.989090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 29/57] 10.222.0.33 () {60 vars in 1140 bytes} [Thu Jul 28 05:12:08 2022] POST /identity/v3/projects => generated 298 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:12:11.000621 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f52cfc-8c6a-4862-ba47-86c15016c4a3 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:11.001138 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f52cfc-8c6a-4862-ba47-86c15016c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:11.001225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f52cfc-8c6a-4862-ba47-86c15016c4a3 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:11.002563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 29/58] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:11.007570 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e4be0-9db4-44c0-b006-7dfe69cfbb43 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:11.008586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e4be0-9db4-44c0-b006-7dfe69cfbb43 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:11.009089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e4be0-9db4-44c0-b006-7dfe69cfbb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:11.027824 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-709e4be0-9db4-44c0-b006-7dfe69cfbb43 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:11.029021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-709e4be0-9db4-44c0-b006-7dfe69cfbb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:11.057432 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:11.094795 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 30/59] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:11.118644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f52cfc-8c6a-4862-ba47-86c15016c4a3 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:11.203591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:11.219364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f52cfc-8c6a-4862-ba47-86c15016c4a3 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:11.253133 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9924d5-ddb1-4fbd-8e2b-1753e29b7a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:11.253741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9924d5-ddb1-4fbd-8e2b-1753e29b7a04 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:11.254032 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9924d5-ddb1-4fbd-8e2b-1753e29b7a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:11.254315 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9924d5-ddb1-4fbd-8e2b-1753e29b7a04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:11.255473 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9924d5-ddb1-4fbd-8e2b-1753e29b7a04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:11.256925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9924d5-ddb1-4fbd-8e2b-1753e29b7a04 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:11.258783 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 30/60] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:11.264393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e4be0-9db4-44c0-b006-7dfe69cfbb43 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:11.360789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e4be0-9db4-44c0-b006-7dfe69cfbb43 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:11.393016 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814edda-21e5-45eb-b45c-f6a66e6c9c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:11.393677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814edda-21e5-45eb-b45c-f6a66e6c9c9f None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:11.393964 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814edda-21e5-45eb-b45c-f6a66e6c9c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:11.394247 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814edda-21e5-45eb-b45c-f6a66e6c9c9f None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:11.394930 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814edda-21e5-45eb-b45c-f6a66e6c9c9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:11.396381 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814edda-21e5-45eb-b45c-f6a66e6c9c9f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:11.484149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 31/61] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:12:11 2022] POST /identity/v3/users => generated 275 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:12:14.623859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bf4d0-8e16-48b6-b342-360c9b61791e None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:14.624909 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bf4d0-8e16-48b6-b342-360c9b61791e None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:14.625440 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bf4d0-8e16-48b6-b342-360c9b61791e None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:14.627027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 31/62] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:14.632183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f30f-ceb1-4af7-b74e-adb6f4f7a956 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:14.633135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f30f-ceb1-4af7-b74e-adb6f4f7a956 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:14.633834 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f30f-ceb1-4af7-b74e-adb6f4f7a956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:14.658550 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8c68f30f-ceb1-4af7-b74e-adb6f4f7a956 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:14.660122 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8c68f30f-ceb1-4af7-b74e-adb6f4f7a956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:14.685184 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:14.748958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 32/63] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:14.774742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bf4d0-8e16-48b6-b342-360c9b61791e None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:14.839431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8d514-7839-4fb2-8c03-7733fa4f7e40 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:14.839767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8d514-7839-4fb2-8c03-7733fa4f7e40 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:14.840017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8d514-7839-4fb2-8c03-7733fa4f7e40 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:14.841374 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 33/64] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:12:14.846131 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633f650-e05f-419a-b2e2-7824c67eb6cb None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:14.846422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633f650-e05f-419a-b2e2-7824c67eb6cb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:14.846706 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633f650-e05f-419a-b2e2-7824c67eb6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:14.875293 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2633f650-e05f-419a-b2e2-7824c67eb6cb None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:14.878457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2633f650-e05f-419a-b2e2-7824c67eb6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:14.966709 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bf4d0-8e16-48b6-b342-360c9b61791e None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:15.001409 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 34/65] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:15.005160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0ade7-bc17-4b3b-9dbc-d7480255df6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:15.006066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0ade7-bc17-4b3b-9dbc-d7480255df6f None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:15.006545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0ade7-bc17-4b3b-9dbc-d7480255df6f None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:15.007014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0ade7-bc17-4b3b-9dbc-d7480255df6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:15.010569 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ede97-474c-489a-9f72-f38c56629f6d None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:15.010870 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ede97-474c-489a-9f72-f38c56629f6d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:15.011161 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ede97-474c-489a-9f72-f38c56629f6d None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:15.012496 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 35/66] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:15.013562 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601a9ae-514d-4f14-a111-5484d446e28d None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:15.013876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601a9ae-514d-4f14-a111-5484d446e28d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:15.014132 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601a9ae-514d-4f14-a111-5484d446e28d None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:15.015478 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 36/67] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:15.019895 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0ade7-bc17-4b3b-9dbc-d7480255df6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:15.020339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec2106-7cd5-464c-a80d-ec1654f14982 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:15.020636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec2106-7cd5-464c-a80d-ec1654f14982 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:15.020923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec2106-7cd5-464c-a80d-ec1654f14982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:15.027140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-77b0ade7-bc17-4b3b-9dbc-d7480255df6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:15.027140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:15.027140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:15.027140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:15.027140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:15.027140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:15.027140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:15.027140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:15.027140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:15.027140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:15.027140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:15.027140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:15.027140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:15.027140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:15.027140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:15.027140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:15.027986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:15.027986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:15.027986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:15.027986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:15.027986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:15.027986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:15.027986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:15.027986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:15.027986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:15.027986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:15.027986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:15.027986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:15.027986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:15.027986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:15.027986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:15.027986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:15.028711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:15.028711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:15.028711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:15.028711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:15.028711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:15.028711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:15.028711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:15.028711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:15.028711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:15.028711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:15.028711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:15.028711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:15.030623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 32/68] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:12:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:15.035491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45731a1-3e0a-42fb-bcfc-93559867a90d None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:15.035491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45731a1-3e0a-42fb-bcfc-93559867a90d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:15.035491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45731a1-3e0a-42fb-bcfc-93559867a90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:15.042808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-36ec2106-7cd5-464c-a80d-ec1654f14982 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:15.044049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-36ec2106-7cd5-464c-a80d-ec1654f14982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:15.051950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e45731a1-3e0a-42fb-bcfc-93559867a90d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:15.053490 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e45731a1-3e0a-42fb-bcfc-93559867a90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:15.063942 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:15.117848 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 37/69] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:15.119054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec2106-7cd5-464c-a80d-ec1654f14982 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:15.131489 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 33/70] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:15.132491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45731a1-3e0a-42fb-bcfc-93559867a90d None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:15.150091 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:15.236835 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec2106-7cd5-464c-a80d-ec1654f14982 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:15.249194 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45731a1-3e0a-42fb-bcfc-93559867a90d None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:15.272174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19febf2d-8ed2-481d-8b2f-af5fb2a347f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:15.272838 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19febf2d-8ed2-481d-8b2f-af5fb2a347f7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:15.273124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19febf2d-8ed2-481d-8b2f-af5fb2a347f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:15.274103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19febf2d-8ed2-481d-8b2f-af5fb2a347f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:15.284482 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19febf2d-8ed2-481d-8b2f-af5fb2a347f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:15.285435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f627183-b200-40c6-b852-eea16a5fdac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:15.286093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f627183-b200-40c6-b852-eea16a5fdac5 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:15.286402 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f627183-b200-40c6-b852-eea16a5fdac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:15.286668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f627183-b200-40c6-b852-eea16a5fdac5 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:15.287392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f627183-b200-40c6-b852-eea16a5fdac5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:15.287704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f627183-b200-40c6-b852-eea16a5fdac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:15.289123 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f627183-b200-40c6-b852-eea16a5fdac5 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:15.289811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-19febf2d-8ed2-481d-8b2f-af5fb2a347f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:15.289811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:15.289811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:15.289811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:15.289811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:15.289811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:15.289811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:15.289811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:15.289811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:15.289811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:15.289811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:15.289811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:15.289811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:15.289811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:15.289811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:15.289811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:15.290687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:15.290687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:15.290687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:15.290687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:15.290687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:15.290687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:15.290687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:15.290687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:15.290687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:15.290687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:15.290687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:15.290687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:15.290687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:15.290687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:15.290687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:15.290687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:15.291424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:15.291424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:15.291424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:15.291424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:15.291424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:15.291424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:15.291424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:15.291424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:15.291424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:15.291424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:15.291424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:15.291424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:15.291424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 38/71] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:12:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:15.292059 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19febf2d-8ed2-481d-8b2f-af5fb2a347f7 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:15.300235 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 34/72] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:15.301178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f627183-b200-40c6-b852-eea16a5fdac5 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:15.310636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:15.367679 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:15.392764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19febf2d-8ed2-481d-8b2f-af5fb2a347f7 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:15.402158 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f627183-b200-40c6-b852-eea16a5fdac5 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:15.426309 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8da0ad-cf69-49f3-8f8d-9eb2d455480e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:15.426956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8da0ad-cf69-49f3-8f8d-9eb2d455480e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:15.427242 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8da0ad-cf69-49f3-8f8d-9eb2d455480e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:15.427519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8da0ad-cf69-49f3-8f8d-9eb2d455480e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:15.428687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8da0ad-cf69-49f3-8f8d-9eb2d455480e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:15.430307 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8da0ad-cf69-49f3-8f8d-9eb2d455480e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:15.431907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 39/73] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:15.434197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4f5ab-64f2-455a-8a7f-c087e076a871 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:15.434491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4f5ab-64f2-455a-8a7f-c087e076a871 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:15.434775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4f5ab-64f2-455a-8a7f-c087e076a871 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:15.436185 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 40/74] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:15.436831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4f5ab-64f2-455a-8a7f-c087e076a871 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:15.437556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fe324-1b85-48f9-ae26-c8fca9e82c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:15.438215 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fe324-1b85-48f9-ae26-c8fca9e82c52 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:15.438498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fe324-1b85-48f9-ae26-c8fca9e82c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:15.438776 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fe324-1b85-48f9-ae26-c8fca9e82c52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:15.450213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fe324-1b85-48f9-ae26-c8fca9e82c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:15.455181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-f62fe324-1b85-48f9-ae26-c8fca9e82c52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:15.455181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:15.455181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:15.455181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:15.455181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:15.455181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:15.455181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:15.455181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:15.455181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:15.455181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:15.455181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:15.455181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:15.455181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:15.455181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:15.455181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:15.455181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:15.455995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:15.455995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:15.455995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:15.455995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:15.455995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:15.455995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:15.455995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:15.455995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:15.455995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:15.455995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:15.455995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:15.455995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:15.455995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:15.455995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:15.455995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:15.455995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:15.456735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:15.456735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:15.456735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:15.456735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:15.456735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:15.456735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:15.456735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:15.456735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:15.456735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:15.456735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:15.456735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:15.456735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:15.456735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 35/75] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:15.457335 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fe324-1b85-48f9-ae26-c8fca9e82c52 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:15.524560 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:15.542569 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4f5ab-64f2-455a-8a7f-c087e076a871 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:15.559843 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fe324-1b85-48f9-ae26-c8fca9e82c52 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:15.577523 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d64d1-01fd-4445-b6ed-9dda137d4827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:15.578150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d64d1-01fd-4445-b6ed-9dda137d4827 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:15.578436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d64d1-01fd-4445-b6ed-9dda137d4827 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:15.578711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d64d1-01fd-4445-b6ed-9dda137d4827 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:15.579421 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d64d1-01fd-4445-b6ed-9dda137d4827 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:15.579732 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d64d1-01fd-4445-b6ed-9dda137d4827 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:15.581143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d64d1-01fd-4445-b6ed-9dda137d4827 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:15.589773 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 41/76] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:12:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:15.590542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d64d1-01fd-4445-b6ed-9dda137d4827 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:15.594623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:15.594746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff4225-b95c-4bcc-b111-b6f38a2a7ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:15.595303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4225-b95c-4bcc-b111-b6f38a2a7ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:15.595583 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4225-b95c-4bcc-b111-b6f38a2a7ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:15.595854 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4225-b95c-4bcc-b111-b6f38a2a7ed6 None admin] PATH_INFO: `/v3/users/40170d20cf2e4d67929f88ba378a2373` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:15.597044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff4225-b95c-4bcc-b111-b6f38a2a7ed6 None admin] RBAC: Authorizing `identity:get_user(user_id=40170d20cf2e4d67929f88ba378a2373)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:15.598502 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff4225-b95c-4bcc-b111-b6f38a2a7ed6 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:15.600074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 36/77] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:15 2022] GET /identity/v3/users/40170d20cf2e4d67929f88ba378a2373 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:15.601168 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21a12c-a85b-49ae-a8ba-d6d49734baab None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:15.602164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21a12c-a85b-49ae-a8ba-d6d49734baab None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:15.602546 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21a12c-a85b-49ae-a8ba-d6d49734baab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:15.620222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-3d21a12c-a85b-49ae-a8ba-d6d49734baab None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:15.621407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-3d21a12c-a85b-49ae-a8ba-d6d49734baab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:15.687537 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 37/78] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:15.688303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21a12c-a85b-49ae-a8ba-d6d49734baab None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:15.689501 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d64d1-01fd-4445-b6ed-9dda137d4827 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:15.723382 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6e852-30a8-43f8-90a4-484487c5d8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:15.724009 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6e852-30a8-43f8-90a4-484487c5d8e3 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:15.724289 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6e852-30a8-43f8-90a4-484487c5d8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:15.724562 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6e852-30a8-43f8-90a4-484487c5d8e3 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:15.725241 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6e852-30a8-43f8-90a4-484487c5d8e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:15.727457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6e852-30a8-43f8-90a4-484487c5d8e3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:15.761197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:15.797814 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21a12c-a85b-49ae-a8ba-d6d49734baab None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:15.813012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 42/79] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:12:15 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:12:15.813943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6e852-30a8-43f8-90a4-484487c5d8e3 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:15.835378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05372b7f-3861-4a4c-ac08-dfa9fbcddeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:15.836673 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05372b7f-3861-4a4c-ac08-dfa9fbcddeca None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:15.837219 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05372b7f-3861-4a4c-ac08-dfa9fbcddeca None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:15.837219 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05372b7f-3861-4a4c-ac08-dfa9fbcddeca None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:15.837952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05372b7f-3861-4a4c-ac08-dfa9fbcddeca None admin] RBAC: Adding query filter params (name=member) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:15.838266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05372b7f-3861-4a4c-ac08-dfa9fbcddeca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:15.839725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05372b7f-3861-4a4c-ac08-dfa9fbcddeca None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:15.854163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 38/80] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:15.854163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05372b7f-3861-4a4c-ac08-dfa9fbcddeca None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:15.889174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:15.937690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6e852-30a8-43f8-90a4-484487c5d8e3 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:15.968299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05372b7f-3861-4a4c-ac08-dfa9fbcddeca None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:15.985662 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636a963-98b2-4704-be07-0199e8f77f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:15.986797 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636a963-98b2-4704-be07-0199e8f77f3c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:15.987086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636a963-98b2-4704-be07-0199e8f77f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:15.987369 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636a963-98b2-4704-be07-0199e8f77f3c None admin] PATH_INFO: `/v3/users/dcb0c8567f0646d2836a2ca21b79e432` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:15.999455 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:16.005218 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636a963-98b2-4704-be07-0199e8f77f3c None admin] RBAC: Authorizing `identity:get_user(user_id=dcb0c8567f0646d2836a2ca21b79e432)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:16.013241 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636a963-98b2-4704-be07-0199e8f77f3c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:16.013241 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 43/81] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:15 2022] GET /identity/v3/users/dcb0c8567f0646d2836a2ca21b79e432 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:16.013241 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636a963-98b2-4704-be07-0199e8f77f3c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:16.014767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f9db8-b79d-4e57-9623-e37516bdde9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:16.015812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f9db8-b79d-4e57-9623-e37516bdde9a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:16.015812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f9db8-b79d-4e57-9623-e37516bdde9a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:16.016082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f9db8-b79d-4e57-9623-e37516bdde9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:16.110349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f9db8-b79d-4e57-9623-e37516bdde9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:16.111830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f9db8-b79d-4e57-9623-e37516bdde9a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:16.156089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636a963-98b2-4704-be07-0199e8f77f3c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:16.179759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:16.199458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b595c-20c4-4782-bdeb-ebe39543e492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:16.200056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b595c-20c4-4782-bdeb-ebe39543e492 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:16.200343 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b595c-20c4-4782-bdeb-ebe39543e492 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:16.200671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b595c-20c4-4782-bdeb-ebe39543e492 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:16.212341 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b595c-20c4-4782-bdeb-ebe39543e492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:16.217528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-cd0b595c-20c4-4782-bdeb-ebe39543e492 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:16.217528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:16.217528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:16.217528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:16.217528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:16.217528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:16.217528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:16.217528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:16.217528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:16.217528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:16.217528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:16.217528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:16.217528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:16.217528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:16.217528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:16.217528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:16.218338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:16.218338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:16.218338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:16.218338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:16.218338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:16.218338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:16.218338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:16.218338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:16.218338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:16.218338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:16.218338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:16.218338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:16.218338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:16.218338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:16.218338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:16.218338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:16.219557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:16.219557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:16.219557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:16.219557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:16.219557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:16.219557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:16.219557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:16.219557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:16.219557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:16.219557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:16.219557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:16.219557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:16.219557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 44/82] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:16.220379 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b595c-20c4-4782-bdeb-ebe39543e492 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:16.231344 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 39/83] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:16.232603 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f9db8-b79d-4e57-9623-e37516bdde9a None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:16.276034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:16.352209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b595c-20c4-4782-bdeb-ebe39543e492 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:16.371574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f9db8-b79d-4e57-9623-e37516bdde9a None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:16.394122 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2094326-6f18-4dc1-a964-789f77f3caf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:16.395046 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2094326-6f18-4dc1-a964-789f77f3caf7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:16.395474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2094326-6f18-4dc1-a964-789f77f3caf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:16.395900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2094326-6f18-4dc1-a964-789f77f3caf7 None admin] PATH_INFO: `/v3/users/dcb0c8567f0646d2836a2ca21b79e432` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:16.397267 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2094326-6f18-4dc1-a964-789f77f3caf7 None admin] RBAC: Authorizing `identity:get_user(user_id=dcb0c8567f0646d2836a2ca21b79e432)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:16.399508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2094326-6f18-4dc1-a964-789f77f3caf7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:16.401411 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 45/84] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:16 2022] GET /identity/v3/users/dcb0c8567f0646d2836a2ca21b79e432 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:16.402380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2094326-6f18-4dc1-a964-789f77f3caf7 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:16.420475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf74c0-1798-4263-8e6d-418b79b72ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:16.421394 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf74c0-1798-4263-8e6d-418b79b72ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:16.421710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf74c0-1798-4263-8e6d-418b79b72ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:16.421990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf74c0-1798-4263-8e6d-418b79b72ec7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:16.459765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:16.515600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf74c0-1798-4263-8e6d-418b79b72ec7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:16.517075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf74c0-1798-4263-8e6d-418b79b72ec7 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:16.517560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2094326-6f18-4dc1-a964-789f77f3caf7 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:16.551144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:16.556418 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319c00e-2b91-4126-9880-db564ed50cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:16.557308 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319c00e-2b91-4126-9880-db564ed50cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:16.557883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319c00e-2b91-4126-9880-db564ed50cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:16.558394 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319c00e-2b91-4126-9880-db564ed50cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:16.559336 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319c00e-2b91-4126-9880-db564ed50cd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:16.559845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319c00e-2b91-4126-9880-db564ed50cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:16.561429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319c00e-2b91-4126-9880-db564ed50cd8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:16.570927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 46/85] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:16.572085 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319c00e-2b91-4126-9880-db564ed50cd8 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:16.639669 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 40/86] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:16.641126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf74c0-1798-4263-8e6d-418b79b72ec7 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:16.693308 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319c00e-2b91-4126-9880-db564ed50cd8 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:16.705699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:16.737763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0598d-8f38-4a5c-ac60-11c91bb5e4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:16.738310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0598d-8f38-4a5c-ac60-11c91bb5e4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:16.738600 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0598d-8f38-4a5c-ac60-11c91bb5e4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:16.738888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0598d-8f38-4a5c-ac60-11c91bb5e4d1 None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:16.740678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0598d-8f38-4a5c-ac60-11c91bb5e4d1 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:16.742472 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0598d-8f38-4a5c-ac60-11c91bb5e4d1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:16.744765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 47/87] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:16 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:16.745790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0598d-8f38-4a5c-ac60-11c91bb5e4d1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:16.768215 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf74c0-1798-4263-8e6d-418b79b72ec7 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:16.798799 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:16.809275 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0cdde-b330-4064-8736-5c12880f6e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:16.810901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0cdde-b330-4064-8736-5c12880f6e8e None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:16.811404 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0cdde-b330-4064-8736-5c12880f6e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:16.812115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0cdde-b330-4064-8736-5c12880f6e8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:16.863525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0598d-8f38-4a5c-ac60-11c91bb5e4d1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:16.892846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0cdde-b330-4064-8736-5c12880f6e8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:16.894180 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0cdde-b330-4064-8736-5c12880f6e8e None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:16.911608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f07e1-7ae8-48f0-9029-1e02f1405917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:16.912793 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f07e1-7ae8-48f0-9029-1e02f1405917 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:16.913688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f07e1-7ae8-48f0-9029-1e02f1405917 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:16.914243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f07e1-7ae8-48f0-9029-1e02f1405917 None admin] PATH_INFO: `/v3/users/dcb0c8567f0646d2836a2ca21b79e432` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:16.915836 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f07e1-7ae8-48f0-9029-1e02f1405917 None admin] RBAC: Authorizing `identity:get_user(user_id=dcb0c8567f0646d2836a2ca21b79e432)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:16.918218 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f07e1-7ae8-48f0-9029-1e02f1405917 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:16.924527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 48/88] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:16 2022] GET /identity/v3/users/dcb0c8567f0646d2836a2ca21b79e432 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:16.924527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f07e1-7ae8-48f0-9029-1e02f1405917 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:16.988856 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:17.009391 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 41/89] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:17.010584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0cdde-b330-4064-8736-5c12880f6e8e None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:17.042100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:17.060427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f07e1-7ae8-48f0-9029-1e02f1405917 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:17.106748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565b2a2-dd13-4e2e-9b5e-3e2e7a98ba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:17.107809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565b2a2-dd13-4e2e-9b5e-3e2e7a98ba92 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:17.108240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565b2a2-dd13-4e2e-9b5e-3e2e7a98ba92 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:17.108661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565b2a2-dd13-4e2e-9b5e-3e2e7a98ba92 None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:17.110275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565b2a2-dd13-4e2e-9b5e-3e2e7a98ba92 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:17.112074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565b2a2-dd13-4e2e-9b5e-3e2e7a98ba92 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:17.114127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 49/90] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:16 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:17.115504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565b2a2-dd13-4e2e-9b5e-3e2e7a98ba92 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:17.141393 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0cdde-b330-4064-8736-5c12880f6e8e None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:17.188761 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52637a82-ab82-4dff-a8a5-15efecfe4aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:17.189678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637a82-ab82-4dff-a8a5-15efecfe4aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:17.189966 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637a82-ab82-4dff-a8a5-15efecfe4aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:17.190245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637a82-ab82-4dff-a8a5-15efecfe4aa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:17.191313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52637a82-ab82-4dff-a8a5-15efecfe4aa7 None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72, user.id=40170d20cf2e4d67929f88ba378a2373) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:17.191630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52637a82-ab82-4dff-a8a5-15efecfe4aa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:17.193896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52637a82-ab82-4dff-a8a5-15efecfe4aa7 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:17.201111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 42/91] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:17 2022] GET /identity/v3/role_assignments?user.id=40170d20cf2e4d67929f88ba378a2373&scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:17.201962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52637a82-ab82-4dff-a8a5-15efecfe4aa7 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:17.233113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565b2a2-dd13-4e2e-9b5e-3e2e7a98ba92 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:17.249259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:17.286976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258f0dc-b691-432f-a7ab-ddd131d576b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:17.288012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258f0dc-b691-432f-a7ab-ddd131d576b0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:17.288524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258f0dc-b691-432f-a7ab-ddd131d576b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:17.290138 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258f0dc-b691-432f-a7ab-ddd131d576b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:17.323247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:17.334810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52637a82-ab82-4dff-a8a5-15efecfe4aa7 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:17.378773 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d5e0c-5a12-48bb-a081-09a1cbbbbafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:17.379446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d5e0c-5a12-48bb-a081-09a1cbbbbafc None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:17.379733 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d5e0c-5a12-48bb-a081-09a1cbbbbafc None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:17.380017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d5e0c-5a12-48bb-a081-09a1cbbbbafc None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:17.385505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d5e0c-5a12-48bb-a081-09a1cbbbbafc None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:17.385505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d5e0c-5a12-48bb-a081-09a1cbbbbafc None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:17.385715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 43/92] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:17 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:17.386452 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d5e0c-5a12-48bb-a081-09a1cbbbbafc None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:17.423317 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258f0dc-b691-432f-a7ab-ddd131d576b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:17.425241 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258f0dc-b691-432f-a7ab-ddd131d576b0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:17.554059 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d5e0c-5a12-48bb-a081-09a1cbbbbafc None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:17.581053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 50/93] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:17.583769 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258f0dc-b691-432f-a7ab-ddd131d576b0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:17.609199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:17.627164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b7bd1-42b1-4ace-abdc-91e7afb05d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:17.627807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b7bd1-42b1-4ace-abdc-91e7afb05d59 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:17.628092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b7bd1-42b1-4ace-abdc-91e7afb05d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:17.628373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b7bd1-42b1-4ace-abdc-91e7afb05d59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:17.629246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b7bd1-42b1-4ace-abdc-91e7afb05d59 None admin] RBAC: Adding query filter params (role.id=07a2273f06f649d4a7f2117b3cf6b34d, scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72, user.id=dcb0c8567f0646d2836a2ca21b79e432) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:17.635105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b7bd1-42b1-4ace-abdc-91e7afb05d59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:17.635105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b7bd1-42b1-4ace-abdc-91e7afb05d59 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:17.643751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 44/94] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:17 2022] GET /identity/v3/role_assignments?user.id=dcb0c8567f0646d2836a2ca21b79e432&scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72&role.id=07a2273f06f649d4a7f2117b3cf6b34d => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:17.644612 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b7bd1-42b1-4ace-abdc-91e7afb05d59 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:17.698216 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:17.756767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258f0dc-b691-432f-a7ab-ddd131d576b0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:17.805139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53535bab-29ec-4474-8072-27684049b92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:17.806145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53535bab-29ec-4474-8072-27684049b92e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:17.806653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53535bab-29ec-4474-8072-27684049b92e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:17.807141 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53535bab-29ec-4474-8072-27684049b92e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:17.808185 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53535bab-29ec-4474-8072-27684049b92e None admin] RBAC: Adding query filter params (role.id=d481402a8f1b4e189c0ecc05bce560e6, scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72, user.id=dcb0c8567f0646d2836a2ca21b79e432) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:17.808693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53535bab-29ec-4474-8072-27684049b92e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:17.810350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53535bab-29ec-4474-8072-27684049b92e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:17.821504 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b7bd1-42b1-4ace-abdc-91e7afb05d59 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:17.826206 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 51/95] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:17 2022] GET /identity/v3/role_assignments?user.id=dcb0c8567f0646d2836a2ca21b79e432&scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72&role.id=d481402a8f1b4e189c0ecc05bce560e6 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:17.862543 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1095f8-d092-4fe0-9a5e-937ef5e2c118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:17.863366 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1095f8-d092-4fe0-9a5e-937ef5e2c118 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:17.863724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1095f8-d092-4fe0-9a5e-937ef5e2c118 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:17.864083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1095f8-d092-4fe0-9a5e-937ef5e2c118 None admin] PATH_INFO: `/v3/projects/fedaad5124274d919b059498c76cc934` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:17.865558 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1095f8-d092-4fe0-9a5e-937ef5e2c118 None admin] RBAC: Authorizing `identity:get_project(project_id=fedaad5124274d919b059498c76cc934)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:17.867662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1095f8-d092-4fe0-9a5e-937ef5e2c118 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:17.869971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 45/96] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:17 2022] GET /identity/v3/projects/fedaad5124274d919b059498c76cc934 => generated 312 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:17.876380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53535bab-29ec-4474-8072-27684049b92e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:17.981917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:18.008651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53535bab-29ec-4474-8072-27684049b92e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:18.063459 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e01ed-87ea-4612-8fa2-793c4510024b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:18.064304 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e01ed-87ea-4612-8fa2-793c4510024b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:18.064589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e01ed-87ea-4612-8fa2-793c4510024b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:18.064873 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e01ed-87ea-4612-8fa2-793c4510024b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:18.065746 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e01ed-87ea-4612-8fa2-793c4510024b None admin] RBAC: Adding query filter params (role.id=d481402a8f1b4e189c0ecc05bce560e6, scope.project.id=fedaad5124274d919b059498c76cc934, user.id=dcb0c8567f0646d2836a2ca21b79e432) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:18.066069 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e01ed-87ea-4612-8fa2-793c4510024b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:18.067541 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e01ed-87ea-4612-8fa2-793c4510024b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:18.077506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 52/97] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:17 2022] GET /identity/v3/role_assignments?user.id=dcb0c8567f0646d2836a2ca21b79e432&scope.project.id=fedaad5124274d919b059498c76cc934&role.id=d481402a8f1b4e189c0ecc05bce560e6 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:18.213871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accca3ad-b50b-4def-8be5-5c24d4d34fb2 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:18.214500 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accca3ad-b50b-4def-8be5-5c24d4d34fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:18.215021 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accca3ad-b50b-4def-8be5-5c24d4d34fb2 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:18.216631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 46/98] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:18.222323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf2fec-861c-4410-8a18-cc71f8a7e8a0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:18.222619 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf2fec-861c-4410-8a18-cc71f8a7e8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:18.222911 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf2fec-861c-4410-8a18-cc71f8a7e8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:18.246276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-febf2fec-861c-4410-8a18-cc71f8a7e8a0 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:18.247513 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-febf2fec-861c-4410-8a18-cc71f8a7e8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:18.341207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 53/99] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:18.375592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accca3ad-b50b-4def-8be5-5c24d4d34fb2 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:18.399115 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007289a-3b06-4200-b743-cf36943af318 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:18.399418 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007289a-3b06-4200-b743-cf36943af318 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:18.399691 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007289a-3b06-4200-b743-cf36943af318 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:18.401060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 54/100] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:18.406527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fef3f-c1f4-4170-a222-c5b2951a7a90 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:18.406814 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fef3f-c1f4-4170-a222-c5b2951a7a90 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:18.407098 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fef3f-c1f4-4170-a222-c5b2951a7a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:18.433220 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8e5fef3f-c1f4-4170-a222-c5b2951a7a90 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:18.434478 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8e5fef3f-c1f4-4170-a222-c5b2951a7a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:18.501698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:18.523083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accca3ad-b50b-4def-8be5-5c24d4d34fb2 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:18.577147 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e363d-fc2c-4c6e-8616-2ce09af33d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:18.577832 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e363d-fc2c-4c6e-8616-2ce09af33d4b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:18.578116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e363d-fc2c-4c6e-8616-2ce09af33d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:18.578399 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e363d-fc2c-4c6e-8616-2ce09af33d4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:18.582181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e363d-fc2c-4c6e-8616-2ce09af33d4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:18.583655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e363d-fc2c-4c6e-8616-2ce09af33d4b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:18.585442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 47/101] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:18.591747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e363d-fc2c-4c6e-8616-2ce09af33d4b None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:18.611352 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:18.619943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 55/102] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:18.658562 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fef3f-c1f4-4170-a222-c5b2951a7a90 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:18.741495 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e363d-fc2c-4c6e-8616-2ce09af33d4b None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:18.802870 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668bd81-20d5-49fd-832f-65ec46e431ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:18.803519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668bd81-20d5-49fd-832f-65ec46e431ae None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:18.803815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668bd81-20d5-49fd-832f-65ec46e431ae None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:18.804098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668bd81-20d5-49fd-832f-65ec46e431ae None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:18.805338 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668bd81-20d5-49fd-832f-65ec46e431ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:18.807044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668bd81-20d5-49fd-832f-65ec46e431ae None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:18.860596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fef3f-c1f4-4170-a222-c5b2951a7a90 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:18.910375 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822a97b-d9c7-44eb-a0b4-1f44cb52211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:18.911046 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822a97b-d9c7-44eb-a0b4-1f44cb52211e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:18.911332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822a97b-d9c7-44eb-a0b4-1f44cb52211e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:18.911615 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822a97b-d9c7-44eb-a0b4-1f44cb52211e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:18.919446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 48/103] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jul 28 05:12:18 2022] POST /identity/v3/projects => generated 302 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:12:18.927912 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822a97b-d9c7-44eb-a0b4-1f44cb52211e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:18.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-2822a97b-d9c7-44eb-a0b4-1f44cb52211e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:18.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:18.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:18.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:18.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:18.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:18.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:18.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:18.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:18.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:18.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:18.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:18.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:18.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:18.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:18.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:18.934992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:18.934992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:18.934992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:18.934992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:18.934992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:18.934992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:18.934992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:18.934992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:18.934992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:18.934992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:18.934992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:18.934992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:18.934992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:18.934992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:18.934992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:18.934992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:18.935980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:18.935980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:18.935980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:18.935980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:18.935980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:18.935980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:18.935980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:18.935980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:18.935980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:18.935980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:18.935980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:18.935980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:18.935980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 56/104] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:18.942257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668bd81-20d5-49fd-832f-65ec46e431ae None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:18.969154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:19.093979 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668bd81-20d5-49fd-832f-65ec46e431ae None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:19.135301 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958aaa4-e18b-485a-b816-f2093dece95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:19.135869 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958aaa4-e18b-485a-b816-f2093dece95c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:19.136154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958aaa4-e18b-485a-b816-f2093dece95c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:19.136429 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958aaa4-e18b-485a-b816-f2093dece95c None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:19.137156 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958aaa4-e18b-485a-b816-f2093dece95c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:19.137483 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958aaa4-e18b-485a-b816-f2093dece95c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:19.138945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958aaa4-e18b-485a-b816-f2093dece95c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:19.148576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 49/105] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:19.154418 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822a97b-d9c7-44eb-a0b4-1f44cb52211e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:19.242869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:19.294163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822a97b-d9c7-44eb-a0b4-1f44cb52211e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:19.340887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bba72-384a-4b5c-9650-e87d87ee7831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:19.341581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bba72-384a-4b5c-9650-e87d87ee7831 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:19.341873 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bba72-384a-4b5c-9650-e87d87ee7831 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:19.342159 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bba72-384a-4b5c-9650-e87d87ee7831 None admin] PATH_INFO: `/v3/users/f2367558d7b84e0ea275ec32a0662e2a` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:19.356015 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bba72-384a-4b5c-9650-e87d87ee7831 None admin] RBAC: Authorizing `identity:get_user(user_id=f2367558d7b84e0ea275ec32a0662e2a)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:19.361533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bba72-384a-4b5c-9650-e87d87ee7831 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:19.363584 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 57/106] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:19 2022] GET /identity/v3/users/f2367558d7b84e0ea275ec32a0662e2a => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:19.369805 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958aaa4-e18b-485a-b816-f2093dece95c None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:19.470833 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:19.505804 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958aaa4-e18b-485a-b816-f2093dece95c None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:19.554380 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460df5c-3229-426f-99df-cdb040b1c85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:19.555716 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460df5c-3229-426f-99df-cdb040b1c85c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:19.557626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460df5c-3229-426f-99df-cdb040b1c85c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:19.558211 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460df5c-3229-426f-99df-cdb040b1c85c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:19.666214 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460df5c-3229-426f-99df-cdb040b1c85c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:19.668079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460df5c-3229-426f-99df-cdb040b1c85c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:19.764913 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:19.790130 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 50/107] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:19.798555 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bba72-384a-4b5c-9650-e87d87ee7831 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:19.990184 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bba72-384a-4b5c-9650-e87d87ee7831 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:20.011617 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:20.031683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962764f5-c967-49c5-9065-86ba222a172d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:20.032275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962764f5-c967-49c5-9065-86ba222a172d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:20.032565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962764f5-c967-49c5-9065-86ba222a172d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:20.032848 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962764f5-c967-49c5-9065-86ba222a172d None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:20.034072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962764f5-c967-49c5-9065-86ba222a172d None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:20.035572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962764f5-c967-49c5-9065-86ba222a172d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:20.037518 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 58/108] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:19 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:20.043857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460df5c-3229-426f-99df-cdb040b1c85c None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:20.103411 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da0908-adc1-42ae-bfac-4c03b7304f80 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:20.103740 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da0908-adc1-42ae-bfac-4c03b7304f80 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:20.103985 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da0908-adc1-42ae-bfac-4c03b7304f80 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:20.105528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 59/109] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:12:20.112950 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71439d-b88c-493f-ac5a-d2c6a401bedd None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:20.113243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71439d-b88c-493f-ac5a-d2c6a401bedd None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:20.113561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71439d-b88c-493f-ac5a-d2c6a401bedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:20.142891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-da71439d-b88c-493f-ac5a-d2c6a401bedd None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:20.144423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-da71439d-b88c-493f-ac5a-d2c6a401bedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:20.225584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460df5c-3229-426f-99df-cdb040b1c85c None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:20.280433 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 60/110] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:20.290979 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a61b74-c77a-4813-903f-682e53ec7ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:20.291775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a61b74-c77a-4813-903f-682e53ec7ece None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:20.292147 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a61b74-c77a-4813-903f-682e53ec7ece None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:20.292495 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a61b74-c77a-4813-903f-682e53ec7ece None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:20.293360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a61b74-c77a-4813-903f-682e53ec7ece None admin] RBAC: Adding query filter params (role.id=7b504f6996494661ac7b09b0df1ac7bf, scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72, user.id=f2367558d7b84e0ea275ec32a0662e2a) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:20.293823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a61b74-c77a-4813-903f-682e53ec7ece None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:20.295352 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a61b74-c77a-4813-903f-682e53ec7ece None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:20.300972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 51/111] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:20 2022] GET /identity/v3/role_assignments?user.id=f2367558d7b84e0ea275ec32a0662e2a&scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72&role.id=7b504f6996494661ac7b09b0df1ac7bf => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:20.312717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71439d-b88c-493f-ac5a-d2c6a401bedd None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:20.439378 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71439d-b88c-493f-ac5a-d2c6a401bedd None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:20.461947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:20.485043 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c4510-36cc-4689-a360-5acfa149beb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:20.485762 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4510-36cc-4689-a360-5acfa149beb1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:20.486051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4510-36cc-4689-a360-5acfa149beb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:20.496703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4510-36cc-4689-a360-5acfa149beb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:20.498335 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c4510-36cc-4689-a360-5acfa149beb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:20.508074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-ed3c4510-36cc-4689-a360-5acfa149beb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:20.508074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:20.508074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:20.508074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:20.508074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:20.508074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:20.508074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:20.508074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:20.508074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:20.508074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:20.508074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:20.508074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:20.508074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:20.508074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:20.508074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:20.508074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:20.509175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:20.509175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:20.509175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:20.509175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:20.509175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:20.509175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:20.509175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:20.509175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:20.509175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:20.509175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:20.509175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:20.509175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:20.509175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:20.509175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:20.509175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:20.509175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:20.509941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:20.509941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:20.509941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:20.509941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:20.509941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:20.509941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:20.509941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:20.509941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:20.509941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:20.509941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:20.509941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:20.509941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:20.509941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 61/112] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:12:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:20.515304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a61b74-c77a-4813-903f-682e53ec7ece None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:20.598860 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:20.704259 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a61b74-c77a-4813-903f-682e53ec7ece None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:20.750294 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66f6f5-617d-4a16-9146-dcbca6f1f990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:20.750933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66f6f5-617d-4a16-9146-dcbca6f1f990 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:20.751213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66f6f5-617d-4a16-9146-dcbca6f1f990 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:20.751486 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66f6f5-617d-4a16-9146-dcbca6f1f990 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:20.752211 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66f6f5-617d-4a16-9146-dcbca6f1f990 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:20.752520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66f6f5-617d-4a16-9146-dcbca6f1f990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:20.753935 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66f6f5-617d-4a16-9146-dcbca6f1f990 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:20.767462 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 52/113] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:20.768820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c4510-36cc-4689-a360-5acfa149beb1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:20.864296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5034931-b496-4221-bf47-480b3c556abd None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:20.864586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5034931-b496-4221-bf47-480b3c556abd None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:20.864765 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5034931-b496-4221-bf47-480b3c556abd None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:20.866138 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 53/114] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:12:20.880144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181e4d6-83ec-4e9d-b764-51b8761444e7 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:20.880696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181e4d6-83ec-4e9d-b764-51b8761444e7 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:20.881170 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181e4d6-83ec-4e9d-b764-51b8761444e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:20.919492 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-c181e4d6-83ec-4e9d-b764-51b8761444e7 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:20.920705 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c181e4d6-83ec-4e9d-b764-51b8761444e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:20.954840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c4510-36cc-4689-a360-5acfa149beb1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:21.027970 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6c460-873b-4a5d-9ddb-22c5e308f63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:21.029748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6c460-873b-4a5d-9ddb-22c5e308f63f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:21.030033 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6c460-873b-4a5d-9ddb-22c5e308f63f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:21.030310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6c460-873b-4a5d-9ddb-22c5e308f63f None admin] PATH_INFO: `/v3/users/40170d20cf2e4d67929f88ba378a2373` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:21.038282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6c460-873b-4a5d-9ddb-22c5e308f63f None admin] RBAC: Authorizing `identity:get_user(user_id=40170d20cf2e4d67929f88ba378a2373)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:21.040729 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6c460-873b-4a5d-9ddb-22c5e308f63f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:21.042528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 62/115] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:20 2022] GET /identity/v3/users/40170d20cf2e4d67929f88ba378a2373 => generated 247 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:21.048095 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6c460-873b-4a5d-9ddb-22c5e308f63f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:21.056079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 54/116] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:21.090130 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181e4d6-83ec-4e9d-b764-51b8761444e7 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:21.134404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:21.141868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:21.237594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181e4d6-83ec-4e9d-b764-51b8761444e7 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:21.239771 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6c460-873b-4a5d-9ddb-22c5e308f63f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:21.273060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a25e1c-f538-4cf8-ac6f-30581dfe05ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:21.274501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a25e1c-f538-4cf8-ac6f-30581dfe05ff None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:21.275011 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a25e1c-f538-4cf8-ac6f-30581dfe05ff None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:21.275389 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a25e1c-f538-4cf8-ac6f-30581dfe05ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:21.284677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06193b1f-9cb3-4ea9-aeca-342c5ad04d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:21.285382 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06193b1f-9cb3-4ea9-aeca-342c5ad04d74 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:21.285701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06193b1f-9cb3-4ea9-aeca-342c5ad04d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:21.285981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06193b1f-9cb3-4ea9-aeca-342c5ad04d74 None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:21.286642 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a25e1c-f538-4cf8-ac6f-30581dfe05ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:21.287171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06193b1f-9cb3-4ea9-aeca-342c5ad04d74 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:21.288615 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06193b1f-9cb3-4ea9-aeca-342c5ad04d74 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:21.290955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 63/117] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:21 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:21.292807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-82a25e1c-f538-4cf8-ac6f-30581dfe05ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:21.292807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:21.292807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:21.292807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:21.292807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:21.292807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:21.292807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:21.292807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:21.292807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:21.292807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:21.292807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:21.292807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:21.292807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:21.292807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:21.292807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:21.292807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:21.293662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:21.293662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:21.293662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:21.293662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:21.293662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:21.293662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:21.293662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:21.293662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:21.293662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:21.293662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:21.293662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:21.293662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:21.293662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:21.293662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:21.293662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:21.293662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:21.294401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:21.294401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:21.294401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:21.294401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:21.294401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:21.294401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:21.294401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:21.294401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:21.294401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:21.294401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:21.294401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:21.294401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:21.294401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 55/118] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:12:21.295682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f28fe-2e69-4acf-a8ff-aa873a8d64bc None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:21.295682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f28fe-2e69-4acf-a8ff-aa873a8d64bc None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:21.295830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f28fe-2e69-4acf-a8ff-aa873a8d64bc None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:21.299183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf3617-48b7-44d8-80c0-7d673d273f15 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:21.299183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf3617-48b7-44d8-80c0-7d673d273f15 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:21.299183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf3617-48b7-44d8-80c0-7d673d273f15 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:21.299419 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 56/119] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:21.299419 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f28fe-2e69-4acf-a8ff-aa873a8d64bc None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:21.300435 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 64/120] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:21.301097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf3617-48b7-44d8-80c0-7d673d273f15 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:21.391620 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:21.405128 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f28fe-2e69-4acf-a8ff-aa873a8d64bc None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:21.421140 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf3617-48b7-44d8-80c0-7d673d273f15 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:21.435455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:21.439891 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba984923-a3ba-469d-a7ee-01f30cbb3d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:21.440572 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba984923-a3ba-469d-a7ee-01f30cbb3d86 None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:21.440853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba984923-a3ba-469d-a7ee-01f30cbb3d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:21.441132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba984923-a3ba-469d-a7ee-01f30cbb3d86 None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72/users/40170d20cf2e4d67929f88ba378a2373/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:21.444111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba984923-a3ba-469d-a7ee-01f30cbb3d86 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6a583ed824940e18ba5dd2fab4e5c72, user_id=40170d20cf2e4d67929f88ba378a2373, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:21.446121 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba984923-a3ba-469d-a7ee-01f30cbb3d86 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:21.458861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97020ab3-1f23-45c7-862a-a9f5ce8f1960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:21.459490 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97020ab3-1f23-45c7-862a-a9f5ce8f1960 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:21.459775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97020ab3-1f23-45c7-862a-a9f5ce8f1960 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:21.460047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97020ab3-1f23-45c7-862a-a9f5ce8f1960 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:21.461406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97020ab3-1f23-45c7-862a-a9f5ce8f1960 None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:21.461744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97020ab3-1f23-45c7-862a-a9f5ce8f1960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:21.463123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97020ab3-1f23-45c7-862a-a9f5ce8f1960 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:21.471823 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 65/121] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:21.472990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71298e-b7e7-4688-87bb-005223fc8551 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:21.473324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71298e-b7e7-4688-87bb-005223fc8551 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:21.476794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71298e-b7e7-4688-87bb-005223fc8551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:21.494228 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ca71298e-b7e7-4688-87bb-005223fc8551 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:21.495611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ca71298e-b7e7-4688-87bb-005223fc8551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:21.503589 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 57/122] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:12:21 2022] PUT /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72/users/40170d20cf2e4d67929f88ba378a2373/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:12:21.511201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d7332-eb82-4d04-9d56-bd215659580c None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:21.511755 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d7332-eb82-4d04-9d56-bd215659580c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:21.514383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d7332-eb82-4d04-9d56-bd215659580c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:21.552105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-8d5d7332-eb82-4d04-9d56-bd215659580c None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:21.554305 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-8d5d7332-eb82-4d04-9d56-bd215659580c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:21.638950 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 66/123] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:21.640058 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71298e-b7e7-4688-87bb-005223fc8551 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:21.696599 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 58/124] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:21.697683 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d7332-eb82-4d04-9d56-bd215659580c None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:21.781007 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71298e-b7e7-4688-87bb-005223fc8551 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:21.784299 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:21.796578 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:21.822058 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2622ac-2532-478d-8ee3-1e26abb49636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:21.822807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2622ac-2532-478d-8ee3-1e26abb49636 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:21.823161 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2622ac-2532-478d-8ee3-1e26abb49636 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:21.823999 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2622ac-2532-478d-8ee3-1e26abb49636 None admin] PATH_INFO: `/v3/users/dcb0c8567f0646d2836a2ca21b79e432` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:21.825093 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2622ac-2532-478d-8ee3-1e26abb49636 None admin] RBAC: Authorizing `identity:get_user(user_id=dcb0c8567f0646d2836a2ca21b79e432)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:21.826673 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2622ac-2532-478d-8ee3-1e26abb49636 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:21.827428 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d7332-eb82-4d04-9d56-bd215659580c None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:21.830904 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 67/125] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:21 2022] GET /identity/v3/users/dcb0c8567f0646d2836a2ca21b79e432 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:21.831210 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2622ac-2532-478d-8ee3-1e26abb49636 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:21.910894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e8e82-9c42-4296-887c-30a3a5d1710e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:21.911715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e8e82-9c42-4296-887c-30a3a5d1710e None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:21.912002 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e8e82-9c42-4296-887c-30a3a5d1710e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:21.912280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e8e82-9c42-4296-887c-30a3a5d1710e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:21.935290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e8e82-9c42-4296-887c-30a3a5d1710e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:21.943698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-382e8e82-9c42-4296-887c-30a3a5d1710e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:21.943698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:21.943698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:21.943698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:21.943698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:21.943698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:21.943698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:21.943698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:21.943698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:21.943698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:21.943698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:21.943698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:21.943698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:21.943698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:21.943698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:21.943698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:21.944533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:21.944533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:21.944533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:21.944533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:21.944533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:21.944533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:21.944533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:21.944533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:21.944533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:21.944533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:21.944533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:21.944533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:21.944533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:21.944533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:21.944533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:21.944533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:21.945921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:21.945921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:21.945921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:21.945921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:21.945921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:21.945921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:21.945921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:21.945921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:21.945921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:21.945921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:21.945921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:21.945921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:21.945921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 59/126] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:21.950211 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e8e82-9c42-4296-887c-30a3a5d1710e None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:22.035618 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2622ac-2532-478d-8ee3-1e26abb49636 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:22.090528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a7100-1c1a-448b-8b77-f780fbfaf18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:22.091185 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a7100-1c1a-448b-8b77-f780fbfaf18e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:22.091716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a7100-1c1a-448b-8b77-f780fbfaf18e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:22.091994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a7100-1c1a-448b-8b77-f780fbfaf18e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:22.105591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a7100-1c1a-448b-8b77-f780fbfaf18e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:22.110980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e8e82-9c42-4296-887c-30a3a5d1710e None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:22.111734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c48a7100-1c1a-448b-8b77-f780fbfaf18e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:22.111734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:22.111734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:22.111734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:22.111734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:22.111734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:22.111734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:22.111734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:22.111734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:22.111734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:22.111734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:22.111734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:22.111734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:22.111734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:22.111734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:22.111734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:22.112635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:22.112635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:22.112635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:22.112635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:22.112635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:22.112635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:22.112635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:22.112635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:22.112635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:22.112635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:22.112635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:22.112635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:22.112635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:22.112635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:22.112635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:22.112635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:22.113395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:22.113395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:22.113395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:22.113395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:22.113395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:22.113395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:22.113395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:22.113395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:22.113395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:22.113395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:22.113395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:22.113395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:22.114009 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 68/127] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:12:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:22.114836 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a7100-1c1a-448b-8b77-f780fbfaf18e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:22.154503 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:22.156001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3291ee-139a-4515-b257-9e19ea03f394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:22.156656 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3291ee-139a-4515-b257-9e19ea03f394 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:22.156969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3291ee-139a-4515-b257-9e19ea03f394 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:22.157208 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3291ee-139a-4515-b257-9e19ea03f394 None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:22.158418 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3291ee-139a-4515-b257-9e19ea03f394 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:22.159863 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3291ee-139a-4515-b257-9e19ea03f394 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:22.161541 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 60/128] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:21 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:22.162738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945128e-271d-4ee7-a033-abf020709461 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:22.163025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945128e-271d-4ee7-a033-abf020709461 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:22.163304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945128e-271d-4ee7-a033-abf020709461 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:22.165207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 61/129] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:22.169969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945128e-271d-4ee7-a033-abf020709461 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:22.179802 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:22.248532 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a7100-1c1a-448b-8b77-f780fbfaf18e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:22.291045 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945128e-271d-4ee7-a033-abf020709461 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:22.294825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5dc89-8143-498b-87a5-c74b562a1a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:22.295468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5dc89-8143-498b-87a5-c74b562a1a77 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:22.295755 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5dc89-8143-498b-87a5-c74b562a1a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:22.296035 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5dc89-8143-498b-87a5-c74b562a1a77 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:22.296765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5dc89-8143-498b-87a5-c74b562a1a77 None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:22.297079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5dc89-8143-498b-87a5-c74b562a1a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:22.298510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5dc89-8143-498b-87a5-c74b562a1a77 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:22.310032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 69/130] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:22.311101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5dc89-8143-498b-87a5-c74b562a1a77 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:22.339191 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61a6c3-4282-40c0-b7c6-4bb5f4bba79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:22.339832 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61a6c3-4282-40c0-b7c6-4bb5f4bba79b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:22.340118 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61a6c3-4282-40c0-b7c6-4bb5f4bba79b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:22.340405 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61a6c3-4282-40c0-b7c6-4bb5f4bba79b None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:22.341762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61a6c3-4282-40c0-b7c6-4bb5f4bba79b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:22.342099 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61a6c3-4282-40c0-b7c6-4bb5f4bba79b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:22.343842 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61a6c3-4282-40c0-b7c6-4bb5f4bba79b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:22.358218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 62/131] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:12:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:22.359843 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154150d-b210-42e6-a6e4-9589a6775ca6 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:22.360367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154150d-b210-42e6-a6e4-9589a6775ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:22.360843 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154150d-b210-42e6-a6e4-9589a6775ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:22.381081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-4154150d-b210-42e6-a6e4-9589a6775ca6 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:22.383285 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4154150d-b210-42e6-a6e4-9589a6775ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:22.437675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:22.446099 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5dc89-8143-498b-87a5-c74b562a1a77 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:22.457632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:22.464330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 63/132] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:22.470128 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154150d-b210-42e6-a6e4-9589a6775ca6 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:22.510695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb64c90-7d5d-4d32-99b7-0834b0155204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:22.512425 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb64c90-7d5d-4d32-99b7-0834b0155204 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:22.512914 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb64c90-7d5d-4d32-99b7-0834b0155204 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:22.513664 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb64c90-7d5d-4d32-99b7-0834b0155204 None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72/users/dcb0c8567f0646d2836a2ca21b79e432/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:22.516734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb64c90-7d5d-4d32-99b7-0834b0155204 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6a583ed824940e18ba5dd2fab4e5c72, user_id=dcb0c8567f0646d2836a2ca21b79e432, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:22.519102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb64c90-7d5d-4d32-99b7-0834b0155204 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:22.590760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154150d-b210-42e6-a6e4-9589a6775ca6 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:22.604676 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 70/133] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:12:22 2022] PUT /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72/users/dcb0c8567f0646d2836a2ca21b79e432/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:12:22.606658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb64c90-7d5d-4d32-99b7-0834b0155204 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:22.648631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca5e0d-45b8-451e-92d5-d4bfadb78f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:22.649702 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca5e0d-45b8-451e-92d5-d4bfadb78f56 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:22.649919 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca5e0d-45b8-451e-92d5-d4bfadb78f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:22.650205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca5e0d-45b8-451e-92d5-d4bfadb78f56 None admin] PATH_INFO: `/v3/users/dcb0c8567f0646d2836a2ca21b79e432` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:22.654528 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca5e0d-45b8-451e-92d5-d4bfadb78f56 None admin] RBAC: Authorizing `identity:get_user(user_id=dcb0c8567f0646d2836a2ca21b79e432)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:22.655969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca5e0d-45b8-451e-92d5-d4bfadb78f56 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:22.659388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 64/134] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:22 2022] GET /identity/v3/users/dcb0c8567f0646d2836a2ca21b79e432 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:22.659388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca5e0d-45b8-451e-92d5-d4bfadb78f56 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:22.750128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb64c90-7d5d-4d32-99b7-0834b0155204 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:22.796521 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:22.796973 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884059d3-c552-4e7f-8f97-b7136f1a0495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:22.799132 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884059d3-c552-4e7f-8f97-b7136f1a0495 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:22.799649 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884059d3-c552-4e7f-8f97-b7136f1a0495 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:22.800390 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884059d3-c552-4e7f-8f97-b7136f1a0495 None admin] PATH_INFO: `/v3/users/dcb0c8567f0646d2836a2ca21b79e432` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:22.802046 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884059d3-c552-4e7f-8f97-b7136f1a0495 None admin] RBAC: Authorizing `identity:get_user(user_id=dcb0c8567f0646d2836a2ca21b79e432)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:22.804888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884059d3-c552-4e7f-8f97-b7136f1a0495 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:22.806830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 71/135] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:22 2022] GET /identity/v3/users/dcb0c8567f0646d2836a2ca21b79e432 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:22.808008 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884059d3-c552-4e7f-8f97-b7136f1a0495 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:22.845629 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:22.847410 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca5e0d-45b8-451e-92d5-d4bfadb78f56 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:22.888621 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2a3b5-e966-4f2e-bcec-b9a4bc90030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:22.889313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a3b5-e966-4f2e-bcec-b9a4bc90030d None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:22.889651 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a3b5-e966-4f2e-bcec-b9a4bc90030d None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:22.890391 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a3b5-e966-4f2e-bcec-b9a4bc90030d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:22.891877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2a3b5-e966-4f2e-bcec-b9a4bc90030d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:22.893578 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2a3b5-e966-4f2e-bcec-b9a4bc90030d None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:22.896332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 65/136] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:22.897482 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2a3b5-e966-4f2e-bcec-b9a4bc90030d None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:22.949782 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884059d3-c552-4e7f-8f97-b7136f1a0495 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:22.986804 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4499e-10fd-4964-9d54-08491c22dbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:22.987800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4499e-10fd-4964-9d54-08491c22dbbb None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:22.988289 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4499e-10fd-4964-9d54-08491c22dbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:22.988770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4499e-10fd-4964-9d54-08491c22dbbb None admin] PATH_INFO: `/v3/projects/fedaad5124274d919b059498c76cc934` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:22.990272 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4499e-10fd-4964-9d54-08491c22dbbb None admin] RBAC: Authorizing `identity:get_project(project_id=fedaad5124274d919b059498c76cc934)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:22.992622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4499e-10fd-4964-9d54-08491c22dbbb None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:22.994739 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 72/137] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:22 2022] GET /identity/v3/projects/fedaad5124274d919b059498c76cc934 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:23.000859 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21497ccc-d561-4abc-bab7-b553f4cc2d51 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:23.001376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21497ccc-d561-4abc-bab7-b553f4cc2d51 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:23.001937 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21497ccc-d561-4abc-bab7-b553f4cc2d51 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:23.007392 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 73/138] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:23.008623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21497ccc-d561-4abc-bab7-b553f4cc2d51 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:23.028078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2a3b5-e966-4f2e-bcec-b9a4bc90030d None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:23.071621 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47c35b-2c06-4625-aceb-a7788d698730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:23.072371 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47c35b-2c06-4625-aceb-a7788d698730 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:23.072479 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47c35b-2c06-4625-aceb-a7788d698730 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:23.072749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47c35b-2c06-4625-aceb-a7788d698730 None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:23.074026 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47c35b-2c06-4625-aceb-a7788d698730 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:23.075549 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47c35b-2c06-4625-aceb-a7788d698730 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:23.077500 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 66/139] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:22 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:23.078718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70f442-ff5a-4145-92e0-4bd4963040da None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:23.079063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70f442-ff5a-4145-92e0-4bd4963040da None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:23.079344 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70f442-ff5a-4145-92e0-4bd4963040da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:23.087527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:23.100673 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-bd70f442-ff5a-4145-92e0-4bd4963040da None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:23.102905 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-bd70f442-ff5a-4145-92e0-4bd4963040da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:23.137882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:23.153151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21497ccc-d561-4abc-bab7-b553f4cc2d51 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:23.182623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 67/140] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:23.184323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70f442-ff5a-4145-92e0-4bd4963040da None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:23.209095 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ead8a8-8655-42b7-84ac-ee81b85ea907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:23.209856 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ead8a8-8655-42b7-84ac-ee81b85ea907 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:23.210146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ead8a8-8655-42b7-84ac-ee81b85ea907 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:23.210434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ead8a8-8655-42b7-84ac-ee81b85ea907 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:23.212091 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ead8a8-8655-42b7-84ac-ee81b85ea907 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:23.213497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ead8a8-8655-42b7-84ac-ee81b85ea907 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:23.298246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70f442-ff5a-4145-92e0-4bd4963040da None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:23.319907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 74/141] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:12:23 2022] POST /identity/v3/users => generated 283 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:12:23.321208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ead8a8-8655-42b7-84ac-ee81b85ea907 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:23.335538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:23.350279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013a5d2-0591-4ee5-926a-56a920a56bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:23.353834 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013a5d2-0591-4ee5-926a-56a920a56bfa None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:23.354536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013a5d2-0591-4ee5-926a-56a920a56bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:23.356151 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013a5d2-0591-4ee5-926a-56a920a56bfa None admin] PATH_INFO: `/v3/projects/fedaad5124274d919b059498c76cc934/users/dcb0c8567f0646d2836a2ca21b79e432/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:23.361274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013a5d2-0591-4ee5-926a-56a920a56bfa None admin] RBAC: Authorizing `identity:create_grant(project_id=fedaad5124274d919b059498c76cc934, user_id=dcb0c8567f0646d2836a2ca21b79e432, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:23.364865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013a5d2-0591-4ee5-926a-56a920a56bfa None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:23.443470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 68/142] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:12:23 2022] PUT /identity/v3/projects/fedaad5124274d919b059498c76cc934/users/dcb0c8567f0646d2836a2ca21b79e432/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:12:23.444810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013a5d2-0591-4ee5-926a-56a920a56bfa None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:23.501374 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ead8a8-8655-42b7-84ac-ee81b85ea907 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:23.572752 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407ea91-109b-4207-8705-c97f6efc955d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:23.573728 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407ea91-109b-4207-8705-c97f6efc955d None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:23.574152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407ea91-109b-4207-8705-c97f6efc955d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:23.576100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407ea91-109b-4207-8705-c97f6efc955d None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72/users/dcb0c8567f0646d2836a2ca21b79e432/roles/07a2273f06f649d4a7f2117b3cf6b34d` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:23.579188 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407ea91-109b-4207-8705-c97f6efc955d None admin] RBAC: Authorizing `identity:create_grant(project_id=a6a583ed824940e18ba5dd2fab4e5c72, user_id=dcb0c8567f0646d2836a2ca21b79e432, role_id=07a2273f06f649d4a7f2117b3cf6b34d)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:23.581098 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407ea91-109b-4207-8705-c97f6efc955d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:23.642245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013a5d2-0591-4ee5-926a-56a920a56bfa None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:23.671792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 75/143] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:12:23 2022] PUT /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72/users/dcb0c8567f0646d2836a2ca21b79e432/roles/07a2273f06f649d4a7f2117b3cf6b34d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:12:23.691001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845f66c-7ba9-4015-b747-9a308a29fae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:23.691689 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845f66c-7ba9-4015-b747-9a308a29fae0 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:23.691971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845f66c-7ba9-4015-b747-9a308a29fae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:23.692252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845f66c-7ba9-4015-b747-9a308a29fae0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:23.706585 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845f66c-7ba9-4015-b747-9a308a29fae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:23.712268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-1845f66c-7ba9-4015-b747-9a308a29fae0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:23.712268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:23.712268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:23.712268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:23.712268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:23.712268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:23.712268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:23.712268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:23.712268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:23.712268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:23.712268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:23.712268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:23.712268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:23.712268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:23.712268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:23.712268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:23.713205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:23.713205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:23.713205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:23.713205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:23.713205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:23.713205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:23.713205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:23.713205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:23.713205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:23.713205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:23.713205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:23.713205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:23.713205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:23.713205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:23.713205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:23.713205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:23.713974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:23.713974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:23.713974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:23.713974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:23.713974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:23.713974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:23.713974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:23.713974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:23.713974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:23.713974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:23.713974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:23.713974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:23.713974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 69/144] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:23.720527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407ea91-109b-4207-8705-c97f6efc955d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:23.734199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:23.872524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407ea91-109b-4207-8705-c97f6efc955d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:23.915773 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14f66e-5430-4e54-b37a-fd92bf001bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:23.916625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14f66e-5430-4e54-b37a-fd92bf001bce None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:23.917047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14f66e-5430-4e54-b37a-fd92bf001bce None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:23.917459 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14f66e-5430-4e54-b37a-fd92bf001bce None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:23.918392 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14f66e-5430-4e54-b37a-fd92bf001bce None admin] RBAC: Adding query filter params (name=reader) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:23.918857 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14f66e-5430-4e54-b37a-fd92bf001bce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:23.920373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14f66e-5430-4e54-b37a-fd92bf001bce None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:23.931747 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 76/145] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:23.937444 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845f66c-7ba9-4015-b747-9a308a29fae0 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:23.994295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f879f-808c-432b-84c9-ddd39a5719e1 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:23.994883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f879f-808c-432b-84c9-ddd39a5719e1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:23.995300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f879f-808c-432b-84c9-ddd39a5719e1 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:23.996849 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 77/146] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:12:24.001742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:24.004541 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a737fe-a49e-4393-a323-94e02f247474 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:24.004829 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a737fe-a49e-4393-a323-94e02f247474 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:24.005112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a737fe-a49e-4393-a323-94e02f247474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:24.032796 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e7a737fe-a49e-4393-a323-94e02f247474 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:24.038127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e7a737fe-a49e-4393-a323-94e02f247474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:24.058931 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845f66c-7ba9-4015-b747-9a308a29fae0 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:24.098945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d937b-ba8d-4bff-b280-1c6a2abee013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:24.099964 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d937b-ba8d-4bff-b280-1c6a2abee013 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:24.100437 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d937b-ba8d-4bff-b280-1c6a2abee013 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:24.100898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d937b-ba8d-4bff-b280-1c6a2abee013 None admin] PATH_INFO: `/v3/users/f2367558d7b84e0ea275ec32a0662e2a` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:24.103144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d937b-ba8d-4bff-b280-1c6a2abee013 None admin] RBAC: Authorizing `identity:get_user(user_id=f2367558d7b84e0ea275ec32a0662e2a)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:24.105288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d937b-ba8d-4bff-b280-1c6a2abee013 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:24.107155 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 70/147] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:23 2022] GET /identity/v3/users/f2367558d7b84e0ea275ec32a0662e2a => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:24.112851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d937b-ba8d-4bff-b280-1c6a2abee013 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:24.169949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:24.182366 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 78/148] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:24.239184 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d937b-ba8d-4bff-b280-1c6a2abee013 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:24.264031 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a737fe-a49e-4393-a323-94e02f247474 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:24.274860 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:24.280583 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec3386-1155-48f3-a0ea-1afd22eb3ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:24.281239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec3386-1155-48f3-a0ea-1afd22eb3ceb None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:24.281558 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec3386-1155-48f3-a0ea-1afd22eb3ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:24.291057 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec3386-1155-48f3-a0ea-1afd22eb3ceb None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:24.291057 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec3386-1155-48f3-a0ea-1afd22eb3ceb None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:24.291057 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec3386-1155-48f3-a0ea-1afd22eb3ceb None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:24.291057 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 71/149] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:24 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:24.293017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec3386-1155-48f3-a0ea-1afd22eb3ceb None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:24.405233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec3386-1155-48f3-a0ea-1afd22eb3ceb None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:24.443432 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe7ac5-aa0f-41ca-8783-9beef0e35492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:24.444032 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe7ac5-aa0f-41ca-8783-9beef0e35492 None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:24.444312 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe7ac5-aa0f-41ca-8783-9beef0e35492 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:24.444590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe7ac5-aa0f-41ca-8783-9beef0e35492 None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72/users/f2367558d7b84e0ea275ec32a0662e2a/roles/7b504f6996494661ac7b09b0df1ac7bf` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:24.447131 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe7ac5-aa0f-41ca-8783-9beef0e35492 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6a583ed824940e18ba5dd2fab4e5c72, user_id=f2367558d7b84e0ea275ec32a0662e2a, role_id=7b504f6996494661ac7b09b0df1ac7bf)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:24.448565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe7ac5-aa0f-41ca-8783-9beef0e35492 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:24.473883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a737fe-a49e-4393-a323-94e02f247474 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:24.524230 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 72/150] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:12:24 2022] PUT /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72/users/f2367558d7b84e0ea275ec32a0662e2a/roles/7b504f6996494661ac7b09b0df1ac7bf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:12:24.531439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafb83e-ac6b-4acf-b0b1-4e9a9a16e520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:24.532109 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb83e-ac6b-4acf-b0b1-4e9a9a16e520 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:24.532397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb83e-ac6b-4acf-b0b1-4e9a9a16e520 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:24.532712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb83e-ac6b-4acf-b0b1-4e9a9a16e520 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:24.551739 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafb83e-ac6b-4acf-b0b1-4e9a9a16e520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:24.557717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-cbafb83e-ac6b-4acf-b0b1-4e9a9a16e520 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:24.557717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:24.557717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:24.557717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:24.557717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:24.557717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:24.557717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:24.557717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:24.557717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:24.557717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:24.557717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:24.557717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:24.557717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:24.557717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:24.557717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:24.557717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:24.558552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:24.558552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:24.558552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:24.558552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:24.558552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:24.558552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:24.558552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:24.558552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:24.558552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:24.558552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:24.558552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:24.558552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:24.558552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:24.558552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:24.558552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:24.558552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:24.559319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:24.559319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:24.559319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:24.559319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:24.559319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:24.559319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:24.559319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:24.559319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:24.559319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:24.559319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:24.559319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:24.559319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:24.562120 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 79/151] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:12:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:24.568100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe7ac5-aa0f-41ca-8783-9beef0e35492 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:24.657977 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:24.731856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe7ac5-aa0f-41ca-8783-9beef0e35492 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:24.778835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abe546-4ac6-4026-a41c-7ca91cf18bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:24.779624 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abe546-4ac6-4026-a41c-7ca91cf18bef None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:24.779915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abe546-4ac6-4026-a41c-7ca91cf18bef None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:24.780194 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abe546-4ac6-4026-a41c-7ca91cf18bef None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:24.780927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abe546-4ac6-4026-a41c-7ca91cf18bef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:24.781239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abe546-4ac6-4026-a41c-7ca91cf18bef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:24.782665 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abe546-4ac6-4026-a41c-7ca91cf18bef None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:24.793746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 73/152] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:24.798231 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafb83e-ac6b-4acf-b0b1-4e9a9a16e520 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:24.883347 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:24.934477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafb83e-ac6b-4acf-b0b1-4e9a9a16e520 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:24.974339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bee493-f319-4028-87e5-07cd626d65c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:24.974988 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bee493-f319-4028-87e5-07cd626d65c3 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:24.975264 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bee493-f319-4028-87e5-07cd626d65c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:24.975533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bee493-f319-4028-87e5-07cd626d65c3 None admin] PATH_INFO: `/v3/users/40170d20cf2e4d67929f88ba378a2373` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:24.977737 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bee493-f319-4028-87e5-07cd626d65c3 None admin] RBAC: Authorizing `identity:get_user(user_id=40170d20cf2e4d67929f88ba378a2373)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:24.979209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bee493-f319-4028-87e5-07cd626d65c3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:24.981130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 80/153] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:24 2022] GET /identity/v3/users/40170d20cf2e4d67929f88ba378a2373 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:24.986502 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abe546-4ac6-4026-a41c-7ca91cf18bef None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:25.124355 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abe546-4ac6-4026-a41c-7ca91cf18bef None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:25.136189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:25.169028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47db46-c6bb-4d03-b3c6-b4716dc2665b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:25.169700 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47db46-c6bb-4d03-b3c6-b4716dc2665b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:25.169987 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47db46-c6bb-4d03-b3c6-b4716dc2665b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:25.170271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47db46-c6bb-4d03-b3c6-b4716dc2665b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:25.253261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47db46-c6bb-4d03-b3c6-b4716dc2665b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:25.254684 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47db46-c6bb-4d03-b3c6-b4716dc2665b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:25.374901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 74/154] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:25.379036 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65dded-539e-46e8-a4b3-3dbf370bbc3c None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:25.379492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65dded-539e-46e8-a4b3-3dbf370bbc3c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:25.379859 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65dded-539e-46e8-a4b3-3dbf370bbc3c None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:25.380778 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47db46-c6bb-4d03-b3c6-b4716dc2665b None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:25.381219 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 81/155] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:25.390789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9e3f-dc9c-4f86-97ee-120bb181fda2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:25.391078 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9e3f-dc9c-4f86-97ee-120bb181fda2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:25.391338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9e3f-dc9c-4f86-97ee-120bb181fda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:25.394740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:25.427140 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-864b9e3f-dc9c-4f86-97ee-120bb181fda2 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:25.428342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-864b9e3f-dc9c-4f86-97ee-120bb181fda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:25.511337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47db46-c6bb-4d03-b3c6-b4716dc2665b None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:25.535084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 82/156] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:25.565533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d9d81-79ee-48c6-a363-cf03e940ea59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:25.566205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9d81-79ee-48c6-a363-cf03e940ea59 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:25.566494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9d81-79ee-48c6-a363-cf03e940ea59 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:25.566772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9d81-79ee-48c6-a363-cf03e940ea59 None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:25.574343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d9d81-79ee-48c6-a363-cf03e940ea59 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:25.575260 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9e3f-dc9c-4f86-97ee-120bb181fda2 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:25.575849 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d9d81-79ee-48c6-a363-cf03e940ea59 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:25.578086 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 75/157] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:25 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:25.583644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d9d81-79ee-48c6-a363-cf03e940ea59 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:25.699712 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:25.725987 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:25.734231 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d9d81-79ee-48c6-a363-cf03e940ea59 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:25.786799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9e3f-dc9c-4f86-97ee-120bb181fda2 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:25.792688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c45e1-c697-4454-ad15-764085c3c4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:25.793333 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c45e1-c697-4454-ad15-764085c3c4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:25.793647 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c45e1-c697-4454-ad15-764085c3c4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:25.793925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c45e1-c697-4454-ad15-764085c3c4f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:25.794731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c45e1-c697-4454-ad15-764085c3c4f6 None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72, user.id=40170d20cf2e4d67929f88ba378a2373) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:25.795046 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c45e1-c697-4454-ad15-764085c3c4f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:25.796507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c45e1-c697-4454-ad15-764085c3c4f6 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:25.809677 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 76/158] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:25 2022] GET /identity/v3/role_assignments?user.id=40170d20cf2e4d67929f88ba378a2373&scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:25.849105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57927b4-7dc3-40ed-82a6-a485ac912b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:25.849834 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57927b4-7dc3-40ed-82a6-a485ac912b3b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:25.850117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57927b4-7dc3-40ed-82a6-a485ac912b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:25.850392 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57927b4-7dc3-40ed-82a6-a485ac912b3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:25.872159 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57927b4-7dc3-40ed-82a6-a485ac912b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:25.877410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c57927b4-7dc3-40ed-82a6-a485ac912b3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:25.877410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:25.877410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:25.877410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:25.877410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:25.877410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:25.877410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:25.877410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:25.877410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:25.877410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:25.877410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:25.877410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:25.877410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:25.877410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:25.877410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:25.877410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:25.878351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:25.878351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:25.878351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:25.878351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:25.878351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:25.878351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:25.878351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:25.878351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:25.878351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:25.878351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:25.878351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:25.878351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:25.878351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:25.878351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:25.878351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:25.878351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:25.879197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:25.879197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:25.879197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:25.879197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:25.879197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:25.879197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:25.879197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:25.879197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:25.879197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:25.879197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:25.879197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:25.879197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:25.879197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 83/159] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:12:25.886922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c45e1-c697-4454-ad15-764085c3c4f6 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:26.008102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c45e1-c697-4454-ad15-764085c3c4f6 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:26.053785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e0658-8f3d-4d83-b394-6ab2083afbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:26.054449 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e0658-8f3d-4d83-b394-6ab2083afbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:26.054739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e0658-8f3d-4d83-b394-6ab2083afbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:26.055055 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e0658-8f3d-4d83-b394-6ab2083afbc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:26.055794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e0658-8f3d-4d83-b394-6ab2083afbc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:26.056106 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e0658-8f3d-4d83-b394-6ab2083afbc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:26.057498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e0658-8f3d-4d83-b394-6ab2083afbc2 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:26.067215 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 77/160] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:26.073487 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57927b4-7dc3-40ed-82a6-a485ac912b3b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:26.214782 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57927b4-7dc3-40ed-82a6-a485ac912b3b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:26.241923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:26.253512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdb0dd-561e-49c1-878a-24f81d325458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:26.269013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdb0dd-561e-49c1-878a-24f81d325458 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:26.269013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdb0dd-561e-49c1-878a-24f81d325458 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:26.269013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdb0dd-561e-49c1-878a-24f81d325458 None admin] PATH_INFO: `/v3/users/dcb0c8567f0646d2836a2ca21b79e432` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:26.269013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdb0dd-561e-49c1-878a-24f81d325458 None admin] RBAC: Authorizing `identity:get_user(user_id=dcb0c8567f0646d2836a2ca21b79e432)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:26.269013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdb0dd-561e-49c1-878a-24f81d325458 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:26.269013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 84/161] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:26 2022] GET /identity/v3/users/dcb0c8567f0646d2836a2ca21b79e432 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:26.269956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e0658-8f3d-4d83-b394-6ab2083afbc2 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:26.278804 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:26.392949 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e0658-8f3d-4d83-b394-6ab2083afbc2 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:26.429338 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969b763-5371-48d3-a216-b5d4caf3c5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:26.430477 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969b763-5371-48d3-a216-b5d4caf3c5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:26.430972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969b763-5371-48d3-a216-b5d4caf3c5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:26.431464 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969b763-5371-48d3-a216-b5d4caf3c5b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:26.502988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969b763-5371-48d3-a216-b5d4caf3c5b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:26.504799 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969b763-5371-48d3-a216-b5d4caf3c5b7 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:26.518103 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:26.609585 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 78/162] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:12:26.617499 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdb0dd-561e-49c1-878a-24f81d325458 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:26.756964 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdb0dd-561e-49c1-878a-24f81d325458 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:26.792233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb0242-9dfa-4861-be7e-aea51fac6bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:26.792888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb0242-9dfa-4861-be7e-aea51fac6bdc None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:26.793174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb0242-9dfa-4861-be7e-aea51fac6bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:26.793455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb0242-9dfa-4861-be7e-aea51fac6bdc None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:26.794671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb0242-9dfa-4861-be7e-aea51fac6bdc None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:26.796143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb0242-9dfa-4861-be7e-aea51fac6bdc None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:26.797981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 85/163] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:26 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:26.803840 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969b763-5371-48d3-a216-b5d4caf3c5b7 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:26.944390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969b763-5371-48d3-a216-b5d4caf3c5b7 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:26.950515 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:26.992586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4215025-5d3b-4978-bcf2-fefb030e9f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:26.993223 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4215025-5d3b-4978-bcf2-fefb030e9f07 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:26.993526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4215025-5d3b-4978-bcf2-fefb030e9f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:26.993812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4215025-5d3b-4978-bcf2-fefb030e9f07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:26.994796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4215025-5d3b-4978-bcf2-fefb030e9f07 None admin] RBAC: Adding query filter params (role.id=d481402a8f1b4e189c0ecc05bce560e6, scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72, user.id=dcb0c8567f0646d2836a2ca21b79e432) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:26.995116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4215025-5d3b-4978-bcf2-fefb030e9f07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:26.996565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4215025-5d3b-4978-bcf2-fefb030e9f07 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:27.009990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 79/164] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:26 2022] GET /identity/v3/role_assignments?user.id=dcb0c8567f0646d2836a2ca21b79e432&scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72&role.id=d481402a8f1b4e189c0ecc05bce560e6 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:27.127568 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d900c7e-76e7-42ed-9259-5b418d8421e3 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:27.128340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d900c7e-76e7-42ed-9259-5b418d8421e3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:27.128827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d900c7e-76e7-42ed-9259-5b418d8421e3 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:27.130594 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 86/165] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:27.137155 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd56f4-32ed-4b78-ae47-6d27fdb8829c None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:27.137703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd56f4-32ed-4b78-ae47-6d27fdb8829c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:27.138154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd56f4-32ed-4b78-ae47-6d27fdb8829c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:27.162756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-95dd56f4-32ed-4b78-ae47-6d27fdb8829c None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:27.164784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-95dd56f4-32ed-4b78-ae47-6d27fdb8829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:27.276787 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 80/166] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:27.325852 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d900c7e-76e7-42ed-9259-5b418d8421e3 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:27.392354 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:27.449241 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d900c7e-76e7-42ed-9259-5b418d8421e3 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:27.496333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06896306-6fa1-4419-9070-b6992e7f2164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:27.497252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06896306-6fa1-4419-9070-b6992e7f2164 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:27.497719 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06896306-6fa1-4419-9070-b6992e7f2164 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:27.498135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06896306-6fa1-4419-9070-b6992e7f2164 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:27.512768 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06896306-6fa1-4419-9070-b6992e7f2164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:27.517978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-06896306-6fa1-4419-9070-b6992e7f2164 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:27.517978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:27.517978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:27.517978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:27.517978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:27.517978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:27.517978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:27.517978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:27.517978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:27.517978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:27.517978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:27.517978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:27.517978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:27.517978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:27.517978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:27.517978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:27.519061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:27.519061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:27.519061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:27.519061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:27.519061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:27.519061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:27.519061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:27.519061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:27.519061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:27.519061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:27.519061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:27.519061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:27.519061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:27.519061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:27.519061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:27.519061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:27.520261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:27.520261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:27.520261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:27.520261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:27.520261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:27.520261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:27.520261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:27.520261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:27.520261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:27.520261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:27.520261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:27.520261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:27.523782 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 87/167] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:27.528696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd56f4-32ed-4b78-ae47-6d27fdb8829c None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:27.593973 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed958c-6ee4-4b79-9432-04097a6d2aa1 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:27.594522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed958c-6ee4-4b79-9432-04097a6d2aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:27.594977 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed958c-6ee4-4b79-9432-04097a6d2aa1 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:27.596596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 88/168] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:27.610040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e88e5a-8dcf-411e-98b7-a5cd1281b52c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:27.610551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e88e5a-8dcf-411e-98b7-a5cd1281b52c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:27.610978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e88e5a-8dcf-411e-98b7-a5cd1281b52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:27.641439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-30e88e5a-8dcf-411e-98b7-a5cd1281b52c None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:27.643333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-30e88e5a-8dcf-411e-98b7-a5cd1281b52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:27.669864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:27.674407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd56f4-32ed-4b78-ae47-6d27fdb8829c None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:27.716833 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9c284-69d3-49f9-acc3-75221eb8bc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:27.717462 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9c284-69d3-49f9-acc3-75221eb8bc5b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:27.717775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9c284-69d3-49f9-acc3-75221eb8bc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:27.718221 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9c284-69d3-49f9-acc3-75221eb8bc5b None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:27.719162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9c284-69d3-49f9-acc3-75221eb8bc5b None admin] RBAC: Adding query filter params (name=member) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:27.719688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9c284-69d3-49f9-acc3-75221eb8bc5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:27.721212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9c284-69d3-49f9-acc3-75221eb8bc5b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:27.737418 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 81/169] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:27.743046 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9c284-69d3-49f9-acc3-75221eb8bc5b None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:27.793809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 89/170] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:27.830204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e88e5a-8dcf-411e-98b7-a5cd1281b52c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:27.887422 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9c284-69d3-49f9-acc3-75221eb8bc5b None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:27.941844 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:27.962315 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f173-e201-43f1-b292-302480450273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:27.962995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f173-e201-43f1-b292-302480450273 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:27.963434 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f173-e201-43f1-b292-302480450273 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:27.963726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f173-e201-43f1-b292-302480450273 None admin] PATH_INFO: `/v3/users/dcb0c8567f0646d2836a2ca21b79e432` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:27.967598 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f173-e201-43f1-b292-302480450273 None admin] RBAC: Authorizing `identity:get_user(user_id=dcb0c8567f0646d2836a2ca21b79e432)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:27.969240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f173-e201-43f1-b292-302480450273 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:27.971689 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 82/171] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:27 2022] GET /identity/v3/users/dcb0c8567f0646d2836a2ca21b79e432 => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:27.978417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f173-e201-43f1-b292-302480450273 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:28.045942 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:28.053283 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e88e5a-8dcf-411e-98b7-a5cd1281b52c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:28.127111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24359a4-21e5-4763-a830-d00c352cf66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:28.128276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24359a4-21e5-4763-a830-d00c352cf66b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:28.128768 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24359a4-21e5-4763-a830-d00c352cf66b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:28.129278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24359a4-21e5-4763-a830-d00c352cf66b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:28.155776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24359a4-21e5-4763-a830-d00c352cf66b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:28.161778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-d24359a4-21e5-4763-a830-d00c352cf66b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:28.161778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:28.161778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:28.161778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:28.161778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:28.161778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:28.161778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:28.161778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:28.161778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:28.161778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:28.161778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:28.161778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:28.161778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:28.161778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:28.161778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:28.161778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:28.162632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:28.162632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:28.162632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:28.162632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:28.162632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:28.162632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:28.162632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:28.162632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:28.162632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:28.162632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:28.162632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:28.162632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:28.162632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:28.162632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:28.162632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:28.162632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:28.163393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:28.163393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:28.163393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:28.163393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:28.163393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:28.163393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:28.163393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:28.163393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:28.163393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:28.163393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:28.163393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:28.163393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:28.169521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 90/172] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:12:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:12:28.174559 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24359a4-21e5-4763-a830-d00c352cf66b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:28.199053 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f173-e201-43f1-b292-302480450273 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:28.264712 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c64de4-c6c1-46de-9cb2-9f854aa889ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:28.265561 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c64de4-c6c1-46de-9cb2-9f854aa889ec None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:28.266048 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c64de4-c6c1-46de-9cb2-9f854aa889ec None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:28.266483 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c64de4-c6c1-46de-9cb2-9f854aa889ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:28.357229 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24359a4-21e5-4763-a830-d00c352cf66b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:28.358984 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:28.373094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c64de4-c6c1-46de-9cb2-9f854aa889ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:28.375145 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c64de4-c6c1-46de-9cb2-9f854aa889ec None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:28.396357 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad4d1f-9f0a-4c0a-957f-bf7be5070569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:28.397336 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad4d1f-9f0a-4c0a-957f-bf7be5070569 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:28.397867 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad4d1f-9f0a-4c0a-957f-bf7be5070569 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:28.398489 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad4d1f-9f0a-4c0a-957f-bf7be5070569 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:28.399619 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad4d1f-9f0a-4c0a-957f-bf7be5070569 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:28.400141 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad4d1f-9f0a-4c0a-957f-bf7be5070569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:28.401881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad4d1f-9f0a-4c0a-957f-bf7be5070569 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:28.405946 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:28.417057 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 91/173] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:12:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:28.418789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da156e31-bcf1-487c-8688-0868c9273be0 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:28.419312 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da156e31-bcf1-487c-8688-0868c9273be0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:28.419791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da156e31-bcf1-487c-8688-0868c9273be0 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:28.421318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 92/174] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:28.422550 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93097c4c-2529-4d47-9801-a17370529d7f None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:28.423030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93097c4c-2529-4d47-9801-a17370529d7f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:28.423581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93097c4c-2529-4d47-9801-a17370529d7f None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:28.425168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 93/175] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:28.430632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93097c4c-2529-4d47-9801-a17370529d7f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:28.490545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 83/176] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:28.497099 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281d26f-982e-42f7-8bb6-9766477f68ef None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:28.497583 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281d26f-982e-42f7-8bb6-9766477f68ef None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:28.498050 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281d26f-982e-42f7-8bb6-9766477f68ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:28.518520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-6281d26f-982e-42f7-8bb6-9766477f68ef None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:28.520310 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6281d26f-982e-42f7-8bb6-9766477f68ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:28.546422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93097c4c-2529-4d47-9801-a17370529d7f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:28.583648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f621cee-27f8-40cb-999f-cef6853fe050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:28.584578 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f621cee-27f8-40cb-999f-cef6853fe050 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:28.584871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f621cee-27f8-40cb-999f-cef6853fe050 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:28.585154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f621cee-27f8-40cb-999f-cef6853fe050 None admin] PATH_INFO: `/v3/users/dcb0c8567f0646d2836a2ca21b79e432` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:28.586906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f621cee-27f8-40cb-999f-cef6853fe050 None admin] RBAC: Authorizing `identity:get_user(user_id=dcb0c8567f0646d2836a2ca21b79e432)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:28.588356 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f621cee-27f8-40cb-999f-cef6853fe050 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:28.590154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 94/177] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:28 2022] GET /identity/v3/users/dcb0c8567f0646d2836a2ca21b79e432 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:28.591262 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d974bd-5926-4db1-806e-3846ae156433 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:28.591550 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d974bd-5926-4db1-806e-3846ae156433 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:28.591828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d974bd-5926-4db1-806e-3846ae156433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:28.597629 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 84/178] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:28.597629 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0c715-bdd2-4129-99f8-a228529357dc None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:28.597629 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0c715-bdd2-4129-99f8-a228529357dc None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:28.597629 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0c715-bdd2-4129-99f8-a228529357dc None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:28.597629 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 85/179] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:28.606688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0c715-bdd2-4129-99f8-a228529357dc None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:28.620197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-74d974bd-5926-4db1-806e-3846ae156433 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:28.621680 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-74d974bd-5926-4db1-806e-3846ae156433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:28.651081 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:28.681952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:28.699386 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 95/180] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:28.700541 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d974bd-5926-4db1-806e-3846ae156433 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:28.732685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0c715-bdd2-4129-99f8-a228529357dc None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:28.766747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8aed2-4f5b-42cd-a722-13a86d6e70eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:28.767388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8aed2-4f5b-42cd-a722-13a86d6e70eb None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:28.767664 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8aed2-4f5b-42cd-a722-13a86d6e70eb None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:28.768009 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8aed2-4f5b-42cd-a722-13a86d6e70eb None admin] PATH_INFO: `/v3/projects/fedaad5124274d919b059498c76cc934` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:28.769124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8aed2-4f5b-42cd-a722-13a86d6e70eb None admin] RBAC: Authorizing `identity:get_project(project_id=fedaad5124274d919b059498c76cc934)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:28.770597 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8aed2-4f5b-42cd-a722-13a86d6e70eb None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:28.772244 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 86/181] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:28 2022] GET /identity/v3/projects/fedaad5124274d919b059498c76cc934 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:28.774085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c252f-20b3-41e0-aa4d-6a36c5de3b1e None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:28.774464 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c252f-20b3-41e0-aa4d-6a36c5de3b1e None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:28.774736 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c252f-20b3-41e0-aa4d-6a36c5de3b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:28.791915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-572c252f-20b3-41e0-aa4d-6a36c5de3b1e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:28.793098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-572c252f-20b3-41e0-aa4d-6a36c5de3b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:28.808111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d974bd-5926-4db1-806e-3846ae156433 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:28.843806 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbce85-f315-4598-ad84-900bfd3c0297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:28.844434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbce85-f315-4598-ad84-900bfd3c0297 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:28.844711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbce85-f315-4598-ad84-900bfd3c0297 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:28.844984 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbce85-f315-4598-ad84-900bfd3c0297 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:28.860131 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 87/182] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:28.860968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c252f-20b3-41e0-aa4d-6a36c5de3b1e None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:28.877963 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:28.917240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbce85-f315-4598-ad84-900bfd3c0297 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:28.918772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbce85-f315-4598-ad84-900bfd3c0297 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:28.919201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:28.962030 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c252f-20b3-41e0-aa4d-6a36c5de3b1e None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:28.994961 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2437e2-6a3f-40ef-82e8-a82560352814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:28.995595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2437e2-6a3f-40ef-82e8-a82560352814 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:28.995870 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2437e2-6a3f-40ef-82e8-a82560352814 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:28.996139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2437e2-6a3f-40ef-82e8-a82560352814 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:29.006339 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2437e2-6a3f-40ef-82e8-a82560352814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:29.011771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-4a2437e2-6a3f-40ef-82e8-a82560352814 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:29.011771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:29.011771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:29.011771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:29.011771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:29.011771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:29.011771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:29.011771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:29.011771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:29.011771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:29.011771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:29.011771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:29.011771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:29.011771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:29.011771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:29.011771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:29.012630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:29.012630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:29.012630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:29.012630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:29.012630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:29.012630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:29.012630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:29.012630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:29.012630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:29.012630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:29.012630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:29.012630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:29.012630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:29.012630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:29.012630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:29.012630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:29.013920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:29.013920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:29.013920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:29.013920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:29.013920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:29.013920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:29.013920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:29.013920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:29.013920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:29.013920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:29.013920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:29.013920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:29.013920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 88/183] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:12:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:29.014863 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272da8db-0c73-40b5-a085-5acdde20538c None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:29.014863 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272da8db-0c73-40b5-a085-5acdde20538c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:29.014863 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272da8db-0c73-40b5-a085-5acdde20538c None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:29.016292 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 89/184] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:29.016983 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272da8db-0c73-40b5-a085-5acdde20538c None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:29.025268 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 96/185] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:29.026296 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbce85-f315-4598-ad84-900bfd3c0297 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:29.085483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:29.121844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272da8db-0c73-40b5-a085-5acdde20538c None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:29.123835 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbce85-f315-4598-ad84-900bfd3c0297 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:29.138746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:29.155867 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825f9fa-f9fe-4350-8b3b-7ce2b7f22567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:29.156511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825f9fa-f9fe-4350-8b3b-7ce2b7f22567 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:29.156795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825f9fa-f9fe-4350-8b3b-7ce2b7f22567 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:29.157073 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825f9fa-f9fe-4350-8b3b-7ce2b7f22567 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:29.157571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f2558-4a2b-4fd1-81cb-f2aafdc8f8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:29.158192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f2558-4a2b-4fd1-81cb-f2aafdc8f8fb None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:29.158476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f2558-4a2b-4fd1-81cb-f2aafdc8f8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:29.158760 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f2558-4a2b-4fd1-81cb-f2aafdc8f8fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:29.159547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f2558-4a2b-4fd1-81cb-f2aafdc8f8fb None admin] RBAC: Adding query filter params (role.id=d481402a8f1b4e189c0ecc05bce560e6, scope.project.id=fedaad5124274d919b059498c76cc934, user.id=dcb0c8567f0646d2836a2ca21b79e432) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:29.159859 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f2558-4a2b-4fd1-81cb-f2aafdc8f8fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:29.161291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f2558-4a2b-4fd1-81cb-f2aafdc8f8fb None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:29.167183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 97/186] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:29 2022] GET /identity/v3/role_assignments?user.id=dcb0c8567f0646d2836a2ca21b79e432&scope.project.id=fedaad5124274d919b059498c76cc934&role.id=d481402a8f1b4e189c0ecc05bce560e6 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:29.167513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825f9fa-f9fe-4350-8b3b-7ce2b7f22567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:29.167966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f2558-4a2b-4fd1-81cb-f2aafdc8f8fb None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:29.173261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-0825f9fa-f9fe-4350-8b3b-7ce2b7f22567 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:29.173261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:29.173261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:29.173261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:29.173261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:29.173261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:29.173261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:29.173261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:29.173261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:29.173261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:29.173261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:29.173261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:29.173261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:29.173261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:29.173261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:29.173261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:29.174210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:29.174210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:29.174210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:29.174210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:29.174210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:29.174210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:29.174210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:29.174210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:29.174210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:29.174210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:29.174210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:29.174210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:29.174210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:29.174210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:29.174210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:29.174210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:29.174980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:29.174980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:29.174980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:29.174980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:29.174980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:29.174980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:29.174980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:29.174980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:29.174980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:29.174980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:29.174980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:29.174980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:29.174980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 90/187] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:12:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:29.176100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825f9fa-f9fe-4350-8b3b-7ce2b7f22567 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:29.290889 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f2558-4a2b-4fd1-81cb-f2aafdc8f8fb None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:29.298304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825f9fa-f9fe-4350-8b3b-7ce2b7f22567 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:29.320098 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:29.332821 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095d6fe-9222-4e54-8ea7-b7b6329ff988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:29.338766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095d6fe-9222-4e54-8ea7-b7b6329ff988 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:29.338766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095d6fe-9222-4e54-8ea7-b7b6329ff988 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:29.338766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095d6fe-9222-4e54-8ea7-b7b6329ff988 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:29.338985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5211f-9f2b-4cf0-b4c3-4b5139f89e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:29.338985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5211f-9f2b-4cf0-b4c3-4b5139f89e5c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:29.338985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5211f-9f2b-4cf0-b4c3-4b5139f89e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:29.338985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5211f-9f2b-4cf0-b4c3-4b5139f89e5c None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:29.339263 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5211f-9f2b-4cf0-b4c3-4b5139f89e5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:29.339263 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5211f-9f2b-4cf0-b4c3-4b5139f89e5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:29.340638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5211f-9f2b-4cf0-b4c3-4b5139f89e5c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:29.347993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095d6fe-9222-4e54-8ea7-b7b6329ff988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:29.352606 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 91/188] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:29.354201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-9095d6fe-9222-4e54-8ea7-b7b6329ff988 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:29.354201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:29.354201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:29.354201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:29.354201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:29.354201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:29.354201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:29.354201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:29.354201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:29.354201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:29.354201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:29.354201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:29.354201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:29.354201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:29.354201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:29.354201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:29.355096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:29.355096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:29.355096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:29.355096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:29.355096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:29.355096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:29.355096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:29.355096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:29.355096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:29.355096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:29.355096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:29.355096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:29.355096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:29.355096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:29.355096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:29.355096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:29.355854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:29.355854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:29.355854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:29.355854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:29.355854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:29.355854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:29.355854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:29.355854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:29.355854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:29.355854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:29.355854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:29.355854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:29.355854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 98/189] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:29.356535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095d6fe-9222-4e54-8ea7-b7b6329ff988 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:29.358562 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de6a37-2aee-4a1b-8096-ade755072e2f None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:29.358860 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de6a37-2aee-4a1b-8096-ade755072e2f None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:29.359143 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de6a37-2aee-4a1b-8096-ade755072e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:29.378062 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-f5de6a37-2aee-4a1b-8096-ade755072e2f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:29.380368 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f5de6a37-2aee-4a1b-8096-ade755072e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:29.416600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:29.453147 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 92/190] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:29.454020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de6a37-2aee-4a1b-8096-ade755072e2f None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:29.469555 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095d6fe-9222-4e54-8ea7-b7b6329ff988 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:29.503874 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bd60c-03eb-45c3-a685-c6e64d53c8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:29.504519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bd60c-03eb-45c3-a685-c6e64d53c8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:29.504809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bd60c-03eb-45c3-a685-c6e64d53c8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:29.505087 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bd60c-03eb-45c3-a685-c6e64d53c8b0 None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:29.506298 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bd60c-03eb-45c3-a685-c6e64d53c8b0 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:29.508274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bd60c-03eb-45c3-a685-c6e64d53c8b0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:29.509982 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 99/191] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:29 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:29.514334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bd60c-03eb-45c3-a685-c6e64d53c8b0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:29.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de6a37-2aee-4a1b-8096-ade755072e2f None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:29.570411 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:29.592668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296609f-5ba6-4418-8aa2-e43c20a733e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:29.593293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296609f-5ba6-4418-8aa2-e43c20a733e1 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:29.593604 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296609f-5ba6-4418-8aa2-e43c20a733e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:29.593879 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296609f-5ba6-4418-8aa2-e43c20a733e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:29.594598 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296609f-5ba6-4418-8aa2-e43c20a733e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:29.594951 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296609f-5ba6-4418-8aa2-e43c20a733e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:29.596320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296609f-5ba6-4418-8aa2-e43c20a733e1 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:29.604687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 93/192] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:12:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:29.605498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296609f-5ba6-4418-8aa2-e43c20a733e1 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:29.616293 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bd60c-03eb-45c3-a685-c6e64d53c8b0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:29.635594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:29.651202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d037c44-4a3f-4966-8a89-e8570186cb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:29.651852 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d037c44-4a3f-4966-8a89-e8570186cb05 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:29.652131 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d037c44-4a3f-4966-8a89-e8570186cb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:29.652410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d037c44-4a3f-4966-8a89-e8570186cb05 None admin] PATH_INFO: `/v3/users/ae5ee3f143e2440683a31989d976f14c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:29.665726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d037c44-4a3f-4966-8a89-e8570186cb05 None admin] RBAC: Authorizing `identity:get_user(user_id=ae5ee3f143e2440683a31989d976f14c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:29.667259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d037c44-4a3f-4966-8a89-e8570186cb05 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:29.668861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 100/193] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:29 2022] GET /identity/v3/users/ae5ee3f143e2440683a31989d976f14c => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:29.673409 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d037c44-4a3f-4966-8a89-e8570186cb05 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:29.705814 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296609f-5ba6-4418-8aa2-e43c20a733e1 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:29.738603 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ced2fe-1da4-443d-bd5a-be3a47da1f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:29.739221 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ced2fe-1da4-443d-bd5a-be3a47da1f65 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:29.739500 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ced2fe-1da4-443d-bd5a-be3a47da1f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:29.739773 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ced2fe-1da4-443d-bd5a-be3a47da1f65 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:29.740490 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ced2fe-1da4-443d-bd5a-be3a47da1f65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:29.740795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ced2fe-1da4-443d-bd5a-be3a47da1f65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:29.742222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ced2fe-1da4-443d-bd5a-be3a47da1f65 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:29.750125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 94/194] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:29.750909 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ced2fe-1da4-443d-bd5a-be3a47da1f65 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:29.774525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d037c44-4a3f-4966-8a89-e8570186cb05 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:29.787491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:29.808113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0e225-6d9c-41ff-959e-f58df460352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:29.812154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0e225-6d9c-41ff-959e-f58df460352e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:29.812154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0e225-6d9c-41ff-959e-f58df460352e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:29.812154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0e225-6d9c-41ff-959e-f58df460352e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:29.812154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0e225-6d9c-41ff-959e-f58df460352e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:29.812154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0e225-6d9c-41ff-959e-f58df460352e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:29.813563 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 101/195] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:29.814574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0e225-6d9c-41ff-959e-f58df460352e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:29.848013 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:29.856470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ced2fe-1da4-443d-bd5a-be3a47da1f65 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:29.890903 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dec084-4d08-4c17-8b17-46d0f378ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:29.891526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dec084-4d08-4c17-8b17-46d0f378ef50 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:29.891799 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dec084-4d08-4c17-8b17-46d0f378ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:29.892080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dec084-4d08-4c17-8b17-46d0f378ef50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:29.892878 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dec084-4d08-4c17-8b17-46d0f378ef50 None admin] RBAC: Adding query filter params (role.id=07a2273f06f649d4a7f2117b3cf6b34d, scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72, user.id=dcb0c8567f0646d2836a2ca21b79e432) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:29.893185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dec084-4d08-4c17-8b17-46d0f378ef50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:29.894668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dec084-4d08-4c17-8b17-46d0f378ef50 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:29.900568 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 95/196] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:29 2022] GET /identity/v3/role_assignments?user.id=dcb0c8567f0646d2836a2ca21b79e432&scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72&role.id=07a2273f06f649d4a7f2117b3cf6b34d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:29.901272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dec084-4d08-4c17-8b17-46d0f378ef50 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:29.924787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0e225-6d9c-41ff-959e-f58df460352e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:29.963182 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b72368-5aa8-4198-a30a-11b13b395949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:29.964000 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b72368-5aa8-4198-a30a-11b13b395949 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:29.964378 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b72368-5aa8-4198-a30a-11b13b395949 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:29.964756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b72368-5aa8-4198-a30a-11b13b395949 None admin] PATH_INFO: `/v3/users/ae5ee3f143e2440683a31989d976f14c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:29.966112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b72368-5aa8-4198-a30a-11b13b395949 None admin] RBAC: Authorizing `identity:get_user(user_id=ae5ee3f143e2440683a31989d976f14c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:29.967703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b72368-5aa8-4198-a30a-11b13b395949 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:29.969664 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 102/197] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:29 2022] GET /identity/v3/users/ae5ee3f143e2440683a31989d976f14c => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:29.974887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b72368-5aa8-4198-a30a-11b13b395949 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:30.018225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dec084-4d08-4c17-8b17-46d0f378ef50 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:30.038390 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:30.059018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85abfb6-4066-4491-bb0e-cfc5231e5766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:30.059655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85abfb6-4066-4491-bb0e-cfc5231e5766 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:30.059937 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85abfb6-4066-4491-bb0e-cfc5231e5766 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:30.060944 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85abfb6-4066-4491-bb0e-cfc5231e5766 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:30.090266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:30.104180 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b72368-5aa8-4198-a30a-11b13b395949 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:30.138882 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85abfb6-4066-4491-bb0e-cfc5231e5766 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:30.140353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85abfb6-4066-4491-bb0e-cfc5231e5766 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:30.141812 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e9900-4b6c-448d-8811-e940c0dc3f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:30.142494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e9900-4b6c-448d-8811-e940c0dc3f50 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:30.142775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e9900-4b6c-448d-8811-e940c0dc3f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:30.143052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e9900-4b6c-448d-8811-e940c0dc3f50 None admin] PATH_INFO: `/v3/users/f2367558d7b84e0ea275ec32a0662e2a` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:30.144219 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e9900-4b6c-448d-8811-e940c0dc3f50 None admin] RBAC: Authorizing `identity:get_user(user_id=f2367558d7b84e0ea275ec32a0662e2a)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:30.145677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e9900-4b6c-448d-8811-e940c0dc3f50 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:30.147269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 103/198] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:29 2022] GET /identity/v3/users/f2367558d7b84e0ea275ec32a0662e2a => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:30.148619 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e9900-4b6c-448d-8811-e940c0dc3f50 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:30.241332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 96/199] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:30.242356 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85abfb6-4066-4491-bb0e-cfc5231e5766 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:30.248714 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e9900-4b6c-448d-8811-e940c0dc3f50 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:30.269398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:30.284315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e88cd-2249-48a6-8dd3-35cf70734356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:30.284938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e88cd-2249-48a6-8dd3-35cf70734356 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:30.285222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e88cd-2249-48a6-8dd3-35cf70734356 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:30.285517 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e88cd-2249-48a6-8dd3-35cf70734356 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:30.286206 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e88cd-2249-48a6-8dd3-35cf70734356 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:30.287639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e88cd-2249-48a6-8dd3-35cf70734356 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:30.306717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:30.349342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85abfb6-4066-4491-bb0e-cfc5231e5766 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:30.381393 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9922b14-5143-4073-a0a0-5d5a6f1e2fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:30.382040 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9922b14-5143-4073-a0a0-5d5a6f1e2fcf None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:30.382853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9922b14-5143-4073-a0a0-5d5a6f1e2fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:30.383301 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9922b14-5143-4073-a0a0-5d5a6f1e2fcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:30.392034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 104/200] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:12:30 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:12:30.392641 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e88cd-2249-48a6-8dd3-35cf70734356 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:30.467658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9922b14-5143-4073-a0a0-5d5a6f1e2fcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:30.469153 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9922b14-5143-4073-a0a0-5d5a6f1e2fcf None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:30.518468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e88cd-2249-48a6-8dd3-35cf70734356 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:30.532455 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:30.560728 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee8843-996c-4ff6-9681-b53edbc3a376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:30.561369 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee8843-996c-4ff6-9681-b53edbc3a376 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:30.562068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee8843-996c-4ff6-9681-b53edbc3a376 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:30.562068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee8843-996c-4ff6-9681-b53edbc3a376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:30.593686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 97/201] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:30.593686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9922b14-5143-4073-a0a0-5d5a6f1e2fcf None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:30.619105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:30.656010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee8843-996c-4ff6-9681-b53edbc3a376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:30.657601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee8843-996c-4ff6-9681-b53edbc3a376 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:30.735396 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9922b14-5143-4073-a0a0-5d5a6f1e2fcf None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:30.781079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb939c-2c3d-450c-9d14-23ddd2d25ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:30.782009 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb939c-2c3d-450c-9d14-23ddd2d25ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:30.782429 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb939c-2c3d-450c-9d14-23ddd2d25ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:30.782900 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb939c-2c3d-450c-9d14-23ddd2d25ce6 None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:30.783657 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 105/202] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:30.784376 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb939c-2c3d-450c-9d14-23ddd2d25ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:30.784487 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee8843-996c-4ff6-9681-b53edbc3a376 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:30.786420 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb939c-2c3d-450c-9d14-23ddd2d25ce6 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:30.788404 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 98/203] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:30 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:30.790085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb939c-2c3d-450c-9d14-23ddd2d25ce6 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:30.853221 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:30.896327 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:30.929310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee8843-996c-4ff6-9681-b53edbc3a376 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:30.951770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb939c-2c3d-450c-9d14-23ddd2d25ce6 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:30.966761 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5608fb6-3aa3-4a65-8d43-39f7e20029ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:30.967420 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5608fb6-3aa3-4a65-8d43-39f7e20029ed None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:30.967702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5608fb6-3aa3-4a65-8d43-39f7e20029ed None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:30.967982 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5608fb6-3aa3-4a65-8d43-39f7e20029ed None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:30.969171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5608fb6-3aa3-4a65-8d43-39f7e20029ed None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:30.970663 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5608fb6-3aa3-4a65-8d43-39f7e20029ed None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:30.972660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 106/204] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:30 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:30.973523 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5608fb6-3aa3-4a65-8d43-39f7e20029ed None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:30.997926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06696d1b-6a93-4cb1-a42f-2407375bb52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:30.998590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696d1b-6a93-4cb1-a42f-2407375bb52c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:30.998924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696d1b-6a93-4cb1-a42f-2407375bb52c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:30.999200 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696d1b-6a93-4cb1-a42f-2407375bb52c None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:31.000450 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06696d1b-6a93-4cb1-a42f-2407375bb52c None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:31.002136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06696d1b-6a93-4cb1-a42f-2407375bb52c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:31.003971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 99/205] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:30 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:31.004840 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06696d1b-6a93-4cb1-a42f-2407375bb52c None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:31.099597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5608fb6-3aa3-4a65-8d43-39f7e20029ed None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:31.109067 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:31.118857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06696d1b-6a93-4cb1-a42f-2407375bb52c None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:31.139347 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62ed2a-ceae-497a-af58-6eaa1fa78175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:31.140250 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62ed2a-ceae-497a-af58-6eaa1fa78175 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:31.140686 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62ed2a-ceae-497a-af58-6eaa1fa78175 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:31.141116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62ed2a-ceae-497a-af58-6eaa1fa78175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:31.142165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62ed2a-ceae-497a-af58-6eaa1fa78175 None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=4c563dccc823490ba5fc84b8bd242ab6, user.id=ae5ee3f143e2440683a31989d976f14c) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:31.142623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62ed2a-ceae-497a-af58-6eaa1fa78175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:31.144308 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62ed2a-ceae-497a-af58-6eaa1fa78175 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:31.157501 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 107/206] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:30 2022] GET /identity/v3/role_assignments?user.id=ae5ee3f143e2440683a31989d976f14c&scope.project.id=4c563dccc823490ba5fc84b8bd242ab6&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:31.157697 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680bcd7-410c-44c3-8c94-5eb0ffcc390e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:31.157697 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680bcd7-410c-44c3-8c94-5eb0ffcc390e None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:31.158158 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680bcd7-410c-44c3-8c94-5eb0ffcc390e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:31.158686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680bcd7-410c-44c3-8c94-5eb0ffcc390e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:31.159376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62ed2a-ceae-497a-af58-6eaa1fa78175 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:31.159669 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680bcd7-410c-44c3-8c94-5eb0ffcc390e None admin] RBAC: Adding query filter params (role.id=07a2273f06f649d4a7f2117b3cf6b34d, scope.project.id=4c563dccc823490ba5fc84b8bd242ab6, user.id=ae5ee3f143e2440683a31989d976f14c) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:31.163534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680bcd7-410c-44c3-8c94-5eb0ffcc390e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:31.163534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680bcd7-410c-44c3-8c94-5eb0ffcc390e None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:31.167855 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:31.169553 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 100/207] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:31 2022] GET /identity/v3/role_assignments?user.id=ae5ee3f143e2440683a31989d976f14c&scope.project.id=4c563dccc823490ba5fc84b8bd242ab6&role.id=07a2273f06f649d4a7f2117b3cf6b34d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:31.337642 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62ed2a-ceae-497a-af58-6eaa1fa78175 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:31.388877 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c1559-3eed-44be-8ff9-1daca3ce83ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:31.389441 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c1559-3eed-44be-8ff9-1daca3ce83ec None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:31.389757 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c1559-3eed-44be-8ff9-1daca3ce83ec None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:31.390041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c1559-3eed-44be-8ff9-1daca3ce83ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:31.390839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c1559-3eed-44be-8ff9-1daca3ce83ec None admin] RBAC: Adding query filter params (role.id=7b504f6996494661ac7b09b0df1ac7bf, scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72, user.id=f2367558d7b84e0ea275ec32a0662e2a) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:31.391157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c1559-3eed-44be-8ff9-1daca3ce83ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:31.392594 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c1559-3eed-44be-8ff9-1daca3ce83ec None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:31.399001 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 108/208] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:31 2022] GET /identity/v3/role_assignments?user.id=f2367558d7b84e0ea275ec32a0662e2a&scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72&role.id=7b504f6996494661ac7b09b0df1ac7bf => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:32.635804 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dccf4e-7e51-4e00-95a3-4521d8efb686 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:32.636332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dccf4e-7e51-4e00-95a3-4521d8efb686 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:32.636332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dccf4e-7e51-4e00-95a3-4521d8efb686 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:32.637901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 101/209] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:32.643118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1b2a3-bbdc-4d32-b26e-595019c2a67d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:32.643531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1b2a3-bbdc-4d32-b26e-595019c2a67d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:32.643759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1b2a3-bbdc-4d32-b26e-595019c2a67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:32.664559 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e3e1b2a3-bbdc-4d32-b26e-595019c2a67d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:32.666060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e3e1b2a3-bbdc-4d32-b26e-595019c2a67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:32.729705 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:32.734927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 109/210] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:32.744743 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecc773-d735-4a13-ab67-e53f1a86e2d6 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:32.745274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecc773-d735-4a13-ab67-e53f1a86e2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:32.755543 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecc773-d735-4a13-ab67-e53f1a86e2d6 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:32.755543 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 102/211] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:32.755738 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72c9df-1cdf-4d9e-ac39-1bc41b1d6df7 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:32.755738 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72c9df-1cdf-4d9e-ac39-1bc41b1d6df7 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:32.755738 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72c9df-1cdf-4d9e-ac39-1bc41b1d6df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:32.760365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecc773-d735-4a13-ab67-e53f1a86e2d6 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:32.773703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9f72c9df-1cdf-4d9e-ac39-1bc41b1d6df7 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:32.775410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9f72c9df-1cdf-4d9e-ac39-1bc41b1d6df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:32.854489 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 110/212] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:32.878761 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72c9df-1cdf-4d9e-ac39-1bc41b1d6df7 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:32.892486 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecc773-d735-4a13-ab67-e53f1a86e2d6 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:32.935581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e68b1f-c246-45ea-bcc2-b3b636d77558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:32.936851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e68b1f-c246-45ea-bcc2-b3b636d77558 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:32.937796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e68b1f-c246-45ea-bcc2-b3b636d77558 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:32.938526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e68b1f-c246-45ea-bcc2-b3b636d77558 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:32.953713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e68b1f-c246-45ea-bcc2-b3b636d77558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:32.961756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-e4e68b1f-c246-45ea-bcc2-b3b636d77558 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:32.961756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:32.961756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:32.961756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:32.961756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:32.961756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:32.961756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:32.961756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:32.961756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:32.961756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:32.961756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:32.961756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:32.961756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:32.961756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:32.961756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:32.961756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:32.962602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:32.962602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:32.962602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:32.962602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:32.962602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:32.962602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:32.962602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:32.962602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:32.962602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:32.962602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:32.962602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:32.962602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:32.962602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:32.962602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:32.962602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:32.962602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:32.963365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:32.963365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:32.963365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:32.963365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:32.963365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:32.963365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:32.963365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:32.963365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:32.963365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:32.963365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:32.963365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:32.963365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:32.966181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 103/213] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:12:32.972125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e68b1f-c246-45ea-bcc2-b3b636d77558 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:32.992624 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:33.004570 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72c9df-1cdf-4d9e-ac39-1bc41b1d6df7 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:33.033825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:33.043020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8159a-0d4c-4e36-9bfb-1cacbba71830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:33.043680 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8159a-0d4c-4e36-9bfb-1cacbba71830 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:33.043960 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8159a-0d4c-4e36-9bfb-1cacbba71830 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:33.044232 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8159a-0d4c-4e36-9bfb-1cacbba71830 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:33.045961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8159a-0d4c-4e36-9bfb-1cacbba71830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:33.047791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8159a-0d4c-4e36-9bfb-1cacbba71830 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:33.053224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 111/214] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:33.056394 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8159a-0d4c-4e36-9bfb-1cacbba71830 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:33.082996 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e68b1f-c246-45ea-bcc2-b3b636d77558 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:33.119800 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dba7c3-09b6-4df3-84c0-4d6b717b31f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:33.120783 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dba7c3-09b6-4df3-84c0-4d6b717b31f8 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:33.121256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dba7c3-09b6-4df3-84c0-4d6b717b31f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:33.121811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dba7c3-09b6-4df3-84c0-4d6b717b31f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:33.122720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dba7c3-09b6-4df3-84c0-4d6b717b31f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:33.123246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dba7c3-09b6-4df3-84c0-4d6b717b31f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:33.125002 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dba7c3-09b6-4df3-84c0-4d6b717b31f8 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:33.139185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 104/215] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:33.140388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dba7c3-09b6-4df3-84c0-4d6b717b31f8 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:33.168934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8159a-0d4c-4e36-9bfb-1cacbba71830 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:33.207722 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc263e5-51d3-4cdc-8554-a85da2191833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:33.208354 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc263e5-51d3-4cdc-8554-a85da2191833 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:33.208636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc263e5-51d3-4cdc-8554-a85da2191833 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:33.208913 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc263e5-51d3-4cdc-8554-a85da2191833 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:33.209754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc263e5-51d3-4cdc-8554-a85da2191833 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:33.212112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc263e5-51d3-4cdc-8554-a85da2191833 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:33.224009 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:33.247223 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dba7c3-09b6-4df3-84c0-4d6b717b31f8 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:33.284033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b1754-7ba0-441a-bdc7-4f9b83ecc929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:33.285419 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b1754-7ba0-441a-bdc7-4f9b83ecc929 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:33.285971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b1754-7ba0-441a-bdc7-4f9b83ecc929 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:33.286800 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b1754-7ba0-441a-bdc7-4f9b83ecc929 None admin] PATH_INFO: `/v3/users/39e5a535d8e640be91173a4e48f7c473` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:33.301158 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b1754-7ba0-441a-bdc7-4f9b83ecc929 None admin] RBAC: Authorizing `identity:get_user(user_id=39e5a535d8e640be91173a4e48f7c473)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:33.302645 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b1754-7ba0-441a-bdc7-4f9b83ecc929 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:33.304504 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 105/216] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:33 2022] GET /identity/v3/users/39e5a535d8e640be91173a4e48f7c473 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:33.309756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b1754-7ba0-441a-bdc7-4f9b83ecc929 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:33.336928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 112/217] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:12:33 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:12:33.336928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab90b53-76b3-49a5-acd3-2c67a43cb18e None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:33.336928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab90b53-76b3-49a5-acd3-2c67a43cb18e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:33.336928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab90b53-76b3-49a5-acd3-2c67a43cb18e None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:33.336928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 113/218] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:33.347384 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6fd3e-64f3-4589-912b-6d8b5e318fc3 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:33.347668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6fd3e-64f3-4589-912b-6d8b5e318fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:33.348002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6fd3e-64f3-4589-912b-6d8b5e318fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:33.368466 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-33f6fd3e-64f3-4589-912b-6d8b5e318fc3 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:33.369759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-33f6fd3e-64f3-4589-912b-6d8b5e318fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:33.426681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:33.427493 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b1754-7ba0-441a-bdc7-4f9b83ecc929 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:33.457493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 114/219] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:33.457493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d97deb-ae34-45ea-abe4-9f4c0e05eec9 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:33.457493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d97deb-ae34-45ea-abe4-9f4c0e05eec9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:33.457493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d97deb-ae34-45ea-abe4-9f4c0e05eec9 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:33.457493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 115/220] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:33.457940 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4c581-a3c7-4713-adf7-852f105b173c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:33.458291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4c581-a3c7-4713-adf7-852f105b173c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:33.458577 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4c581-a3c7-4713-adf7-852f105b173c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:33.477781 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a0d44-a8df-4e67-8d60-eba856a2adba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:33.478542 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a0d44-a8df-4e67-8d60-eba856a2adba None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:33.478941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a0d44-a8df-4e67-8d60-eba856a2adba None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:33.479494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a0d44-a8df-4e67-8d60-eba856a2adba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:33.480888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e6f4c581-a3c7-4713-adf7-852f105b173c None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:33.482137 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e6f4c581-a3c7-4713-adf7-852f105b173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:33.483585 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:33.561051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 116/221] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:33.561999 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4c581-a3c7-4713-adf7-852f105b173c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:33.563601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a0d44-a8df-4e67-8d60-eba856a2adba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:33.566664 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a0d44-a8df-4e67-8d60-eba856a2adba None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:33.695638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 106/222] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:12:33.696527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a0d44-a8df-4e67-8d60-eba856a2adba None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:33.702566 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4c581-a3c7-4713-adf7-852f105b173c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:33.721859 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:33.738405 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:33.740690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c12f6-8573-49fe-99d3-016064f4136e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:33.741682 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c12f6-8573-49fe-99d3-016064f4136e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:33.742185 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c12f6-8573-49fe-99d3-016064f4136e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:33.742778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c12f6-8573-49fe-99d3-016064f4136e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:33.753876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c12f6-8573-49fe-99d3-016064f4136e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:33.759620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-470c12f6-8573-49fe-99d3-016064f4136e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:33.759620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:33.759620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:33.759620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:33.759620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:33.759620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:33.759620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:33.759620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:33.759620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:33.759620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:33.759620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:33.759620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:33.759620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:33.759620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:33.759620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:33.759620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:33.760486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:33.760486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:33.760486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:33.760486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:33.760486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:33.760486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:33.760486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:33.760486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:33.760486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:33.760486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:33.760486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:33.760486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:33.760486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:33.760486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:33.760486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:33.760486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:33.761302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:33.761302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:33.761302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:33.761302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:33.761302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:33.761302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:33.761302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:33.761302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:33.761302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:33.761302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:33.761302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:33.761302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:33.763630 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 117/223] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:12:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:33.764561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c12f6-8573-49fe-99d3-016064f4136e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:33.806131 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a0d44-a8df-4e67-8d60-eba856a2adba None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:33.931276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3894d-d6c5-4ef0-bf28-efd3689f7f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:33.931764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3894d-d6c5-4ef0-bf28-efd3689f7f9e None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:33.932093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3894d-d6c5-4ef0-bf28-efd3689f7f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:33.932360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3894d-d6c5-4ef0-bf28-efd3689f7f9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:33.945759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3894d-d6c5-4ef0-bf28-efd3689f7f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:33.950762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-d2b3894d-d6c5-4ef0-bf28-efd3689f7f9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:33.950762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:33.950762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:33.950762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:33.950762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:33.950762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:33.950762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:33.950762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:33.950762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:33.950762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:33.950762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:33.950762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:33.950762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:33.950762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:33.950762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:33.950762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:33.958003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:33.958003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:33.958003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:33.958003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:33.958003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:33.958003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:33.958003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:33.958003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:33.958003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:33.958003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:33.958003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:33.958003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:33.958003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:33.958003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:33.958003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:33.958003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:33.958826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:33.958826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:33.958826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:33.958826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:33.958826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:33.958826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:33.958826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:33.958826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:33.958826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:33.958826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:33.958826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:33.958826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:33.958826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 107/224] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:12:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:33.958826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3894d-d6c5-4ef0-bf28-efd3689f7f9e None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:33.971373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c12f6-8573-49fe-99d3-016064f4136e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:34.008489 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2293832-b620-4baf-8da4-a4edfe717ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:34.009689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2293832-b620-4baf-8da4-a4edfe717ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:34.010190 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2293832-b620-4baf-8da4-a4edfe717ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:34.010660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2293832-b620-4baf-8da4-a4edfe717ab7 None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:34.012053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2293832-b620-4baf-8da4-a4edfe717ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:34.013750 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2293832-b620-4baf-8da4-a4edfe717ab7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:34.015761 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 118/225] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:33 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:34.016722 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2293832-b620-4baf-8da4-a4edfe717ab7 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:34.063822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:34.065264 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:34.071037 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3894d-d6c5-4ef0-bf28-efd3689f7f9e None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:34.107218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93c6ea-d8e9-40fa-a083-e8d99f7b9320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:34.107857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93c6ea-d8e9-40fa-a083-e8d99f7b9320 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:34.108145 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93c6ea-d8e9-40fa-a083-e8d99f7b9320 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:34.108651 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93c6ea-d8e9-40fa-a083-e8d99f7b9320 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:34.109122 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93c6ea-d8e9-40fa-a083-e8d99f7b9320 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:34.109425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93c6ea-d8e9-40fa-a083-e8d99f7b9320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:34.110881 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93c6ea-d8e9-40fa-a083-e8d99f7b9320 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:34.124675 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 108/226] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:34.124675 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93c6ea-d8e9-40fa-a083-e8d99f7b9320 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:34.135590 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2293832-b620-4baf-8da4-a4edfe717ab7 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:34.174122 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec28d6-685c-49fe-b0b1-cf599793d61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:34.175149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec28d6-685c-49fe-b0b1-cf599793d61c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:34.176100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec28d6-685c-49fe-b0b1-cf599793d61c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:34.176578 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec28d6-685c-49fe-b0b1-cf599793d61c None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:34.177833 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec28d6-685c-49fe-b0b1-cf599793d61c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:34.178511 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec28d6-685c-49fe-b0b1-cf599793d61c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:34.181566 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec28d6-685c-49fe-b0b1-cf599793d61c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:34.192987 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 119/227] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:12:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:34.194070 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec28d6-685c-49fe-b0b1-cf599793d61c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:34.231909 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93c6ea-d8e9-40fa-a083-e8d99f7b9320 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:34.267906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9f4fb-7659-475a-9f8e-db269bbd0653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:34.268605 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9f4fb-7659-475a-9f8e-db269bbd0653 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:34.268954 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9f4fb-7659-475a-9f8e-db269bbd0653 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:34.269295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9f4fb-7659-475a-9f8e-db269bbd0653 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:34.270193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9f4fb-7659-475a-9f8e-db269bbd0653 None admin] RBAC: Adding query filter params (role.id=d481402a8f1b4e189c0ecc05bce560e6, scope.project.id=4c563dccc823490ba5fc84b8bd242ab6, user.id=39e5a535d8e640be91173a4e48f7c473) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:34.270566 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9f4fb-7659-475a-9f8e-db269bbd0653 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:34.272077 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9f4fb-7659-475a-9f8e-db269bbd0653 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:34.278629 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 109/228] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:34 2022] GET /identity/v3/role_assignments?user.id=39e5a535d8e640be91173a4e48f7c473&scope.project.id=4c563dccc823490ba5fc84b8bd242ab6&role.id=d481402a8f1b4e189c0ecc05bce560e6 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:34.286292 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9f4fb-7659-475a-9f8e-db269bbd0653 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:34.335148 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec28d6-685c-49fe-b0b1-cf599793d61c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:34.338166 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:34.340062 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:34.387948 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc39530-e5db-463b-b36c-03ddafa19833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:34.388941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc39530-e5db-463b-b36c-03ddafa19833 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:34.389430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc39530-e5db-463b-b36c-03ddafa19833 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:34.389916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc39530-e5db-463b-b36c-03ddafa19833 None admin] PATH_INFO: `/v3/users/ae5ee3f143e2440683a31989d976f14c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:34.393177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc39530-e5db-463b-b36c-03ddafa19833 None admin] RBAC: Authorizing `identity:get_user(user_id=ae5ee3f143e2440683a31989d976f14c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:34.394921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc39530-e5db-463b-b36c-03ddafa19833 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:34.396919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 120/229] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:34 2022] GET /identity/v3/users/ae5ee3f143e2440683a31989d976f14c => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:34.410397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc39530-e5db-463b-b36c-03ddafa19833 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:34.499688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9f4fb-7659-475a-9f8e-db269bbd0653 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:34.536985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73a9b4-4a7c-4d8f-a025-8709e97b8d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:34.538017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73a9b4-4a7c-4d8f-a025-8709e97b8d3b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:34.539170 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73a9b4-4a7c-4d8f-a025-8709e97b8d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:34.539688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73a9b4-4a7c-4d8f-a025-8709e97b8d3b None admin] PATH_INFO: `/v3/users/ae5ee3f143e2440683a31989d976f14c` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:34.541095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73a9b4-4a7c-4d8f-a025-8709e97b8d3b None admin] RBAC: Authorizing `identity:get_user(user_id=ae5ee3f143e2440683a31989d976f14c)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:34.542847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73a9b4-4a7c-4d8f-a025-8709e97b8d3b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:34.544945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 110/230] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:34 2022] GET /identity/v3/users/ae5ee3f143e2440683a31989d976f14c => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:34.551553 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73a9b4-4a7c-4d8f-a025-8709e97b8d3b None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:34.558455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc39530-e5db-463b-b36c-03ddafa19833 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:34.622236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd6f66-71c8-4986-972d-8eee86566190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:34.623280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd6f66-71c8-4986-972d-8eee86566190 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:34.623779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd6f66-71c8-4986-972d-8eee86566190 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:34.624271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd6f66-71c8-4986-972d-8eee86566190 None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:34.625782 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd6f66-71c8-4986-972d-8eee86566190 None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:34.627446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd6f66-71c8-4986-972d-8eee86566190 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:34.629649 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 121/231] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:34 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:34.636708 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd6f66-71c8-4986-972d-8eee86566190 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:34.676831 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:34.693823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73a9b4-4a7c-4d8f-a025-8709e97b8d3b None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:34.723663 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:34.783571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1599c37-c8bb-44cc-a5bb-0aec532da24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:34.784255 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1599c37-c8bb-44cc-a5bb-0aec532da24a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:34.784525 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1599c37-c8bb-44cc-a5bb-0aec532da24a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:34.784802 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1599c37-c8bb-44cc-a5bb-0aec532da24a None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:34.786222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1599c37-c8bb-44cc-a5bb-0aec532da24a None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:34.787687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1599c37-c8bb-44cc-a5bb-0aec532da24a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:34.794168 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 111/232] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:34 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:34.798399 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1599c37-c8bb-44cc-a5bb-0aec532da24a None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:34.810490 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd6f66-71c8-4986-972d-8eee86566190 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:34.874167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2da51-a0f6-4b9c-a768-284ffdc253c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:34.875114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2da51-a0f6-4b9c-a768-284ffdc253c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:34.876682 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2da51-a0f6-4b9c-a768-284ffdc253c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:34.877114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2da51-a0f6-4b9c-a768-284ffdc253c1 None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6/users/ae5ee3f143e2440683a31989d976f14c/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:34.880517 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2da51-a0f6-4b9c-a768-284ffdc253c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c563dccc823490ba5fc84b8bd242ab6, user_id=ae5ee3f143e2440683a31989d976f14c, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:34.883421 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2da51-a0f6-4b9c-a768-284ffdc253c1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:34.939285 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1599c37-c8bb-44cc-a5bb-0aec532da24a None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:34.957350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 122/233] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:12:34 2022] PUT /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6/users/ae5ee3f143e2440683a31989d976f14c/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:12:34.982976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79898334-480d-4711-b960-e6cf8545f6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:34.983982 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79898334-480d-4711-b960-e6cf8545f6db None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:34.984402 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79898334-480d-4711-b960-e6cf8545f6db None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:34.984812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79898334-480d-4711-b960-e6cf8545f6db None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6/users/ae5ee3f143e2440683a31989d976f14c/roles/07a2273f06f649d4a7f2117b3cf6b34d` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:34.987315 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79898334-480d-4711-b960-e6cf8545f6db None admin] RBAC: Authorizing `identity:create_grant(project_id=4c563dccc823490ba5fc84b8bd242ab6, user_id=ae5ee3f143e2440683a31989d976f14c, role_id=07a2273f06f649d4a7f2117b3cf6b34d)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:34.988967 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79898334-480d-4711-b960-e6cf8545f6db None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:35.089118 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 112/234] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:12:34 2022] PUT /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6/users/ae5ee3f143e2440683a31989d976f14c/roles/07a2273f06f649d4a7f2117b3cf6b34d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:12:35.707297 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec19da-0917-45d8-8323-a23ecc4e700a None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:35.707691 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec19da-0917-45d8-8323-a23ecc4e700a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:35.707864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec19da-0917-45d8-8323-a23ecc4e700a None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:35.709232 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 123/235] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:35.714967 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6205f-50b0-4885-943d-74c409a23cd9 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:35.715257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6205f-50b0-4885-943d-74c409a23cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:35.715539 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6205f-50b0-4885-943d-74c409a23cd9 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:35.717020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 113/236] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:35.719000 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf25fb-1d71-454e-8cff-cbbcbb82d26d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:35.719284 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf25fb-1d71-454e-8cff-cbbcbb82d26d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:35.719566 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf25fb-1d71-454e-8cff-cbbcbb82d26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:35.727443 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dc0ce-1842-42e4-bee1-39853a56935b None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:35.727738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dc0ce-1842-42e4-bee1-39853a56935b None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:35.728023 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dc0ce-1842-42e4-bee1-39853a56935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:35.746113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e2bf25fb-1d71-454e-8cff-cbbcbb82d26d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:35.747324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e2bf25fb-1d71-454e-8cff-cbbcbb82d26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:35.764167 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-f81dc0ce-1842-42e4-bee1-39853a56935b None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:35.766290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f81dc0ce-1842-42e4-bee1-39853a56935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:35.796589 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:35.924196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 124/237] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:35.943179 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 114/238] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:35.950599 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf25fb-1d71-454e-8cff-cbbcbb82d26d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:35.966387 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dc0ce-1842-42e4-bee1-39853a56935b None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:35.998111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:36.132080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dc0ce-1842-42e4-bee1-39853a56935b None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:36.163602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf25fb-1d71-454e-8cff-cbbcbb82d26d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:36.177324 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4d31f-c567-4203-96a6-ce7b8e7ed4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:36.178013 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4d31f-c567-4203-96a6-ce7b8e7ed4ac None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:36.178291 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4d31f-c567-4203-96a6-ce7b8e7ed4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:36.178566 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4d31f-c567-4203-96a6-ce7b8e7ed4ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:36.199929 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4d31f-c567-4203-96a6-ce7b8e7ed4ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:36.204938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-eeb4d31f-c567-4203-96a6-ce7b8e7ed4ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:36.204938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:36.204938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:36.204938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:36.204938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:36.204938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:36.204938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:36.204938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:36.204938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:36.204938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:36.204938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:36.204938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:36.204938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:36.204938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:36.204938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:36.204938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:36.205827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:36.205827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:36.205827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:36.205827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:36.205827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:36.205827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:36.205827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:36.205827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:36.205827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:36.205827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:36.205827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:36.205827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:36.205827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:36.205827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:36.205827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:36.205827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:36.206592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:36.206592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:36.206592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:36.206592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:36.206592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:36.206592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:36.206592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:36.206592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:36.206592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:36.206592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:36.206592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:36.206592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:36.206592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 115/239] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:12:36.212330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4d31f-c567-4203-96a6-ce7b8e7ed4ac None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:36.223525 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:36.251101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ebe49-8cbf-4bb0-ae64-cf6eaeb57ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:36.251770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ebe49-8cbf-4bb0-ae64-cf6eaeb57ffe None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:36.252049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ebe49-8cbf-4bb0-ae64-cf6eaeb57ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:36.252323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ebe49-8cbf-4bb0-ae64-cf6eaeb57ffe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:36.258739 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ebe49-8cbf-4bb0-ae64-cf6eaeb57ffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:36.260252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ebe49-8cbf-4bb0-ae64-cf6eaeb57ffe None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:36.262392 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 125/240] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:36.270670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ebe49-8cbf-4bb0-ae64-cf6eaeb57ffe None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:36.359645 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4d31f-c567-4203-96a6-ce7b8e7ed4ac None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:36.409785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:36.416974 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ebe49-8cbf-4bb0-ae64-cf6eaeb57ffe None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:36.453212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532ba6-8aa5-4d4d-965c-80c37f6e7a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:36.454390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532ba6-8aa5-4d4d-965c-80c37f6e7a8c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:36.454669 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532ba6-8aa5-4d4d-965c-80c37f6e7a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:36.454941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532ba6-8aa5-4d4d-965c-80c37f6e7a8c None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:36.455672 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2532ba6-8aa5-4d4d-965c-80c37f6e7a8c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:36.455972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2532ba6-8aa5-4d4d-965c-80c37f6e7a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:36.457370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2532ba6-8aa5-4d4d-965c-80c37f6e7a8c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:36.465494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc04267-3c50-4d20-9489-1d2182bc61a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:36.466145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc04267-3c50-4d20-9489-1d2182bc61a9 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:36.466428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc04267-3c50-4d20-9489-1d2182bc61a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:36.466701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc04267-3c50-4d20-9489-1d2182bc61a9 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:36.467392 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc04267-3c50-4d20-9489-1d2182bc61a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:36.468827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc04267-3c50-4d20-9489-1d2182bc61a9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:36.475795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 116/241] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:36.482114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532ba6-8aa5-4d4d-965c-80c37f6e7a8c None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:36.542009 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 126/242] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:12:36 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:12:36.570352 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:36.611737 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532ba6-8aa5-4d4d-965c-80c37f6e7a8c None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:36.674314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1d833-1df9-432c-ac81-89f45bf1a50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:36.675366 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1d833-1df9-432c-ac81-89f45bf1a50c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:36.675823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1d833-1df9-432c-ac81-89f45bf1a50c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:36.676292 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1d833-1df9-432c-ac81-89f45bf1a50c None admin] PATH_INFO: `/v3/users/00a873d88e18419888979b3d1abe8660` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:36.693447 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1d833-1df9-432c-ac81-89f45bf1a50c None admin] RBAC: Authorizing `identity:get_user(user_id=00a873d88e18419888979b3d1abe8660)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:36.696280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1d833-1df9-432c-ac81-89f45bf1a50c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:36.698608 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 117/243] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:36 2022] GET /identity/v3/users/00a873d88e18419888979b3d1abe8660 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:36.706681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc04267-3c50-4d20-9489-1d2182bc61a9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:36.765249 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2749-9684-4e1c-aa1d-4f9f9749b47d None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:36.765249 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2749-9684-4e1c-aa1d-4f9f9749b47d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:36.765249 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2749-9684-4e1c-aa1d-4f9f9749b47d None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:36.765249 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 118/244] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:36.774775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22b43b-4a36-4840-9629-f7b0a0b9619f None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:36.775071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22b43b-4a36-4840-9629-f7b0a0b9619f None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:36.775353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22b43b-4a36-4840-9629-f7b0a0b9619f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:36.809382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-9e22b43b-4a36-4840-9629-f7b0a0b9619f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:36.811255 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9e22b43b-4a36-4840-9629-f7b0a0b9619f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:36.835006 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc04267-3c50-4d20-9489-1d2182bc61a9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:36.883860 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78dba9-c6f6-4671-ad0e-094615775b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:36.887304 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78dba9-c6f6-4671-ad0e-094615775b61 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:36.887614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78dba9-c6f6-4671-ad0e-094615775b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:36.887903 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78dba9-c6f6-4671-ad0e-094615775b61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:36.903473 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 119/245] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:36.921863 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:36.926416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22b43b-4a36-4840-9629-f7b0a0b9619f None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:36.985116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78dba9-c6f6-4671-ad0e-094615775b61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:36.986900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78dba9-c6f6-4671-ad0e-094615775b61 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:37.010448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:37.073974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22b43b-4a36-4840-9629-f7b0a0b9619f None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:37.127062 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 127/246] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:37.127711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a0c7a-c7ca-4a87-86e4-38ce80e2f4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:37.128529 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a0c7a-c7ca-4a87-86e4-38ce80e2f4bd None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:37.128880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a0c7a-c7ca-4a87-86e4-38ce80e2f4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:37.129223 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a0c7a-c7ca-4a87-86e4-38ce80e2f4bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:37.132770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78dba9-c6f6-4671-ad0e-094615775b61 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:37.144281 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a0c7a-c7ca-4a87-86e4-38ce80e2f4bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:37.151390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-726a0c7a-c7ca-4a87-86e4-38ce80e2f4bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:37.151390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:37.151390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:37.151390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:37.151390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:37.151390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:37.151390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:37.151390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:37.151390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:37.151390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:37.151390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:37.151390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:37.151390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:37.151390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:37.151390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:37.151390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:37.152257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:37.152257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:37.152257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:37.152257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:37.152257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:37.152257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:37.152257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:37.152257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:37.152257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:37.152257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:37.152257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:37.152257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:37.152257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:37.152257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:37.152257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:37.152257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:37.153119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:37.153119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:37.153119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:37.153119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:37.153119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:37.153119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:37.153119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:37.153119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:37.153119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:37.153119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:37.153119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:37.153119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:37.153119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 120/247] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:12:37.158506 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a0c7a-c7ca-4a87-86e4-38ce80e2f4bd None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:37.202808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:37.264173 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78dba9-c6f6-4671-ad0e-094615775b61 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:37.285678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a0c7a-c7ca-4a87-86e4-38ce80e2f4bd None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:37.330287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1babae4-1d86-4cc7-a296-f3f060b8b13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:37.331423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1babae4-1d86-4cc7-a296-f3f060b8b13e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:37.331922 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1babae4-1d86-4cc7-a296-f3f060b8b13e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:37.332389 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1babae4-1d86-4cc7-a296-f3f060b8b13e None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:37.333852 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1babae4-1d86-4cc7-a296-f3f060b8b13e None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:37.334607 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:37.337506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1babae4-1d86-4cc7-a296-f3f060b8b13e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:37.339811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 128/248] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:37 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:37.346682 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1babae4-1d86-4cc7-a296-f3f060b8b13e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:37.394202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4184d31-455b-4324-bea3-eaaaeff43ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:37.394872 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4184d31-455b-4324-bea3-eaaaeff43ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:37.395133 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4184d31-455b-4324-bea3-eaaaeff43ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:37.395426 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4184d31-455b-4324-bea3-eaaaeff43ff6 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:37.396142 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4184d31-455b-4324-bea3-eaaaeff43ff6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:37.396451 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4184d31-455b-4324-bea3-eaaaeff43ff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:37.397915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4184d31-455b-4324-bea3-eaaaeff43ff6 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:37.413037 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 121/249] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:37.421493 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4184d31-455b-4324-bea3-eaaaeff43ff6 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:37.548248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1babae4-1d86-4cc7-a296-f3f060b8b13e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:37.589376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb03bc-9ec0-4d3c-a2b7-99420cfcac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:37.590469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb03bc-9ec0-4d3c-a2b7-99420cfcac0f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:37.590953 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb03bc-9ec0-4d3c-a2b7-99420cfcac0f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:37.591427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb03bc-9ec0-4d3c-a2b7-99420cfcac0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:37.592447 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb03bc-9ec0-4d3c-a2b7-99420cfcac0f None admin] RBAC: Adding query filter params (role.id=7b504f6996494661ac7b09b0df1ac7bf, scope.project.id=4c563dccc823490ba5fc84b8bd242ab6, user.id=00a873d88e18419888979b3d1abe8660) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:37.592980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb03bc-9ec0-4d3c-a2b7-99420cfcac0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:37.595289 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:37.595793 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb03bc-9ec0-4d3c-a2b7-99420cfcac0f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:37.602950 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 129/250] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:37 2022] GET /identity/v3/role_assignments?user.id=00a873d88e18419888979b3d1abe8660&scope.project.id=4c563dccc823490ba5fc84b8bd242ab6&role.id=7b504f6996494661ac7b09b0df1ac7bf => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:37.661621 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4184d31-455b-4324-bea3-eaaaeff43ff6 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:37.713172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7093603-f567-421b-8248-6d4e30a9cdeb None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:37.713837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7093603-f567-421b-8248-6d4e30a9cdeb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:37.713943 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942f926-8459-48b6-978b-582e1169001e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:37.714443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7093603-f567-421b-8248-6d4e30a9cdeb None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:37.714571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942f926-8459-48b6-978b-582e1169001e None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:37.714803 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942f926-8459-48b6-978b-582e1169001e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:37.715088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942f926-8459-48b6-978b-582e1169001e None admin] PATH_INFO: `/v3/users/39e5a535d8e640be91173a4e48f7c473` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:37.717093 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 130/251] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:37.721294 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942f926-8459-48b6-978b-582e1169001e None admin] RBAC: Authorizing `identity:get_user(user_id=39e5a535d8e640be91173a4e48f7c473)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:37.721294 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942f926-8459-48b6-978b-582e1169001e None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:37.721294 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 122/252] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:37 2022] GET /identity/v3/users/39e5a535d8e640be91173a4e48f7c473 => generated 297 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:37.723281 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8293e-e42b-4293-909c-90af91e1c189 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:37.723772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8293e-e42b-4293-909c-90af91e1c189 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:37.724248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8293e-e42b-4293-909c-90af91e1c189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:37.727212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942f926-8459-48b6-978b-582e1169001e None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:37.764241 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-46b8293e-e42b-4293-909c-90af91e1c189 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:37.765491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-46b8293e-e42b-4293-909c-90af91e1c189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:37.808253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:37.903513 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 131/253] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:37.912337 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb7c8c-e7f8-467f-9a64-4f5e5b271c9e None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:37.914315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb7c8c-e7f8-467f-9a64-4f5e5b271c9e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:37.914808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb7c8c-e7f8-467f-9a64-4f5e5b271c9e None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:37.916772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 132/254] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:37.920937 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942f926-8459-48b6-978b-582e1169001e None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:37.922887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3360714-720c-4d38-afc2-9f51ae45ed8b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:37.923523 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3360714-720c-4d38-afc2-9f51ae45ed8b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:37.924000 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3360714-720c-4d38-afc2-9f51ae45ed8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:37.954075 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a3360714-720c-4d38-afc2-9f51ae45ed8b None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:37.955648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a3360714-720c-4d38-afc2-9f51ae45ed8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:37.957959 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03719eb3-1547-4c4a-9496-53e5a7bc237b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:37.958536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03719eb3-1547-4c4a-9496-53e5a7bc237b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:37.958821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03719eb3-1547-4c4a-9496-53e5a7bc237b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:37.959104 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03719eb3-1547-4c4a-9496-53e5a7bc237b None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:37.970380 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03719eb3-1547-4c4a-9496-53e5a7bc237b None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:37.971898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03719eb3-1547-4c4a-9496-53e5a7bc237b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:37.974042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 123/255] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:37 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:37.982541 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03719eb3-1547-4c4a-9496-53e5a7bc237b None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:38.082513 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 133/256] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:38.083416 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3360714-720c-4d38-afc2-9f51ae45ed8b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:38.096978 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03719eb3-1547-4c4a-9496-53e5a7bc237b None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:38.124363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:38.132461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf71ea-fbf9-442b-9f58-a4d0379b0c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:38.133150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf71ea-fbf9-442b-9f58-a4d0379b0c3c None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:38.133435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf71ea-fbf9-442b-9f58-a4d0379b0c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:38.133742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf71ea-fbf9-442b-9f58-a4d0379b0c3c None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6/users/39e5a535d8e640be91173a4e48f7c473/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:38.140511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf71ea-fbf9-442b-9f58-a4d0379b0c3c None admin] RBAC: Authorizing `identity:create_grant(project_id=4c563dccc823490ba5fc84b8bd242ab6, user_id=39e5a535d8e640be91173a4e48f7c473, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:38.142238 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf71ea-fbf9-442b-9f58-a4d0379b0c3c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:38.168608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:38.214705 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 124/257] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:12:37 2022] PUT /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6/users/39e5a535d8e640be91173a4e48f7c473/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:12:38.215596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf71ea-fbf9-442b-9f58-a4d0379b0c3c None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:38.248530 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3360714-720c-4d38-afc2-9f51ae45ed8b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:38.338647 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf76c6-bc46-48e1-8fac-0c066a55bf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:38.339326 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf76c6-bc46-48e1-8fac-0c066a55bf89 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:38.339614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf76c6-bc46-48e1-8fac-0c066a55bf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:38.339896 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf76c6-bc46-48e1-8fac-0c066a55bf89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:38.362015 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf76c6-bc46-48e1-8fac-0c066a55bf89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:38.367767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-7edf76c6-bc46-48e1-8fac-0c066a55bf89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:38.367767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:38.367767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:38.367767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:38.367767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:38.367767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:38.367767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:38.367767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:38.367767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:38.367767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:38.367767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:38.367767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:38.367767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:38.367767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:38.367767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:38.367767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:38.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:38.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:38.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:38.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:38.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:38.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:38.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:38.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:38.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:38.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:38.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:38.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:38.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:38.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:38.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:38.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:38.369429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:38.369429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:38.369429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:38.369429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:38.369429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:38.369429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:38.369429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:38.369429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:38.369429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:38.369429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:38.369429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:38.369429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:38.369429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 134/258] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:12:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:38.377408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf76c6-bc46-48e1-8fac-0c066a55bf89 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:38.426152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf71ea-fbf9-442b-9f58-a4d0379b0c3c None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:38.498069 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b14f0-a5c8-489a-bc7f-0d1461e48530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:38.498755 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b14f0-a5c8-489a-bc7f-0d1461e48530 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:38.499039 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b14f0-a5c8-489a-bc7f-0d1461e48530 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:38.499319 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b14f0-a5c8-489a-bc7f-0d1461e48530 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:38.524798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b14f0-a5c8-489a-bc7f-0d1461e48530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:38.532024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-c88b14f0-a5c8-489a-bc7f-0d1461e48530 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:38.532024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:38.532024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:38.532024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:38.532024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:38.532024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:38.532024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:38.532024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:38.532024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:38.532024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:38.532024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:38.532024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:38.532024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:38.532024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:38.532024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:38.532024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:38.532970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:38.532970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:38.532970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:38.532970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:38.532970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:38.532970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:38.532970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:38.532970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:38.532970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:38.532970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:38.532970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:38.532970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:38.532970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:38.532970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:38.532970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:38.532970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:38.533777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:38.533777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:38.533777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:38.533777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:38.533777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:38.533777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:38.533777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:38.533777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:38.533777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:38.533777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:38.533777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:38.533777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:38.533777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 125/259] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:12:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:38.542260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b14f0-a5c8-489a-bc7f-0d1461e48530 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:38.581178 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf76c6-bc46-48e1-8fac-0c066a55bf89 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:38.587160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:38.617812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:38.648633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720fa25-d968-48a2-85bb-8f51adf679ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:38.649269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720fa25-d968-48a2-85bb-8f51adf679ae None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:38.649585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720fa25-d968-48a2-85bb-8f51adf679ae None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:38.649863 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720fa25-d968-48a2-85bb-8f51adf679ae None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:38.650588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720fa25-d968-48a2-85bb-8f51adf679ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:38.650894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720fa25-d968-48a2-85bb-8f51adf679ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:38.653015 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720fa25-d968-48a2-85bb-8f51adf679ae None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:38.669158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 135/260] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:12:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:38.675936 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720fa25-d968-48a2-85bb-8f51adf679ae None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:38.727400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b14f0-a5c8-489a-bc7f-0d1461e48530 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:38.791865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf375f8-464b-4784-9b44-1a04221012b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:38.793410 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf375f8-464b-4784-9b44-1a04221012b7 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:38.794219 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf375f8-464b-4784-9b44-1a04221012b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:38.794699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf375f8-464b-4784-9b44-1a04221012b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:38.795883 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf375f8-464b-4784-9b44-1a04221012b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:38.797217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf375f8-464b-4784-9b44-1a04221012b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:38.798852 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf375f8-464b-4784-9b44-1a04221012b7 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:38.818724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 126/261] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:38.825175 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf375f8-464b-4784-9b44-1a04221012b7 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:38.849849 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720fa25-d968-48a2-85bb-8f51adf679ae None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:38.915218 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3a77e-7322-4359-9c1d-63402f2fe7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:38.915982 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3a77e-7322-4359-9c1d-63402f2fe7ce None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:38.916176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3a77e-7322-4359-9c1d-63402f2fe7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:38.916428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3a77e-7322-4359-9c1d-63402f2fe7ce None admin] PATH_INFO: `/v3/users/ae5ee3f143e2440683a31989d976f14c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:38.918575 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3a77e-7322-4359-9c1d-63402f2fe7ce None admin] RBAC: Authorizing `identity:get_user(user_id=ae5ee3f143e2440683a31989d976f14c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:38.920026 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3a77e-7322-4359-9c1d-63402f2fe7ce None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:38.923373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 136/262] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:38 2022] GET /identity/v3/users/ae5ee3f143e2440683a31989d976f14c => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:38.928162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3a77e-7322-4359-9c1d-63402f2fe7ce None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:38.990249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:39.004742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:39.007343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf375f8-464b-4784-9b44-1a04221012b7 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:39.068932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcaa53-db62-4549-af75-689d920eaeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:39.069667 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcaa53-db62-4549-af75-689d920eaeac None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:39.069955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcaa53-db62-4549-af75-689d920eaeac None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:39.070231 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcaa53-db62-4549-af75-689d920eaeac None admin] PATH_INFO: `/v3/users/ae5ee3f143e2440683a31989d976f14c` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:39.074222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcaa53-db62-4549-af75-689d920eaeac None admin] RBAC: Authorizing `identity:get_user(user_id=ae5ee3f143e2440683a31989d976f14c)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:39.075764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcaa53-db62-4549-af75-689d920eaeac None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:39.077756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 127/263] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:38 2022] GET /identity/v3/users/ae5ee3f143e2440683a31989d976f14c => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:39.083108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcaa53-db62-4549-af75-689d920eaeac None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:39.109748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3a77e-7322-4359-9c1d-63402f2fe7ce None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:39.196554 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fc36a-7dcf-46c6-b266-46625a972205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:39.197432 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc36a-7dcf-46c6-b266-46625a972205 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:39.197740 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc36a-7dcf-46c6-b266-46625a972205 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:39.198012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc36a-7dcf-46c6-b266-46625a972205 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:39.333326 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcaa53-db62-4549-af75-689d920eaeac None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:39.337061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fc36a-7dcf-46c6-b266-46625a972205 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:39.339621 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fc36a-7dcf-46c6-b266-46625a972205 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:39.412993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1ef14-febd-4007-8803-624bb7dfec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:39.413821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1ef14-febd-4007-8803-624bb7dfec21 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:39.414047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:39.414152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1ef14-febd-4007-8803-624bb7dfec21 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:39.414372 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1ef14-febd-4007-8803-624bb7dfec21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:39.501777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:39.543678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 137/264] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:12:39.545028 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e789f6-0202-453c-82e6-31117b60d620 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:39.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e789f6-0202-453c-82e6-31117b60d620 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:39.545626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e789f6-0202-453c-82e6-31117b60d620 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:39.546871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 138/265] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:39.552268 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7947a3-a84a-487c-a2b4-40696082381f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:39.552481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7947a3-a84a-487c-a2b4-40696082381f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:39.552753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7947a3-a84a-487c-a2b4-40696082381f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:39.565859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1ef14-febd-4007-8803-624bb7dfec21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:39.567328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1ef14-febd-4007-8803-624bb7dfec21 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:39.589083 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8f7947a3-a84a-487c-a2b4-40696082381f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:39.590521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8f7947a3-a84a-487c-a2b4-40696082381f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:39.703923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 139/266] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:39.705163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7947a3-a84a-487c-a2b4-40696082381f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:39.777928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:39.812446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 128/267] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:12:39.813566 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1ef14-febd-4007-8803-624bb7dfec21 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:39.814281 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7947a3-a84a-487c-a2b4-40696082381f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:39.865077 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84caa78-47fc-4459-9350-79bb59c6a77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:39.866028 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84caa78-47fc-4459-9350-79bb59c6a77c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:39.866315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84caa78-47fc-4459-9350-79bb59c6a77c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:39.866737 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84caa78-47fc-4459-9350-79bb59c6a77c None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:39.867991 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84caa78-47fc-4459-9350-79bb59c6a77c None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:39.869683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84caa78-47fc-4459-9350-79bb59c6a77c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:39.876785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 140/268] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:39 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:39.877782 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84caa78-47fc-4459-9350-79bb59c6a77c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:39.909414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:39.949034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1ef14-febd-4007-8803-624bb7dfec21 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:39.986909 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f97c0-2ace-499a-8646-676d55a26085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:39.987989 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f97c0-2ace-499a-8646-676d55a26085 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:39.988343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f97c0-2ace-499a-8646-676d55a26085 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:39.988716 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f97c0-2ace-499a-8646-676d55a26085 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:39.990152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f97c0-2ace-499a-8646-676d55a26085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:39.992017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f97c0-2ace-499a-8646-676d55a26085 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:39.997604 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 129/269] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:39.998994 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cdbae-719c-4254-9f77-0bf19406073f None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:40.000423 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cdbae-719c-4254-9f77-0bf19406073f None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:40.000697 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cdbae-719c-4254-9f77-0bf19406073f None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:40.001992 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 130/270] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:40.002687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cdbae-719c-4254-9f77-0bf19406073f None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:40.019180 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84caa78-47fc-4459-9350-79bb59c6a77c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:40.052728 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:40.058352 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1735c-745a-44fb-9ee2-0aa6b64b23c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:40.059466 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1735c-745a-44fb-9ee2-0aa6b64b23c2 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:40.062334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1735c-745a-44fb-9ee2-0aa6b64b23c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:40.062334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1735c-745a-44fb-9ee2-0aa6b64b23c2 None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:40.062334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1735c-745a-44fb-9ee2-0aa6b64b23c2 None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:40.063722 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1735c-745a-44fb-9ee2-0aa6b64b23c2 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:40.066258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 141/271] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:39 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:40.072858 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1735c-745a-44fb-9ee2-0aa6b64b23c2 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:40.116542 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cdbae-719c-4254-9f77-0bf19406073f None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:40.154084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a15e1b-d9bb-41ab-bdd2-a8f70cdc8de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:40.154705 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a15e1b-d9bb-41ab-bdd2-a8f70cdc8de0 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:40.154996 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a15e1b-d9bb-41ab-bdd2-a8f70cdc8de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:40.155255 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a15e1b-d9bb-41ab-bdd2-a8f70cdc8de0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:40.156142 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a15e1b-d9bb-41ab-bdd2-a8f70cdc8de0 None admin] RBAC: Adding query filter params (role.id=07a2273f06f649d4a7f2117b3cf6b34d, scope.project.id=4c563dccc823490ba5fc84b8bd242ab6, user.id=ae5ee3f143e2440683a31989d976f14c) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:40.156454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a15e1b-d9bb-41ab-bdd2-a8f70cdc8de0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:40.158021 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a15e1b-d9bb-41ab-bdd2-a8f70cdc8de0 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:40.159937 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:40.169505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 131/272] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:40 2022] GET /identity/v3/role_assignments?user.id=ae5ee3f143e2440683a31989d976f14c&scope.project.id=4c563dccc823490ba5fc84b8bd242ab6&role.id=07a2273f06f649d4a7f2117b3cf6b34d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:40.169505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaa751-c020-4dce-846f-de7ebd12a719 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:40.169505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaa751-c020-4dce-846f-de7ebd12a719 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:40.169505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaa751-c020-4dce-846f-de7ebd12a719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:40.186453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-aebaa751-c020-4dce-846f-de7ebd12a719 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:40.187715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-aebaa751-c020-4dce-846f-de7ebd12a719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:40.255589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1735c-745a-44fb-9ee2-0aa6b64b23c2 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:40.269408 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 132/273] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:40.269408 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaa751-c020-4dce-846f-de7ebd12a719 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:40.325671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43b58e-f9a5-49b6-949c-a50a95bd65ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:40.326232 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43b58e-f9a5-49b6-949c-a50a95bd65ba None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:40.326509 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43b58e-f9a5-49b6-949c-a50a95bd65ba None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:40.326891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43b58e-f9a5-49b6-949c-a50a95bd65ba None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:40.327589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43b58e-f9a5-49b6-949c-a50a95bd65ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:40.329055 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43b58e-f9a5-49b6-949c-a50a95bd65ba None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:40.381078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaa751-c020-4dce-846f-de7ebd12a719 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:40.416168 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:40.424137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112d37a-6391-46a3-a6a9-4b44eed8af13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:40.424805 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112d37a-6391-46a3-a6a9-4b44eed8af13 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:40.425850 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112d37a-6391-46a3-a6a9-4b44eed8af13 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:40.425850 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112d37a-6391-46a3-a6a9-4b44eed8af13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:40.426171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112d37a-6391-46a3-a6a9-4b44eed8af13 None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=4c563dccc823490ba5fc84b8bd242ab6, user.id=ae5ee3f143e2440683a31989d976f14c) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:40.426482 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112d37a-6391-46a3-a6a9-4b44eed8af13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:40.427914 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112d37a-6391-46a3-a6a9-4b44eed8af13 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:40.435139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 133/274] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:40 2022] GET /identity/v3/role_assignments?user.id=ae5ee3f143e2440683a31989d976f14c&scope.project.id=4c563dccc823490ba5fc84b8bd242ab6&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:40.436391 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871a367-2667-48eb-b4e7-57c4ef4b599c None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:40.436672 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871a367-2667-48eb-b4e7-57c4ef4b599c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:40.440010 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871a367-2667-48eb-b4e7-57c4ef4b599c None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:40.440010 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 134/275] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:40.440172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 142/276] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:12:40 2022] POST /identity/v3/users => generated 293 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:12:40.440243 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871a367-2667-48eb-b4e7-57c4ef4b599c None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:40.445088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929090-61b8-473e-83c2-0c9c70b5be2f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:40.446000 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929090-61b8-473e-83c2-0c9c70b5be2f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:40.446413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929090-61b8-473e-83c2-0c9c70b5be2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:40.472835 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-59929090-61b8-473e-83c2-0c9c70b5be2f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:40.474611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-59929090-61b8-473e-83c2-0c9c70b5be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:40.556144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:40.599989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 143/277] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:40.608922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871a367-2667-48eb-b4e7-57c4ef4b599c None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:40.656785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59929090-61b8-473e-83c2-0c9c70b5be2f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:40.676730 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a282b2-bb7a-4e8b-a23c-2e9e03a94726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:40.677416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a282b2-bb7a-4e8b-a23c-2e9e03a94726 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:40.678131 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a282b2-bb7a-4e8b-a23c-2e9e03a94726 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:40.678406 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a282b2-bb7a-4e8b-a23c-2e9e03a94726 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:40.699715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a282b2-bb7a-4e8b-a23c-2e9e03a94726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:40.705182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-89a282b2-bb7a-4e8b-a23c-2e9e03a94726 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:40.705182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:40.705182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:40.705182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:40.705182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:40.705182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:40.705182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:40.705182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:40.705182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:40.705182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:40.705182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:40.705182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:40.705182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:40.705182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:40.705182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:40.705182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:40.706193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:40.706193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:40.706193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:40.706193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:40.706193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:40.706193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:40.706193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:40.706193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:40.706193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:40.706193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:40.706193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:40.706193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:40.706193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:40.706193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:40.706193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:40.706193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:40.707041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:40.707041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:40.707041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:40.707041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:40.707041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:40.707041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:40.707041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:40.707041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:40.707041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:40.707041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:40.707041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:40.707041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:40.707041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 135/278] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:40.714702 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a282b2-bb7a-4e8b-a23c-2e9e03a94726 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:40.780774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:40.821262 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59929090-61b8-473e-83c2-0c9c70b5be2f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:40.850245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a282b2-bb7a-4e8b-a23c-2e9e03a94726 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:40.869191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9b0be-72e3-4776-9500-9e11bd8d1855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:40.869881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9b0be-72e3-4776-9500-9e11bd8d1855 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:40.870158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9b0be-72e3-4776-9500-9e11bd8d1855 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:40.870430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9b0be-72e3-4776-9500-9e11bd8d1855 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:40.887490 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9b0be-72e3-4776-9500-9e11bd8d1855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:40.892565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-35b9b0be-72e3-4776-9500-9e11bd8d1855 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:40.892565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:40.892565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:40.892565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:40.892565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:40.892565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:40.892565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:40.892565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:40.892565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:40.892565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:40.892565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:40.892565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:40.892565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:40.892565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:40.892565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:40.892565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:40.894278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:40.894278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:40.894278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:40.894278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:40.894278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:40.894278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:40.894278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:40.894278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:40.894278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:40.894278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:40.894278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:40.894278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:40.894278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:40.894278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:40.894278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:40.894278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:40.895779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:40.895779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:40.895779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:40.895779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:40.895779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:40.895779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:40.895779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:40.895779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:40.895779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:40.895779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:40.895779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:40.895779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:40.895779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 144/279] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:40.906117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9b0be-72e3-4776-9500-9e11bd8d1855 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:40.920167 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe74b74-856c-498a-ac38-d71c9c843d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:40.920808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe74b74-856c-498a-ac38-d71c9c843d76 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:40.921089 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe74b74-856c-498a-ac38-d71c9c843d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:40.921370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe74b74-856c-498a-ac38-d71c9c843d76 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:40.922549 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe74b74-856c-498a-ac38-d71c9c843d76 None admin] RBAC: Adding query filter params (name=member) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:40.922859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe74b74-856c-498a-ac38-d71c9c843d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:40.924872 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe74b74-856c-498a-ac38-d71c9c843d76 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:40.941018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 136/280] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:40.949212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe74b74-856c-498a-ac38-d71c9c843d76 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:40.982084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:41.057379 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9b0be-72e3-4776-9500-9e11bd8d1855 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:41.108212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a5269-8b08-4479-92b7-6a684c263592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:41.108774 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a5269-8b08-4479-92b7-6a684c263592 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:41.109056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a5269-8b08-4479-92b7-6a684c263592 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:41.109334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a5269-8b08-4479-92b7-6a684c263592 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:41.110088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a5269-8b08-4479-92b7-6a684c263592 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:41.110396 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a5269-8b08-4479-92b7-6a684c263592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:41.111792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a5269-8b08-4479-92b7-6a684c263592 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:41.116108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe74b74-856c-498a-ac38-d71c9c843d76 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:41.129380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 145/281] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:41.138286 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a5269-8b08-4479-92b7-6a684c263592 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:41.142899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:41.167329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0b18a-f543-4fb5-9e4a-f59e6bf30e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:41.168597 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0b18a-f543-4fb5-9e4a-f59e6bf30e10 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:41.169162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0b18a-f543-4fb5-9e4a-f59e6bf30e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:41.169663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0b18a-f543-4fb5-9e4a-f59e6bf30e10 None admin] PATH_INFO: `/v3/users/f1f02b59870f4ed98e98f21b4b09ccb4` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:41.188558 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0b18a-f543-4fb5-9e4a-f59e6bf30e10 None admin] RBAC: Authorizing `identity:get_user(user_id=f1f02b59870f4ed98e98f21b4b09ccb4)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:41.190953 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0b18a-f543-4fb5-9e4a-f59e6bf30e10 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:41.197872 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 137/282] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:40 2022] GET /identity/v3/users/f1f02b59870f4ed98e98f21b4b09ccb4 => generated 293 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:41.199889 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0b18a-f543-4fb5-9e4a-f59e6bf30e10 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:41.285219 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a5269-8b08-4479-92b7-6a684c263592 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:41.296613 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:41.321808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0b18a-f543-4fb5-9e4a-f59e6bf30e10 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:41.332297 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39a6a4-661f-4814-b312-aa6d86bb5124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:41.332959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39a6a4-661f-4814-b312-aa6d86bb5124 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:41.333243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39a6a4-661f-4814-b312-aa6d86bb5124 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:41.333556 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39a6a4-661f-4814-b312-aa6d86bb5124 None admin] PATH_INFO: `/v3/users/00a873d88e18419888979b3d1abe8660` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:41.335748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39a6a4-661f-4814-b312-aa6d86bb5124 None admin] RBAC: Authorizing `identity:get_user(user_id=00a873d88e18419888979b3d1abe8660)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:41.337209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39a6a4-661f-4814-b312-aa6d86bb5124 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:41.344209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 146/283] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:41 2022] GET /identity/v3/users/00a873d88e18419888979b3d1abe8660 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:41.344209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345b4dc-e6a2-483a-9797-f237550d177e None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:41.344209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345b4dc-e6a2-483a-9797-f237550d177e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:41.344209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345b4dc-e6a2-483a-9797-f237550d177e None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:41.344209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 147/284] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:41.348592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345b4dc-e6a2-483a-9797-f237550d177e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:41.372190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948c028-dbcf-41d5-83f9-08b7ce313f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:41.373302 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948c028-dbcf-41d5-83f9-08b7ce313f72 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:41.373905 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948c028-dbcf-41d5-83f9-08b7ce313f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:41.374547 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948c028-dbcf-41d5-83f9-08b7ce313f72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:41.375531 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948c028-dbcf-41d5-83f9-08b7ce313f72 None admin] RBAC: Adding query filter params (role.id=d481402a8f1b4e189c0ecc05bce560e6, user.id=f1f02b59870f4ed98e98f21b4b09ccb4, scope.system=all) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:41.376036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948c028-dbcf-41d5-83f9-08b7ce313f72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:41.377831 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948c028-dbcf-41d5-83f9-08b7ce313f72 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:41.389233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 138/285] 10.222.0.33 () {56 vars in 1308 bytes} [Thu Jul 28 05:12:41 2022] GET /identity/v3/role_assignments?user.id=f1f02b59870f4ed98e98f21b4b09ccb4&scope.system=all&role.id=d481402a8f1b4e189c0ecc05bce560e6 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:41.391144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52a80f-6f5f-4e18-a23d-c7c47e344310 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:41.391707 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52a80f-6f5f-4e18-a23d-c7c47e344310 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:41.392181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52a80f-6f5f-4e18-a23d-c7c47e344310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:41.423576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-7a52a80f-6f5f-4e18-a23d-c7c47e344310 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:41.425133 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7a52a80f-6f5f-4e18-a23d-c7c47e344310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:41.484366 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:41.488769 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345b4dc-e6a2-483a-9797-f237550d177e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:41.530675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124e8c7-9c1e-448e-b719-bc60fa1abdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:41.531700 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124e8c7-9c1e-448e-b719-bc60fa1abdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:41.531994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124e8c7-9c1e-448e-b719-bc60fa1abdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:41.532272 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124e8c7-9c1e-448e-b719-bc60fa1abdb9 None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:41.533494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124e8c7-9c1e-448e-b719-bc60fa1abdb9 None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:41.534968 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124e8c7-9c1e-448e-b719-bc60fa1abdb9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:41.541503 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 148/286] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:41 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:41.550506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124e8c7-9c1e-448e-b719-bc60fa1abdb9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:41.561675 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 139/287] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:41.633401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52a80f-6f5f-4e18-a23d-c7c47e344310 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:41.633946 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:41.692412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124e8c7-9c1e-448e-b719-bc60fa1abdb9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:41.729996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b28e5-4840-441e-a4d3-e794b70e79a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:41.733627 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b28e5-4840-441e-a4d3-e794b70e79a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:41.733627 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b28e5-4840-441e-a4d3-e794b70e79a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:41.733627 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b28e5-4840-441e-a4d3-e794b70e79a6 None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6/users/00a873d88e18419888979b3d1abe8660/roles/7b504f6996494661ac7b09b0df1ac7bf` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:41.741181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b28e5-4840-441e-a4d3-e794b70e79a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c563dccc823490ba5fc84b8bd242ab6, user_id=00a873d88e18419888979b3d1abe8660, role_id=7b504f6996494661ac7b09b0df1ac7bf)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:41.743063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b28e5-4840-441e-a4d3-e794b70e79a6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:41.776295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52a80f-6f5f-4e18-a23d-c7c47e344310 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:41.814785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aca891-15ea-4b80-9031-41de2b138fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:41.815679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aca891-15ea-4b80-9031-41de2b138fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:41.816102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aca891-15ea-4b80-9031-41de2b138fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:41.816593 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aca891-15ea-4b80-9031-41de2b138fc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:41.825388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 149/288] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:12:41 2022] PUT /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6/users/00a873d88e18419888979b3d1abe8660/roles/7b504f6996494661ac7b09b0df1ac7bf => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:12:41.839546 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aca891-15ea-4b80-9031-41de2b138fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:41.845188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-96aca891-15ea-4b80-9031-41de2b138fc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:41.845188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:41.845188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:41.845188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:41.845188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:41.845188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:41.845188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:41.845188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:41.845188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:41.845188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:41.845188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:41.845188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:41.845188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:41.845188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:41.845188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:41.845188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:41.846266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:41.846266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:41.846266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:41.846266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:41.846266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:41.846266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:41.846266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:41.846266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:41.846266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:41.846266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:41.846266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:41.846266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:41.846266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:41.846266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:41.846266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:41.846266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:41.847283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:41.847283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:41.847283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:41.847283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:41.847283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:41.847283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:41.847283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:41.847283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:41.847283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:41.847283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:41.847283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:41.847283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:41.849607 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 140/289] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:41.857535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b28e5-4840-441e-a4d3-e794b70e79a6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:42.042287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b28e5-4840-441e-a4d3-e794b70e79a6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:42.044708 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:42.092139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963eb8d-ac2b-4178-bfcc-c9040a15e24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:42.092796 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963eb8d-ac2b-4178-bfcc-c9040a15e24e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:42.093050 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963eb8d-ac2b-4178-bfcc-c9040a15e24e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:42.093324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963eb8d-ac2b-4178-bfcc-c9040a15e24e None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:42.094093 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963eb8d-ac2b-4178-bfcc-c9040a15e24e None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:42.094398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963eb8d-ac2b-4178-bfcc-c9040a15e24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:42.095801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963eb8d-ac2b-4178-bfcc-c9040a15e24e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:42.110788 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 150/290] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:42.117203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aca891-15ea-4b80-9031-41de2b138fc0 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:42.152386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:42.239157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aca891-15ea-4b80-9031-41de2b138fc0 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:42.293065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d6dc3-6d05-42c9-94b5-cdbab68ef3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:42.293688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d6dc3-6d05-42c9-94b5-cdbab68ef3ec None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:42.293974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d6dc3-6d05-42c9-94b5-cdbab68ef3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:42.294255 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d6dc3-6d05-42c9-94b5-cdbab68ef3ec None admin] PATH_INFO: `/v3/users/39e5a535d8e640be91173a4e48f7c473` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:42.295470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d6dc3-6d05-42c9-94b5-cdbab68ef3ec None admin] RBAC: Authorizing `identity:get_user(user_id=39e5a535d8e640be91173a4e48f7c473)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:42.296925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d6dc3-6d05-42c9-94b5-cdbab68ef3ec None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:42.298609 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 141/291] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:42 2022] GET /identity/v3/users/39e5a535d8e640be91173a4e48f7c473 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:42.304153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963eb8d-ac2b-4178-bfcc-c9040a15e24e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:42.464255 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963eb8d-ac2b-4178-bfcc-c9040a15e24e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:42.509658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6628e3-058c-46b6-b91e-e5e33e78dd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:42.510291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6628e3-058c-46b6-b91e-e5e33e78dd10 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:42.510569 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6628e3-058c-46b6-b91e-e5e33e78dd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:42.510839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6628e3-058c-46b6-b91e-e5e33e78dd10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:42.573904 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:42.604908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6628e3-058c-46b6-b91e-e5e33e78dd10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:42.606414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6628e3-058c-46b6-b91e-e5e33e78dd10 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:42.724433 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 151/292] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:42.730437 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d6dc3-6d05-42c9-94b5-cdbab68ef3ec None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:42.874205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:42.885832 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d6dc3-6d05-42c9-94b5-cdbab68ef3ec None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:42.934782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209f483-418a-4b92-a4a8-bb6073641867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:42.935432 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209f483-418a-4b92-a4a8-bb6073641867 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:42.935713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209f483-418a-4b92-a4a8-bb6073641867 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:42.935988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209f483-418a-4b92-a4a8-bb6073641867 None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:42.937148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209f483-418a-4b92-a4a8-bb6073641867 None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:42.938635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209f483-418a-4b92-a4a8-bb6073641867 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:42.940870 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 142/293] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:42 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:42.947811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6628e3-058c-46b6-b91e-e5e33e78dd10 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:43.053896 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:43.101396 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6628e3-058c-46b6-b91e-e5e33e78dd10 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:43.150252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8ee0d-f827-48bb-9f4f-90c576554686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:43.150814 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8ee0d-f827-48bb-9f4f-90c576554686 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:43.151095 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8ee0d-f827-48bb-9f4f-90c576554686 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:43.151370 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8ee0d-f827-48bb-9f4f-90c576554686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:43.152169 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8ee0d-f827-48bb-9f4f-90c576554686 None admin] RBAC: Adding query filter params (role.id=d481402a8f1b4e189c0ecc05bce560e6, scope.project.id=4c563dccc823490ba5fc84b8bd242ab6, user.id=39e5a535d8e640be91173a4e48f7c473) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:43.152481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8ee0d-f827-48bb-9f4f-90c576554686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:43.154047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8ee0d-f827-48bb-9f4f-90c576554686 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:43.161139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 152/294] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:42 2022] GET /identity/v3/role_assignments?user.id=39e5a535d8e640be91173a4e48f7c473&scope.project.id=4c563dccc823490ba5fc84b8bd242ab6&role.id=d481402a8f1b4e189c0ecc05bce560e6 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:43.236379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532724f-4256-4da5-a1a7-a00b62b08eed None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:43.236893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532724f-4256-4da5-a1a7-a00b62b08eed None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:43.236965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532724f-4256-4da5-a1a7-a00b62b08eed None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:43.238616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 143/295] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:43.244500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74a6c6-2faa-4e31-8fcf-4e23af8b2894 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:43.244790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74a6c6-2faa-4e31-8fcf-4e23af8b2894 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:43.245073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74a6c6-2faa-4e31-8fcf-4e23af8b2894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:43.263251 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272545d-04a0-4534-afc2-6df916c9e916 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:43.263411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272545d-04a0-4534-afc2-6df916c9e916 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:43.264847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272545d-04a0-4534-afc2-6df916c9e916 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:43.265038 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 144/296] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:12:43.269513 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-5f74a6c6-2faa-4e31-8fcf-4e23af8b2894 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:43.269694 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5f74a6c6-2faa-4e31-8fcf-4e23af8b2894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:43.271633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b37f0-8f68-47c2-a748-511497e9a9c3 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:43.271988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b37f0-8f68-47c2-a748-511497e9a9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:43.272338 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b37f0-8f68-47c2-a748-511497e9a9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:43.304355 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-557b37f0-8f68-47c2-a748-511497e9a9c3 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:43.305681 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-557b37f0-8f68-47c2-a748-511497e9a9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:43.399801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 153/297] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:43.407344 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 145/298] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:43.429921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74a6c6-2faa-4e31-8fcf-4e23af8b2894 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:43.430862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b37f0-8f68-47c2-a748-511497e9a9c3 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:43.517372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:43.533557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:43.546946 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b37f0-8f68-47c2-a748-511497e9a9c3 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:43.570497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74a6c6-2faa-4e31-8fcf-4e23af8b2894 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:43.592840 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025153e-443e-48d6-add0-8e278ecba39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:43.593975 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025153e-443e-48d6-add0-8e278ecba39a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:43.594648 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025153e-443e-48d6-add0-8e278ecba39a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:43.595473 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025153e-443e-48d6-add0-8e278ecba39a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:43.596821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025153e-443e-48d6-add0-8e278ecba39a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:43.598971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025153e-443e-48d6-add0-8e278ecba39a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:43.601665 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 146/299] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:43.607146 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025153e-443e-48d6-add0-8e278ecba39a None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:43.617759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923171d8-342d-4a13-938b-4616b5e03a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:43.618418 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923171d8-342d-4a13-938b-4616b5e03a67 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:43.618705 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923171d8-342d-4a13-938b-4616b5e03a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:43.618983 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923171d8-342d-4a13-938b-4616b5e03a67 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:43.629622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923171d8-342d-4a13-938b-4616b5e03a67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:43.635258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-923171d8-342d-4a13-938b-4616b5e03a67 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:43.635258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:43.635258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:43.635258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:43.635258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:43.635258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:43.635258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:43.635258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:43.635258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:43.635258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:43.635258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:43.635258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:43.635258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:43.635258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:43.635258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:43.635258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:43.636331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:43.636331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:43.636331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:43.636331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:43.636331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:43.636331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:43.636331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:43.636331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:43.636331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:43.636331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:43.636331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:43.636331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:43.636331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:43.636331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:43.636331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:43.636331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:43.637204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:43.637204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:43.637204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:43.637204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:43.637204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:43.637204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:43.637204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:43.637204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:43.637204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:43.637204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:43.637204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:43.637204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:43.637204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 154/300] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:43.644736 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923171d8-342d-4a13-938b-4616b5e03a67 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:43.733923 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025153e-443e-48d6-add0-8e278ecba39a None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:43.750581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923171d8-342d-4a13-938b-4616b5e03a67 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:43.771875 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:43.774466 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839fda8-6ab5-41ba-a0b6-1252b8eeb99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:43.775293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839fda8-6ab5-41ba-a0b6-1252b8eeb99e None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:43.775767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839fda8-6ab5-41ba-a0b6-1252b8eeb99e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:43.776538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839fda8-6ab5-41ba-a0b6-1252b8eeb99e None admin] PATH_INFO: `/v3/groups` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:43.777829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839fda8-6ab5-41ba-a0b6-1252b8eeb99e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:43.779593 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839fda8-6ab5-41ba-a0b6-1252b8eeb99e None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:43.786921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269773b-1aba-4233-bd2a-13cee45511c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:43.787635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269773b-1aba-4233-bd2a-13cee45511c0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:43.787963 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269773b-1aba-4233-bd2a-13cee45511c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:43.788206 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269773b-1aba-4233-bd2a-13cee45511c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:43.789063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269773b-1aba-4233-bd2a-13cee45511c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:43.789493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269773b-1aba-4233-bd2a-13cee45511c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:43.790857 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269773b-1aba-4233-bd2a-13cee45511c0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:43.801520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 155/301] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:43.805160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269773b-1aba-4233-bd2a-13cee45511c0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:43.869531 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 147/302] 10.222.0.33 () {60 vars in 1134 bytes} [Thu Jul 28 05:12:43 2022] POST /identity/v3/groups => generated 229 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:12:43.932129 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269773b-1aba-4233-bd2a-13cee45511c0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:43.973244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25ec94-fe50-4f38-ae56-3b82e81e4ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:43.974357 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25ec94-fe50-4f38-ae56-3b82e81e4ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:43.974833 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25ec94-fe50-4f38-ae56-3b82e81e4ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:43.975302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25ec94-fe50-4f38-ae56-3b82e81e4ea2 None admin] PATH_INFO: `/v3/users/bbbe32f44f1545e891abb6e922593b46` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:43.992944 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25ec94-fe50-4f38-ae56-3b82e81e4ea2 None admin] RBAC: Authorizing `identity:get_user(user_id=bbbe32f44f1545e891abb6e922593b46)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:43.994803 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25ec94-fe50-4f38-ae56-3b82e81e4ea2 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:43.997353 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 156/303] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:43 2022] GET /identity/v3/users/bbbe32f44f1545e891abb6e922593b46 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:44.003566 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839fda8-6ab5-41ba-a0b6-1252b8eeb99e None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:44.029625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:44.065185 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1353de9-a727-454c-b985-44ae4b3d91a2 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:44.065830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1353de9-a727-454c-b985-44ae4b3d91a2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:44.066303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1353de9-a727-454c-b985-44ae4b3d91a2 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:44.068207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 157/304] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:12:44.075099 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dc566-507c-4a35-b459-f80fe223f8b9 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:44.075099 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dc566-507c-4a35-b459-f80fe223f8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:44.075099 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dc566-507c-4a35-b459-f80fe223f8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:44.093953 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8b6dc566-507c-4a35-b459-f80fe223f8b9 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:44.095171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8b6dc566-507c-4a35-b459-f80fe223f8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:44.134098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839fda8-6ab5-41ba-a0b6-1252b8eeb99e None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:44.143915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:44.167785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 158/305] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:44.178184 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cf547-2d2e-4fa2-8ddc-64bdcf4b9bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:44.179713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cf547-2d2e-4fa2-8ddc-64bdcf4b9bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:44.180191 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cf547-2d2e-4fa2-8ddc-64bdcf4b9bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:44.180895 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cf547-2d2e-4fa2-8ddc-64bdcf4b9bf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:44.181935 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cf547-2d2e-4fa2-8ddc-64bdcf4b9bf9 None admin] RBAC: Adding query filter params (role.id=7b504f6996494661ac7b09b0df1ac7bf, user.id=bbbe32f44f1545e891abb6e922593b46, scope.system=all) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:44.182438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cf547-2d2e-4fa2-8ddc-64bdcf4b9bf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:44.184082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cf547-2d2e-4fa2-8ddc-64bdcf4b9bf9 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:44.190056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 148/306] 10.222.0.33 () {56 vars in 1308 bytes} [Thu Jul 28 05:12:44 2022] GET /identity/v3/role_assignments?user.id=bbbe32f44f1545e891abb6e922593b46&scope.system=all&role.id=7b504f6996494661ac7b09b0df1ac7bf => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:44.190182 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dc566-507c-4a35-b459-f80fe223f8b9 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:44.310086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dc566-507c-4a35-b459-f80fe223f8b9 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:44.349200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5cda6-a12e-48e1-8a3f-4edc4880ac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:44.349891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5cda6-a12e-48e1-8a3f-4edc4880ac1a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:44.350176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5cda6-a12e-48e1-8a3f-4edc4880ac1a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:44.350456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5cda6-a12e-48e1-8a3f-4edc4880ac1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:44.361753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5cda6-a12e-48e1-8a3f-4edc4880ac1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:44.366791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-eed5cda6-a12e-48e1-8a3f-4edc4880ac1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:44.366791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:44.366791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:44.366791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:44.366791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:44.366791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:44.366791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:44.366791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:44.366791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:44.366791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:44.366791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:44.366791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:44.366791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:44.366791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:44.366791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:44.366791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:44.367656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:44.367656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:44.367656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:44.367656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:44.367656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:44.367656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:44.367656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:44.367656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:44.367656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:44.367656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:44.367656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:44.367656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:44.367656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:44.367656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:44.367656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:44.367656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:44.368446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:44.368446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:44.368446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:44.368446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:44.368446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:44.368446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:44.368446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:44.368446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:44.368446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:44.368446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:44.368446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:44.368446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:44.368446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 159/307] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:44.374135 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cf547-2d2e-4fa2-8ddc-64bdcf4b9bf9 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:44.462799 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:44.472447 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc18222-3970-49dd-bfe8-74578285bda5 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:44.472739 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc18222-3970-49dd-bfe8-74578285bda5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:44.473018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc18222-3970-49dd-bfe8-74578285bda5 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:44.474592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 160/308] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:44.484396 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cf547-2d2e-4fa2-8ddc-64bdcf4b9bf9 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:44.484576 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd06dd-3474-47cb-8991-30ade636defb None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:44.485092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd06dd-3474-47cb-8991-30ade636defb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:44.485601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd06dd-3474-47cb-8991-30ade636defb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:44.505053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-7dcd06dd-3474-47cb-8991-30ade636defb None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:44.506610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7dcd06dd-3474-47cb-8991-30ade636defb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:44.524233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59a17f-7c90-4234-8555-803c5c07fd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:44.525717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59a17f-7c90-4234-8555-803c5c07fd53 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:44.526265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59a17f-7c90-4234-8555-803c5c07fd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:44.527026 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59a17f-7c90-4234-8555-803c5c07fd53 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:44.527961 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59a17f-7c90-4234-8555-803c5c07fd53 None admin] RBAC: Adding query filter params (name=member) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:44.528608 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59a17f-7c90-4234-8555-803c5c07fd53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:44.530522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59a17f-7c90-4234-8555-803c5c07fd53 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:44.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 149/309] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:44.545841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:44.548327 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59a17f-7c90-4234-8555-803c5c07fd53 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:44.592235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 161/310] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:44.618355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd06dd-3474-47cb-8991-30ade636defb None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:44.670952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59a17f-7c90-4234-8555-803c5c07fd53 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:44.715872 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd435b-d9e5-4254-af08-a9551363ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:44.717416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd435b-d9e5-4254-af08-a9551363ec64 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:44.717948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd435b-d9e5-4254-af08-a9551363ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:44.718574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd435b-d9e5-4254-af08-a9551363ec64 None admin] PATH_INFO: `/v3/users/f1f02b59870f4ed98e98f21b4b09ccb4` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:44.720501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd435b-d9e5-4254-af08-a9551363ec64 None admin] RBAC: Authorizing `identity:get_user(user_id=f1f02b59870f4ed98e98f21b4b09ccb4)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:44.721907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd06dd-3474-47cb-8991-30ade636defb None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:44.722390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd435b-d9e5-4254-af08-a9551363ec64 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:44.725230 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 150/311] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:44 2022] GET /identity/v3/users/f1f02b59870f4ed98e98f21b4b09ccb4 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:44.735845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd435b-d9e5-4254-af08-a9551363ec64 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:44.750323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:44.762677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74eaef-d99b-42c9-8b3a-bf83cf6ccc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:44.763443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74eaef-d99b-42c9-8b3a-bf83cf6ccc9e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:44.763613 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74eaef-d99b-42c9-8b3a-bf83cf6ccc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:44.769579 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74eaef-d99b-42c9-8b3a-bf83cf6ccc9e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:44.775289 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74eaef-d99b-42c9-8b3a-bf83cf6ccc9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:44.781118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-7a74eaef-d99b-42c9-8b3a-bf83cf6ccc9e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:44.781118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:44.781118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:44.781118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:44.781118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:44.781118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:44.781118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:44.781118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:44.781118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:44.781118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:44.781118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:44.781118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:44.781118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:44.781118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:44.781118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:44.781118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:44.782133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:44.782133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:44.782133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:44.782133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:44.782133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:44.782133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:44.782133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:44.782133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:44.782133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:44.782133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:44.782133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:44.782133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:44.782133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:44.782133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:44.782133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:44.782133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:44.782906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:44.782906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:44.782906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:44.782906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:44.782906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:44.782906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:44.782906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:44.782906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:44.782906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:44.782906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:44.782906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:44.782906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:44.787231 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 162/312] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:12:44.789053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74eaef-d99b-42c9-8b3a-bf83cf6ccc9e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:44.815266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:44.843421 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd435b-d9e5-4254-af08-a9551363ec64 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:44.879628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5159990-66ec-4986-8d55-e1064bf1d0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:44.880618 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5159990-66ec-4986-8d55-e1064bf1d0aa None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:44.881116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5159990-66ec-4986-8d55-e1064bf1d0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:44.881610 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5159990-66ec-4986-8d55-e1064bf1d0aa None admin] PATH_INFO: `/v3/system/users/f1f02b59870f4ed98e98f21b4b09ccb4/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:44.883544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5159990-66ec-4986-8d55-e1064bf1d0aa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f1f02b59870f4ed98e98f21b4b09ccb4, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:44.885102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5159990-66ec-4986-8d55-e1064bf1d0aa None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:44.903134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74eaef-d99b-42c9-8b3a-bf83cf6ccc9e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:44.939938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb1803-372e-4876-8028-d8944ce971cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:44.940567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb1803-372e-4876-8028-d8944ce971cd None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:44.940851 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb1803-372e-4876-8028-d8944ce971cd None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:44.941127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb1803-372e-4876-8028-d8944ce971cd None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:44.941900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb1803-372e-4876-8028-d8944ce971cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:44.942228 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb1803-372e-4876-8028-d8944ce971cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:44.943603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb1803-372e-4876-8028-d8944ce971cd None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:44.953681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 163/313] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:44.959018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb1803-372e-4876-8028-d8944ce971cd None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:44.976844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 151/314] 10.222.0.33 () {58 vars in 1334 bytes} [Thu Jul 28 05:12:44 2022] PUT /identity/v3/system/users/f1f02b59870f4ed98e98f21b4b09ccb4/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:12:45.259455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:45.259455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb1803-372e-4876-8028-d8944ce971cd None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:45.259455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead4e1f-bed6-419d-819f-5b37ba736228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:45.259455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead4e1f-bed6-419d-819f-5b37ba736228 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:45.260133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead4e1f-bed6-419d-819f-5b37ba736228 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:45.260133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead4e1f-bed6-419d-819f-5b37ba736228 None admin] PATH_INFO: `/v3/users/00a873d88e18419888979b3d1abe8660` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:45.260133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead4e1f-bed6-419d-819f-5b37ba736228 None admin] RBAC: Authorizing `identity:get_user(user_id=00a873d88e18419888979b3d1abe8660)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:45.260133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead4e1f-bed6-419d-819f-5b37ba736228 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:45.260133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 164/315] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:44 2022] GET /identity/v3/users/00a873d88e18419888979b3d1abe8660 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:45.260448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5159990-66ec-4986-8d55-e1064bf1d0aa None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:45.260448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:45.260448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5159990-66ec-4986-8d55-e1064bf1d0aa None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:45.282717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f2e82-48c6-4163-9c5d-6cd5a920f1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:45.283356 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f2e82-48c6-4163-9c5d-6cd5a920f1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:45.283642 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f2e82-48c6-4163-9c5d-6cd5a920f1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:45.283923 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f2e82-48c6-4163-9c5d-6cd5a920f1e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:45.359518 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f2e82-48c6-4163-9c5d-6cd5a920f1e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:45.360986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f2e82-48c6-4163-9c5d-6cd5a920f1e5 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:45.454551 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:45.468203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 152/316] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:45.474553 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead4e1f-bed6-419d-819f-5b37ba736228 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:45.578745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead4e1f-bed6-419d-819f-5b37ba736228 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:45.613067 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6826097-0c69-4710-ad57-1a9fadafe703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:45.613745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6826097-0c69-4710-ad57-1a9fadafe703 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:45.614030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6826097-0c69-4710-ad57-1a9fadafe703 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:45.614320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6826097-0c69-4710-ad57-1a9fadafe703 None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:45.615565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6826097-0c69-4710-ad57-1a9fadafe703 None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:45.617636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6826097-0c69-4710-ad57-1a9fadafe703 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:45.619601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 165/317] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:45 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:45.626735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f2e82-48c6-4163-9c5d-6cd5a920f1e5 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:45.729865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f2e82-48c6-4163-9c5d-6cd5a920f1e5 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:45.766005 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c20c68-78c3-4ee1-a048-61484152f5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:45.766628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c20c68-78c3-4ee1-a048-61484152f5cf None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:45.766906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c20c68-78c3-4ee1-a048-61484152f5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:45.767176 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c20c68-78c3-4ee1-a048-61484152f5cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:45.767963 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c20c68-78c3-4ee1-a048-61484152f5cf None admin] RBAC: Adding query filter params (role.id=7b504f6996494661ac7b09b0df1ac7bf, scope.project.id=4c563dccc823490ba5fc84b8bd242ab6, user.id=00a873d88e18419888979b3d1abe8660) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:45.768271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c20c68-78c3-4ee1-a048-61484152f5cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:45.769726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c20c68-78c3-4ee1-a048-61484152f5cf None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:45.780868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 153/318] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:12:45 2022] GET /identity/v3/role_assignments?user.id=00a873d88e18419888979b3d1abe8660&scope.project.id=4c563dccc823490ba5fc84b8bd242ab6&role.id=7b504f6996494661ac7b09b0df1ac7bf => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:46.072594 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797af13-a751-435d-b51a-4498685bcdb7 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:46.072887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797af13-a751-435d-b51a-4498685bcdb7 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:46.073150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797af13-a751-435d-b51a-4498685bcdb7 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:46.074675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 166/319] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:46.079500 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958a4b5-269b-4874-a64d-6c32d5d8d8d7 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:46.079794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958a4b5-269b-4874-a64d-6c32d5d8d8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:46.080068 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958a4b5-269b-4874-a64d-6c32d5d8d8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:46.098091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-3958a4b5-269b-4874-a64d-6c32d5d8d8d7 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:46.099272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-3958a4b5-269b-4874-a64d-6c32d5d8d8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:46.137090 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:46.169337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 154/320] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:46.192324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797af13-a751-435d-b51a-4498685bcdb7 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:46.211845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:46.265941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb47fa2-020d-40f5-9c64-4491fd2149a9 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:46.266260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb47fa2-020d-40f5-9c64-4491fd2149a9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:46.266500 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb47fa2-020d-40f5-9c64-4491fd2149a9 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:46.267917 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 155/321] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:46.273791 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c8325-af4c-4986-af0a-65b10c1605e1 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:46.274090 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c8325-af4c-4986-af0a-65b10c1605e1 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:46.274341 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c8325-af4c-4986-af0a-65b10c1605e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:46.294584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-9b9c8325-af4c-4986-af0a-65b10c1605e1 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:46.295775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9b9c8325-af4c-4986-af0a-65b10c1605e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:46.315455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797af13-a751-435d-b51a-4498685bcdb7 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:46.352410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c939f8-195f-49ce-b973-50137a1ece1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:46.352974 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c939f8-195f-49ce-b973-50137a1ece1f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:46.353260 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c939f8-195f-49ce-b973-50137a1ece1f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:46.353556 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c939f8-195f-49ce-b973-50137a1ece1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:46.354697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c939f8-195f-49ce-b973-50137a1ece1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:46.356110 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c939f8-195f-49ce-b973-50137a1ece1f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:46.357713 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 167/322] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:12:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:46.362984 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c939f8-195f-49ce-b973-50137a1ece1f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:46.368388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 156/323] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:46.389908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c8325-af4c-4986-af0a-65b10c1605e1 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:46.449369 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:46.463710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c939f8-195f-49ce-b973-50137a1ece1f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:46.496686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c8325-af4c-4986-af0a-65b10c1605e1 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:46.497600 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513ac35-0279-4b66-9ad4-7666f489aa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:46.498226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513ac35-0279-4b66-9ad4-7666f489aa3b None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:46.498379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:46.498542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513ac35-0279-4b66-9ad4-7666f489aa3b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:46.498768 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513ac35-0279-4b66-9ad4-7666f489aa3b None admin] PATH_INFO: `/v3/groups` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:46.499426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513ac35-0279-4b66-9ad4-7666f489aa3b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:46.500848 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513ac35-0279-4b66-9ad4-7666f489aa3b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:46.532315 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b0506-e6ac-4f61-960d-7e899ad7f911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:46.532962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b0506-e6ac-4f61-960d-7e899ad7f911 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:46.533237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b0506-e6ac-4f61-960d-7e899ad7f911 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:46.533546 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b0506-e6ac-4f61-960d-7e899ad7f911 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:46.543918 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b0506-e6ac-4f61-960d-7e899ad7f911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:46.548795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-034b0506-e6ac-4f61-960d-7e899ad7f911 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:46.548795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:46.548795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:46.548795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:46.548795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:46.548795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:46.548795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:46.548795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:46.548795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:46.548795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:46.548795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:46.548795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:46.548795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:46.548795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:46.548795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:46.548795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:46.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:46.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:46.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:46.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:46.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:46.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:46.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:46.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:46.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:46.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:46.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:46.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:46.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:46.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:46.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:46.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:46.554600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:46.554600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:46.554600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:46.554600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:46.554600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:46.554600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:46.554600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:46.554600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:46.554600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:46.554600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:46.554600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:46.554600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:46.554600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 157/324] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:12:46.556054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b0506-e6ac-4f61-960d-7e899ad7f911 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:46.613573 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 168/325] 10.222.0.33 () {60 vars in 1134 bytes} [Thu Jul 28 05:12:46 2022] POST /identity/v3/groups => generated 226 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:12:46.674117 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b0506-e6ac-4f61-960d-7e899ad7f911 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:46.711891 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9b25e-ad7b-45de-9585-99a8c2cee904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:46.712533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9b25e-ad7b-45de-9585-99a8c2cee904 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:46.712818 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9b25e-ad7b-45de-9585-99a8c2cee904 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:46.713152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9b25e-ad7b-45de-9585-99a8c2cee904 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:46.713973 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9b25e-ad7b-45de-9585-99a8c2cee904 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:46.714293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9b25e-ad7b-45de-9585-99a8c2cee904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:46.715697 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9b25e-ad7b-45de-9585-99a8c2cee904 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:46.730187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 158/326] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:46.731709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513ac35-0279-4b66-9ad4-7666f489aa3b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:46.842721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513ac35-0279-4b66-9ad4-7666f489aa3b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:46.892674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4fd9c-20c9-4fc5-886d-fa559e2b924c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:46.893655 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4fd9c-20c9-4fc5-886d-fa559e2b924c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:46.894135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4fd9c-20c9-4fc5-886d-fa559e2b924c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:46.894417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4fd9c-20c9-4fc5-886d-fa559e2b924c None admin] PATH_INFO: `/v3/users/bbbe32f44f1545e891abb6e922593b46` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:46.895621 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4fd9c-20c9-4fc5-886d-fa559e2b924c None admin] RBAC: Authorizing `identity:get_user(user_id=bbbe32f44f1545e891abb6e922593b46)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:46.897086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4fd9c-20c9-4fc5-886d-fa559e2b924c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:46.899748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 169/327] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:46 2022] GET /identity/v3/users/bbbe32f44f1545e891abb6e922593b46 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:46.905072 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9b25e-ad7b-45de-9585-99a8c2cee904 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:46.935852 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:47.021166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9b25e-ad7b-45de-9585-99a8c2cee904 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:47.058797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246c36f-89bd-4503-a3c1-f7dc24da5db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:47.059475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246c36f-89bd-4503-a3c1-f7dc24da5db0 None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:47.059759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246c36f-89bd-4503-a3c1-f7dc24da5db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:47.060036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246c36f-89bd-4503-a3c1-f7dc24da5db0 None admin] PATH_INFO: `/v3/system/users/bbbe32f44f1545e891abb6e922593b46/roles/7b504f6996494661ac7b09b0df1ac7bf` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:47.061567 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246c36f-89bd-4503-a3c1-f7dc24da5db0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bbbe32f44f1545e891abb6e922593b46, role_id=7b504f6996494661ac7b09b0df1ac7bf)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:47.062961 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246c36f-89bd-4503-a3c1-f7dc24da5db0 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:47.126073 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 159/328] 10.222.0.33 () {58 vars in 1334 bytes} [Thu Jul 28 05:12:46 2022] PUT /identity/v3/system/users/bbbe32f44f1545e891abb6e922593b46/roles/7b504f6996494661ac7b09b0df1ac7bf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:12:47.195458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590331fd-51f7-46aa-8768-c5441885217a None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:47.195890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590331fd-51f7-46aa-8768-c5441885217a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:47.196059 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590331fd-51f7-46aa-8768-c5441885217a None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:47.197916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 170/329] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:47.203855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7095-7ac6-48e2-9b53-db7a2363dd16 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:47.204146 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7095-7ac6-48e2-9b53-db7a2363dd16 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:47.204413 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7095-7ac6-48e2-9b53-db7a2363dd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:47.224627 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-059e7095-7ac6-48e2-9b53-db7a2363dd16 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:47.226433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-059e7095-7ac6-48e2-9b53-db7a2363dd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:47.332149 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 160/330] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:47.357064 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590331fd-51f7-46aa-8768-c5441885217a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:47.374312 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:47.482196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590331fd-51f7-46aa-8768-c5441885217a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:47.525004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640f834-8519-454a-8010-e3a712eb1bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:47.525695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640f834-8519-454a-8010-e3a712eb1bbc None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:47.525984 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640f834-8519-454a-8010-e3a712eb1bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:47.526265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640f834-8519-454a-8010-e3a712eb1bbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:47.537803 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640f834-8519-454a-8010-e3a712eb1bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:47.544469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-6640f834-8519-454a-8010-e3a712eb1bbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:47.544469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:47.544469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:47.544469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:47.544469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:47.544469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:47.544469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:47.544469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:47.544469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:47.544469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:47.544469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:47.544469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:47.544469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:47.544469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:47.544469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:47.544469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:47.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:47.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:47.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:47.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:47.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:47.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:47.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:47.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:47.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:47.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:47.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:47.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:47.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:47.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:47.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:47.545320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:47.546136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:47.546136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:47.546136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:47.546136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:47.546136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:47.546136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:47.546136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:47.546136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:47.546136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:47.546136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:47.546136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:47.546136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:47.546136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 171/331] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:47.551815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e7095-7ac6-48e2-9b53-db7a2363dd16 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:47.573056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:47.669237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e7095-7ac6-48e2-9b53-db7a2363dd16 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:47.719387 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb99b9f-6821-4fb0-bac9-8381aa56ad79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:47.720336 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb99b9f-6821-4fb0-bac9-8381aa56ad79 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:47.720808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb99b9f-6821-4fb0-bac9-8381aa56ad79 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:47.721279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb99b9f-6821-4fb0-bac9-8381aa56ad79 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:47.722245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb99b9f-6821-4fb0-bac9-8381aa56ad79 None admin] RBAC: Adding query filter params (name=member) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:47.722788 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb99b9f-6821-4fb0-bac9-8381aa56ad79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:47.724354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb99b9f-6821-4fb0-bac9-8381aa56ad79 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:47.735887 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 161/332] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:47.739745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640f834-8519-454a-8010-e3a712eb1bbc None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:47.918975 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:47.949876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640f834-8519-454a-8010-e3a712eb1bbc None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:47.991145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c40638-83d5-40d8-9ea9-ba7586667437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:47.992226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c40638-83d5-40d8-9ea9-ba7586667437 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:47.992706 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c40638-83d5-40d8-9ea9-ba7586667437 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:47.993157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c40638-83d5-40d8-9ea9-ba7586667437 None admin] PATH_INFO: `/v3/users/f1f02b59870f4ed98e98f21b4b09ccb4` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:47.998192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c40638-83d5-40d8-9ea9-ba7586667437 None admin] RBAC: Authorizing `identity:get_user(user_id=f1f02b59870f4ed98e98f21b4b09ccb4)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:47.999931 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c40638-83d5-40d8-9ea9-ba7586667437 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:48.002164 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 172/333] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:47 2022] GET /identity/v3/users/f1f02b59870f4ed98e98f21b4b09ccb4 => generated 293 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:48.008409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb99b9f-6821-4fb0-bac9-8381aa56ad79 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:48.100143 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:48.122671 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb99b9f-6821-4fb0-bac9-8381aa56ad79 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:48.159553 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51564804-b8af-4720-9fea-a1daadf3b4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:48.160232 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51564804-b8af-4720-9fea-a1daadf3b4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:48.160520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51564804-b8af-4720-9fea-a1daadf3b4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:48.160800 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51564804-b8af-4720-9fea-a1daadf3b4e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:48.161658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51564804-b8af-4720-9fea-a1daadf3b4e0 None admin] RBAC: Adding query filter params (role.id=d481402a8f1b4e189c0ecc05bce560e6, user.id=f1f02b59870f4ed98e98f21b4b09ccb4, scope.system=all) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:48.161978 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51564804-b8af-4720-9fea-a1daadf3b4e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:48.164027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51564804-b8af-4720-9fea-a1daadf3b4e0 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:48.178355 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 162/334] 10.222.0.33 () {56 vars in 1308 bytes} [Thu Jul 28 05:12:48 2022] GET /identity/v3/role_assignments?user.id=f1f02b59870f4ed98e98f21b4b09ccb4&scope.system=all&role.id=d481402a8f1b4e189c0ecc05bce560e6 => generated 510 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:49.207551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f325b1-3743-4f37-83a5-fb7144623c14 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:49.208062 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f325b1-3743-4f37-83a5-fb7144623c14 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:49.208135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f325b1-3743-4f37-83a5-fb7144623c14 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:49.209761 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 173/335] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:49.214784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2dcbd-4a3c-4ade-a40b-002a9dae97f3 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:49.215195 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2dcbd-4a3c-4ade-a40b-002a9dae97f3 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:49.215382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2dcbd-4a3c-4ade-a40b-002a9dae97f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:49.238660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-cdc2dcbd-4a3c-4ade-a40b-002a9dae97f3 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:49.239888 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-cdc2dcbd-4a3c-4ade-a40b-002a9dae97f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:49.328145 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 163/336] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:49.368242 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f325b1-3743-4f37-83a5-fb7144623c14 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:49.404496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0cb0b-9d93-4150-9d56-1bff639fc7bc None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:49.405105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0cb0b-9d93-4150-9d56-1bff639fc7bc None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:49.405664 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0cb0b-9d93-4150-9d56-1bff639fc7bc None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:49.407474 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 164/337] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:49.412503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180e3b5-f822-4468-a357-f303dbb0cdee None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:49.413033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180e3b5-f822-4468-a357-f303dbb0cdee None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:49.413968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180e3b5-f822-4468-a357-f303dbb0cdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:49.437424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-f180e3b5-f822-4468-a357-f303dbb0cdee None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:49.440777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f180e3b5-f822-4468-a357-f303dbb0cdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:49.530126 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f325b1-3743-4f37-83a5-fb7144623c14 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:49.560109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:49.571179 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 165/338] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:49.588854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f477a7e-1ade-433e-b003-972c7dfc4d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:49.589550 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f477a7e-1ade-433e-b003-972c7dfc4d01 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:49.589840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f477a7e-1ade-433e-b003-972c7dfc4d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:49.590120 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f477a7e-1ade-433e-b003-972c7dfc4d01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:49.603598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f477a7e-1ade-433e-b003-972c7dfc4d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:49.609090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-4f477a7e-1ade-433e-b003-972c7dfc4d01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:49.609090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:49.609090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:49.609090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:49.609090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:49.609090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:49.609090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:49.609090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:49.609090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:49.609090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:49.609090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:49.609090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:49.609090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:49.609090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:49.609090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:49.609090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:49.609994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:49.609994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:49.609994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:49.609994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:49.609994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:49.609994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:49.609994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:49.609994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:49.609994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:49.609994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:49.609994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:49.609994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:49.609994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:49.609994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:49.609994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:49.609994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:49.610779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:49.610779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:49.610779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:49.610779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:49.610779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:49.610779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:49.610779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:49.610779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:49.610779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:49.610779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:49.610779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:49.610779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:49.610779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 174/339] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:12:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:49.617635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180e3b5-f822-4468-a357-f303dbb0cdee None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:49.654200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f477a7e-1ade-433e-b003-972c7dfc4d01 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:49.657425 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:49.822393 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180e3b5-f822-4468-a357-f303dbb0cdee None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:49.848110 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f477a7e-1ade-433e-b003-972c7dfc4d01 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:49.906218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa74ca-034b-4811-a26c-b6da8369a23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:49.906862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa74ca-034b-4811-a26c-b6da8369a23b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:49.907142 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa74ca-034b-4811-a26c-b6da8369a23b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:49.907411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa74ca-034b-4811-a26c-b6da8369a23b None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:49.908137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa74ca-034b-4811-a26c-b6da8369a23b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:49.908438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa74ca-034b-4811-a26c-b6da8369a23b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:49.909828 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa74ca-034b-4811-a26c-b6da8369a23b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:49.912164 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c4486-35e6-44b3-a6a6-601032e39bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:49.914073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c4486-35e6-44b3-a6a6-601032e39bda None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:49.914523 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c4486-35e6-44b3-a6a6-601032e39bda None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:49.914943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c4486-35e6-44b3-a6a6-601032e39bda None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:49.922419 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 166/340] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:12:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:49.936115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa74ca-034b-4811-a26c-b6da8369a23b None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:49.937196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c4486-35e6-44b3-a6a6-601032e39bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:49.943342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-852c4486-35e6-44b3-a6a6-601032e39bda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:49.943342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:49.943342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:49.943342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:49.943342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:49.943342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:49.943342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:49.943342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:49.943342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:49.943342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:49.943342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:49.943342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:49.943342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:49.943342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:49.943342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:49.943342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:49.944464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:49.944464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:49.944464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:49.944464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:49.944464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:49.944464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:49.944464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:49.944464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:49.944464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:49.944464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:49.944464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:49.944464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:49.944464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:49.944464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:49.944464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:49.944464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:49.945434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:49.945434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:49.945434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:49.945434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:49.945434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:49.945434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:49.945434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:49.945434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:49.945434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:49.945434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:49.945434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:49.945434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:49.948736 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 175/341] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:49.955139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c4486-35e6-44b3-a6a6-601032e39bda None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:50.050350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:50.105911 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:50.128663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa74ca-034b-4811-a26c-b6da8369a23b None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:50.146997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c4486-35e6-44b3-a6a6-601032e39bda None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:50.191112 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6109ef-b558-4173-9fdc-26c598a52bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:50.191744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6109ef-b558-4173-9fdc-26c598a52bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:50.192022 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6109ef-b558-4173-9fdc-26c598a52bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:50.192300 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6109ef-b558-4173-9fdc-26c598a52bb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:50.211737 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b776e1e-1e7f-4aa2-a497-23c552cbc4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:50.212304 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b776e1e-1e7f-4aa2-a497-23c552cbc4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:50.212741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b776e1e-1e7f-4aa2-a497-23c552cbc4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:50.213187 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b776e1e-1e7f-4aa2-a497-23c552cbc4a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:50.214077 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b776e1e-1e7f-4aa2-a497-23c552cbc4a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:50.214519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b776e1e-1e7f-4aa2-a497-23c552cbc4a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:50.216052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b776e1e-1e7f-4aa2-a497-23c552cbc4a5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:50.233321 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 176/342] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:50.234848 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6a75b-c686-451f-8c8c-18ec5c1b8393 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:50.235360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6a75b-c686-451f-8c8c-18ec5c1b8393 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:50.235772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6a75b-c686-451f-8c8c-18ec5c1b8393 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:50.237386 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 177/343] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:50.239450 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6a75b-c686-451f-8c8c-18ec5c1b8393 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:50.312294 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6109ef-b558-4173-9fdc-26c598a52bb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:50.314095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6109ef-b558-4173-9fdc-26c598a52bb5 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:50.401051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6a75b-c686-451f-8c8c-18ec5c1b8393 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:50.421813 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:50.449814 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:50.471640 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e7dd9-d39f-471e-a4db-82a3fd771834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:50.472302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e7dd9-d39f-471e-a4db-82a3fd771834 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:50.472591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e7dd9-d39f-471e-a4db-82a3fd771834 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:50.472877 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e7dd9-d39f-471e-a4db-82a3fd771834 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:50.510281 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 167/344] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:50.511603 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61f880-79b4-4d0e-a2aa-85f4ae0c68bf None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:50.511894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61f880-79b4-4d0e-a2aa-85f4ae0c68bf None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:50.512171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61f880-79b4-4d0e-a2aa-85f4ae0c68bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:50.544541 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-5b61f880-79b4-4d0e-a2aa-85f4ae0c68bf None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:50.546096 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5b61f880-79b4-4d0e-a2aa-85f4ae0c68bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:50.586717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e7dd9-d39f-471e-a4db-82a3fd771834 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:50.591498 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e7dd9-d39f-471e-a4db-82a3fd771834 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:50.637767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 168/345] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:50.639796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4b2bf-495f-4f19-bf81-06c8080e468b None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:50.640554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4b2bf-495f-4f19-bf81-06c8080e468b None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:50.641061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4b2bf-495f-4f19-bf81-06c8080e468b None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:50.643465 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 169/346] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:50.644633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4b2bf-495f-4f19-bf81-06c8080e468b None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:50.705151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 178/347] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:12:50.710929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8259900-fd80-4a3c-9e0e-2f5560e49986 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:50.711216 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8259900-fd80-4a3c-9e0e-2f5560e49986 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:50.711490 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8259900-fd80-4a3c-9e0e-2f5560e49986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:50.733041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a8259900-fd80-4a3c-9e0e-2f5560e49986 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:50.734711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a8259900-fd80-4a3c-9e0e-2f5560e49986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:50.756279 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:50.765888 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:50.779689 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4b2bf-495f-4f19-bf81-06c8080e468b None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:50.825201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 179/348] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:50.826626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8259900-fd80-4a3c-9e0e-2f5560e49986 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:50.839961 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c49c3-7196-4204-8a74-1b29cb3631f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:50.841047 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c49c3-7196-4204-8a74-1b29cb3631f8 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:50.842066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c49c3-7196-4204-8a74-1b29cb3631f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:50.842808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c49c3-7196-4204-8a74-1b29cb3631f8 None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:50.845428 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c49c3-7196-4204-8a74-1b29cb3631f8 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:50.847453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c49c3-7196-4204-8a74-1b29cb3631f8 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:50.851340 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 170/349] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:50 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:50.852645 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c49c3-7196-4204-8a74-1b29cb3631f8 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:50.969106 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8259900-fd80-4a3c-9e0e-2f5560e49986 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:50.988183 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c49c3-7196-4204-8a74-1b29cb3631f8 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:51.014611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28ee7d-3ad8-407d-ac49-4145c3b2d50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:51.015618 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28ee7d-3ad8-407d-ac49-4145c3b2d50d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:51.016153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28ee7d-3ad8-407d-ac49-4145c3b2d50d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:51.016641 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28ee7d-3ad8-407d-ac49-4145c3b2d50d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:51.033774 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28ee7d-3ad8-407d-ac49-4145c3b2d50d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:51.041435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fccb7-1905-4e7d-ad20-9d0b0f490d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:51.041969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-7d28ee7d-3ad8-407d-ac49-4145c3b2d50d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:51.041969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:51.041969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:51.041969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:51.041969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:51.041969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:51.041969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:51.041969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:51.041969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:51.041969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:51.041969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:51.041969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:51.041969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:51.041969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:51.041969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:51.041969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:51.042900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:51.042900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:51.042900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:51.042900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:51.042900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:51.042900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:51.042900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:51.042900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:51.042900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:51.042900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:51.042900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:51.042900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:51.042900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:51.042900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:51.042900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:51.042900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:51.043699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:51.043699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:51.043699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:51.043699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:51.043699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:51.043699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:51.043699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:51.043699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:51.043699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:51.043699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:51.043699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:12:51.043699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:51.044320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fccb7-1905-4e7d-ad20-9d0b0f490d69 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:51.044320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fccb7-1905-4e7d-ad20-9d0b0f490d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:51.044320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fccb7-1905-4e7d-ad20-9d0b0f490d69 None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:51.044320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fccb7-1905-4e7d-ad20-9d0b0f490d69 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:51.045096 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fccb7-1905-4e7d-ad20-9d0b0f490d69 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:51.046781 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 171/351] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:50 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:51.046887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 180/351] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:51.047534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fccb7-1905-4e7d-ad20-9d0b0f490d69 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:51.048086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28ee7d-3ad8-407d-ac49-4145c3b2d50d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:51.070977 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:51.088771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:51.183899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fccb7-1905-4e7d-ad20-9d0b0f490d69 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:51.199661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28ee7d-3ad8-407d-ac49-4145c3b2d50d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:51.226762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ee52a-62aa-4fd5-916f-0a39235871e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:51.227346 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ee52a-62aa-4fd5-916f-0a39235871e5 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:51.227627 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ee52a-62aa-4fd5-916f-0a39235871e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:51.227904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ee52a-62aa-4fd5-916f-0a39235871e5 None admin] PATH_INFO: `/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:51.237591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ee52a-62aa-4fd5-916f-0a39235871e5 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b1bc1f5a134ced8d3a1e7860ca6585)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:51.240646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ee52a-62aa-4fd5-916f-0a39235871e5 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:51.243185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 172/352] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jul 28 05:12:51 2022] GET /identity/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:51.244220 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ee52a-62aa-4fd5-916f-0a39235871e5 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:51.249318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f66ad-0015-435b-ac3f-102d6b2e5ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:51.249318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f66ad-0015-435b-ac3f-102d6b2e5ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:51.249318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f66ad-0015-435b-ac3f-102d6b2e5ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:51.249318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f66ad-0015-435b-ac3f-102d6b2e5ce6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:51.259965 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f66ad-0015-435b-ac3f-102d6b2e5ce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:51.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-f76f66ad-0015-435b-ac3f-102d6b2e5ce6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:51.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:51.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:51.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:51.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:51.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:51.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:51.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:51.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:51.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:51.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:51.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:51.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:51.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:51.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:51.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:51.265929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:51.265929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:51.265929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:51.265929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:51.265929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:51.265929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:51.265929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:51.265929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:51.265929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:51.265929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:51.265929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:51.265929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:51.265929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:51.265929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:51.265929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:51.265929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:51.266711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:51.266711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:51.266711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:51.266711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:51.266711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:51.266711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:51.266711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:51.266711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:51.266711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:51.266711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:51.266711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:51.266711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:51.266711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 181/353] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:51.270319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f66ad-0015-435b-ac3f-102d6b2e5ce6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:51.367259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:51.384123 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:51.394868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f66ad-0015-435b-ac3f-102d6b2e5ce6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:51.399054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ee52a-62aa-4fd5-916f-0a39235871e5 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:51.444220 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d8bd6-d77a-46a5-97ea-ea5b1e18ffac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:51.445586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d8bd6-d77a-46a5-97ea-ea5b1e18ffac None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:51.446731 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d8bd6-d77a-46a5-97ea-ea5b1e18ffac None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:51.446731 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d8bd6-d77a-46a5-97ea-ea5b1e18ffac None admin] PATH_INFO: `/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:51.446948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ac270-d85f-4b4d-8858-adaceb19e78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:51.447260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ac270-d85f-4b4d-8858-adaceb19e78e None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:51.447543 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ac270-d85f-4b4d-8858-adaceb19e78e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:51.447818 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ac270-d85f-4b4d-8858-adaceb19e78e None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:51.447915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d8bd6-d77a-46a5-97ea-ea5b1e18ffac None admin] RBAC: Authorizing `identity:get_group(group_id=b2b1bc1f5a134ced8d3a1e7860ca6585)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:51.449377 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d8bd6-d77a-46a5-97ea-ea5b1e18ffac None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:51.449625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ac270-d85f-4b4d-8858-adaceb19e78e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:51.449934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ac270-d85f-4b4d-8858-adaceb19e78e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:51.451294 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ac270-d85f-4b4d-8858-adaceb19e78e None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:51.452102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 182/354] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jul 28 05:12:51 2022] GET /identity/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:51.457696 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d8bd6-d77a-46a5-97ea-ea5b1e18ffac None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:51.462332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 173/355] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:51.464281 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff343c8b-86ed-4b35-9f8b-f78c523d5575 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:51.464281 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff343c8b-86ed-4b35-9f8b-f78c523d5575 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:51.464281 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff343c8b-86ed-4b35-9f8b-f78c523d5575 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:51.465576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 174/356] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:51.466274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff343c8b-86ed-4b35-9f8b-f78c523d5575 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:51.579255 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d8bd6-d77a-46a5-97ea-ea5b1e18ffac None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:51.589980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff343c8b-86ed-4b35-9f8b-f78c523d5575 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:51.617139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10b024-b68b-49ae-8d2b-1f719e62cee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:51.617800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10b024-b68b-49ae-8d2b-1f719e62cee1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:51.618087 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10b024-b68b-49ae-8d2b-1f719e62cee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:51.618368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10b024-b68b-49ae-8d2b-1f719e62cee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:51.619166 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10b024-b68b-49ae-8d2b-1f719e62cee1 None admin] RBAC: Adding query filter params (group.id=b2b1bc1f5a134ced8d3a1e7860ca6585, role.id=07a2273f06f649d4a7f2117b3cf6b34d, scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:51.619481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10b024-b68b-49ae-8d2b-1f719e62cee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:51.620917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10b024-b68b-49ae-8d2b-1f719e62cee1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:51.626997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 183/357] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jul 28 05:12:51 2022] GET /identity/v3/role_assignments?group.id=b2b1bc1f5a134ced8d3a1e7860ca6585&scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72&role.id=07a2273f06f649d4a7f2117b3cf6b34d => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:51.627872 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10b024-b68b-49ae-8d2b-1f719e62cee1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:51.628427 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e50d6-afcf-4153-8402-ff1c236f73f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:51.629061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e50d6-afcf-4153-8402-ff1c236f73f6 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:51.629342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e50d6-afcf-4153-8402-ff1c236f73f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:51.629652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e50d6-afcf-4153-8402-ff1c236f73f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:51.630388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e50d6-afcf-4153-8402-ff1c236f73f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:51.630698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e50d6-afcf-4153-8402-ff1c236f73f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:51.632205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e50d6-afcf-4153-8402-ff1c236f73f6 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:51.638764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:51.644579 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 175/358] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:51.645667 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e50d6-afcf-4153-8402-ff1c236f73f6 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:51.671185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:51.766842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10b024-b68b-49ae-8d2b-1f719e62cee1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:51.802141 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e50d6-afcf-4153-8402-ff1c236f73f6 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:51.814827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b068ab-c366-4527-8aa0-3296aef2ad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:51.815463 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b068ab-c366-4527-8aa0-3296aef2ad78 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:51.815750 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b068ab-c366-4527-8aa0-3296aef2ad78 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:51.816024 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b068ab-c366-4527-8aa0-3296aef2ad78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:51.816825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b068ab-c366-4527-8aa0-3296aef2ad78 None admin] RBAC: Adding query filter params (group.id=b2b1bc1f5a134ced8d3a1e7860ca6585, role.id=d481402a8f1b4e189c0ecc05bce560e6, scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:51.817138 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b068ab-c366-4527-8aa0-3296aef2ad78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:51.818616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b068ab-c366-4527-8aa0-3296aef2ad78 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:51.826717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 184/359] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jul 28 05:12:51 2022] GET /identity/v3/role_assignments?group.id=b2b1bc1f5a134ced8d3a1e7860ca6585&scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72&role.id=d481402a8f1b4e189c0ecc05bce560e6 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:51.827967 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1f1d5-3dbf-428f-a5d5-378a1c045567 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:51.828251 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1f1d5-3dbf-428f-a5d5-378a1c045567 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:51.828531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1f1d5-3dbf-428f-a5d5-378a1c045567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:51.840949 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5d657-2e3b-4466-a706-c36848df232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:51.841580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5d657-2e3b-4466-a706-c36848df232a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:51.841859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5d657-2e3b-4466-a706-c36848df232a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:51.842132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5d657-2e3b-4466-a706-c36848df232a None admin] PATH_INFO: `/v3/users/bbbe32f44f1545e891abb6e922593b46` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:51.843423 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5d657-2e3b-4466-a706-c36848df232a None admin] RBAC: Authorizing `identity:get_user(user_id=bbbe32f44f1545e891abb6e922593b46)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:51.845209 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5d657-2e3b-4466-a706-c36848df232a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:51.847316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 176/360] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:12:51 2022] GET /identity/v3/users/bbbe32f44f1545e891abb6e922593b46 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:51.848541 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f130016-3e64-4e41-a55b-eb16ee2f7b02 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:51.848825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f130016-3e64-4e41-a55b-eb16ee2f7b02 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:51.849095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f130016-3e64-4e41-a55b-eb16ee2f7b02 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:51.849698 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1cb1f1d5-3dbf-428f-a5d5-378a1c045567 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:51.851756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1cb1f1d5-3dbf-428f-a5d5-378a1c045567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:51.853383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 177/361] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:51.853843 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f130016-3e64-4e41-a55b-eb16ee2f7b02 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:51.934060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:51.940350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 185/362] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:51.941247 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1f1d5-3dbf-428f-a5d5-378a1c045567 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:51.979398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:52.014400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f130016-3e64-4e41-a55b-eb16ee2f7b02 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:52.064607 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36521263-5fe2-4c79-b482-9c7b1a5f7065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:52.065242 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36521263-5fe2-4c79-b482-9c7b1a5f7065 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:52.065586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36521263-5fe2-4c79-b482-9c7b1a5f7065 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:52.065869 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36521263-5fe2-4c79-b482-9c7b1a5f7065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:52.098277 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1f1d5-3dbf-428f-a5d5-378a1c045567 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:52.141785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71304c09-6287-4719-8d46-647a43d1ed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:52.142812 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71304c09-6287-4719-8d46-647a43d1ed50 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:52.143271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71304c09-6287-4719-8d46-647a43d1ed50 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:52.143721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71304c09-6287-4719-8d46-647a43d1ed50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:52.144725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71304c09-6287-4719-8d46-647a43d1ed50 None admin] RBAC: Adding query filter params (role.id=7b504f6996494661ac7b09b0df1ac7bf, user.id=bbbe32f44f1545e891abb6e922593b46, scope.system=all) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:52.145386 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71304c09-6287-4719-8d46-647a43d1ed50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:52.147158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71304c09-6287-4719-8d46-647a43d1ed50 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:52.162195 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 186/363] 10.222.0.33 () {56 vars in 1308 bytes} [Thu Jul 28 05:12:51 2022] GET /identity/v3/role_assignments?user.id=bbbe32f44f1545e891abb6e922593b46&scope.system=all&role.id=7b504f6996494661ac7b09b0df1ac7bf => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:52.162468 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36521263-5fe2-4c79-b482-9c7b1a5f7065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:52.164014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36521263-5fe2-4c79-b482-9c7b1a5f7065 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:52.164516 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e978e0d-63fa-409f-bb4b-27b287cc8483 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:52.164992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e978e0d-63fa-409f-bb4b-27b287cc8483 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:52.165443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e978e0d-63fa-409f-bb4b-27b287cc8483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:52.187453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-0e978e0d-63fa-409f-bb4b-27b287cc8483 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:52.189421 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0e978e0d-63fa-409f-bb4b-27b287cc8483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:52.277545 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:52.294370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:52.300048 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 187/364] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:52.300722 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e978e0d-63fa-409f-bb4b-27b287cc8483 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:52.331894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 178/365] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:52.338696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36521263-5fe2-4c79-b482-9c7b1a5f7065 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:52.469563 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e978e0d-63fa-409f-bb4b-27b287cc8483 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:52.509671 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36521263-5fe2-4c79-b482-9c7b1a5f7065 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:52.517546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684e2dc-9c54-472f-ac4e-92e423e9de51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:52.518271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684e2dc-9c54-472f-ac4e-92e423e9de51 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:52.518603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684e2dc-9c54-472f-ac4e-92e423e9de51 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:52.518889 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684e2dc-9c54-472f-ac4e-92e423e9de51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:52.535676 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684e2dc-9c54-472f-ac4e-92e423e9de51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:52.542315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c684e2dc-9c54-472f-ac4e-92e423e9de51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:52.542315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:52.542315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:52.542315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:52.542315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:52.542315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:52.542315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:52.542315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:52.542315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:52.542315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:52.542315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:52.542315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:52.542315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:52.542315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:52.542315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:52.542315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:52.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:52.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:52.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:52.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:52.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:52.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:52.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:52.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:52.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:52.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:52.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:52.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:52.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:52.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:52.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:52.543205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:52.543996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:52.543996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:52.543996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:52.543996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:52.543996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:52.543996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:52.543996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:52.543996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:52.543996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:52.543996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:52.543996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:52.543996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:52.543996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 188/366] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:12:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:52.544656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684e2dc-9c54-472f-ac4e-92e423e9de51 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:52.560068 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a07c9a-7d60-45b6-8a90-abd9cc34f0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:52.561253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a07c9a-7d60-45b6-8a90-abd9cc34f0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:52.561567 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a07c9a-7d60-45b6-8a90-abd9cc34f0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:52.561850 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a07c9a-7d60-45b6-8a90-abd9cc34f0e5 None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:52.563494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a07c9a-7d60-45b6-8a90-abd9cc34f0e5 None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:52.565584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a07c9a-7d60-45b6-8a90-abd9cc34f0e5 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:52.568722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 179/367] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:52 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:52.569346 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a07c9a-7d60-45b6-8a90-abd9cc34f0e5 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:52.605993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:52.638821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:52.675643 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684e2dc-9c54-472f-ac4e-92e423e9de51 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:52.717669 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a07c9a-7d60-45b6-8a90-abd9cc34f0e5 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:52.720268 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f39326-ee3b-48eb-8aca-937552e6d8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:52.721709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f39326-ee3b-48eb-8aca-937552e6d8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:52.722002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f39326-ee3b-48eb-8aca-937552e6d8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:52.722275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f39326-ee3b-48eb-8aca-937552e6d8e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:52.740482 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f39326-ee3b-48eb-8aca-937552e6d8e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:52.748741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-f0f39326-ee3b-48eb-8aca-937552e6d8e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:52.748741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:52.748741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:52.748741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:52.748741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:52.748741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:52.748741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:52.748741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:52.748741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:52.748741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:52.748741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:52.748741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:52.748741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:52.748741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:52.748741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:52.748741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:52.749668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:52.749668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:52.749668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:52.749668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:52.749668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:52.749668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:52.749668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:52.749668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:52.749668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:52.749668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:52.749668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:52.749668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:52.749668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:52.749668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:52.749668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:52.749668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:52.750462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:52.750462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:52.750462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:52.750462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:52.750462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:52.750462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:52.750462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:52.750462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:52.750462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:52.750462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:52.750462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:52.750462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:52.754952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 189/368] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:12:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:52.754952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f39326-ee3b-48eb-8aca-937552e6d8e1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:52.769030 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08567df2-dd2c-4792-92e5-42f0adfc21bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:52.770256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08567df2-dd2c-4792-92e5-42f0adfc21bf None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:52.771249 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08567df2-dd2c-4792-92e5-42f0adfc21bf None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:52.771772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08567df2-dd2c-4792-92e5-42f0adfc21bf None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:52.773623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08567df2-dd2c-4792-92e5-42f0adfc21bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:52.774383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08567df2-dd2c-4792-92e5-42f0adfc21bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:52.776459 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08567df2-dd2c-4792-92e5-42f0adfc21bf None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:52.789865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 180/369] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:12:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:52.791755 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08567df2-dd2c-4792-92e5-42f0adfc21bf None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:52.875231 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f39326-ee3b-48eb-8aca-937552e6d8e1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:52.887420 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:52.921230 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfbab1-c156-4854-b68d-ec9024a6b419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:52.921987 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfbab1-c156-4854-b68d-ec9024a6b419 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:52.922435 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfbab1-c156-4854-b68d-ec9024a6b419 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:52.922664 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfbab1-c156-4854-b68d-ec9024a6b419 None admin] PATH_INFO: `/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:52.923924 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfbab1-c156-4854-b68d-ec9024a6b419 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b1bc1f5a134ced8d3a1e7860ca6585)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:52.925453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfbab1-c156-4854-b68d-ec9024a6b419 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:52.927134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 190/370] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jul 28 05:12:52 2022] GET /identity/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:52.928192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfbab1-c156-4854-b68d-ec9024a6b419 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:52.935985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08567df2-dd2c-4792-92e5-42f0adfc21bf None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:52.953948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:52.982818 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb27c52-52e3-4333-aa31-8784a903878f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:52.983714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb27c52-52e3-4333-aa31-8784a903878f None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:52.984243 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb27c52-52e3-4333-aa31-8784a903878f None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:52.984802 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb27c52-52e3-4333-aa31-8784a903878f None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:52.985748 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb27c52-52e3-4333-aa31-8784a903878f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:52.986247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb27c52-52e3-4333-aa31-8784a903878f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:52.988096 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb27c52-52e3-4333-aa31-8784a903878f None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:52.997712 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 181/371] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:52.998995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb27c52-52e3-4333-aa31-8784a903878f None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:53.059018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfbab1-c156-4854-b68d-ec9024a6b419 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:53.108693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4e0c0-1f7b-4e5a-a9e3-5d130f913d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:53.109340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4e0c0-1f7b-4e5a-a9e3-5d130f913d70 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:53.109653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4e0c0-1f7b-4e5a-a9e3-5d130f913d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:53.109939 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4e0c0-1f7b-4e5a-a9e3-5d130f913d70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:53.134163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb27c52-52e3-4333-aa31-8784a903878f None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:53.179353 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:53.187847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ed28f-e8d5-45b3-b435-bb2f22657e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:53.189044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ed28f-e8d5-45b3-b435-bb2f22657e98 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:53.189598 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ed28f-e8d5-45b3-b435-bb2f22657e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:53.196198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ed28f-e8d5-45b3-b435-bb2f22657e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:53.196198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ed28f-e8d5-45b3-b435-bb2f22657e98 None admin] RBAC: Adding query filter params (group.id=b2b1bc1f5a134ced8d3a1e7860ca6585, role.id=d481402a8f1b4e189c0ecc05bce560e6, scope.project.id=4c563dccc823490ba5fc84b8bd242ab6) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:53.196198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ed28f-e8d5-45b3-b435-bb2f22657e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:53.196198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ed28f-e8d5-45b3-b435-bb2f22657e98 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:53.203393 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 182/372] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jul 28 05:12:52 2022] GET /identity/v3/role_assignments?group.id=b2b1bc1f5a134ced8d3a1e7860ca6585&scope.project.id=4c563dccc823490ba5fc84b8bd242ab6&role.id=d481402a8f1b4e189c0ecc05bce560e6 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:53.204812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ed28f-e8d5-45b3-b435-bb2f22657e98 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:53.211105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4e0c0-1f7b-4e5a-a9e3-5d130f913d70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:53.212385 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4e0c0-1f7b-4e5a-a9e3-5d130f913d70 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:53.269632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:53.339970 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 191/373] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:53.346979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4e0c0-1f7b-4e5a-a9e3-5d130f913d70 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:53.355720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ed28f-e8d5-45b3-b435-bb2f22657e98 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:53.406996 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff43dd6-e396-472f-a8a1-20f1ce6fa7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:53.407640 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff43dd6-e396-472f-a8a1-20f1ce6fa7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:53.407921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff43dd6-e396-472f-a8a1-20f1ce6fa7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:53.408198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff43dd6-e396-472f-a8a1-20f1ce6fa7e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:53.442785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:53.469029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4e0c0-1f7b-4e5a-a9e3-5d130f913d70 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:53.492409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff43dd6-e396-472f-a8a1-20f1ce6fa7e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:53.493699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff43dd6-e396-472f-a8a1-20f1ce6fa7e1 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:53.511526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdbd89-4d81-4757-a1f1-29037e22b35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:53.512595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdbd89-4d81-4757-a1f1-29037e22b35c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:53.513082 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdbd89-4d81-4757-a1f1-29037e22b35c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:53.513705 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdbd89-4d81-4757-a1f1-29037e22b35c None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:53.515224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdbd89-4d81-4757-a1f1-29037e22b35c None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:53.516904 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdbd89-4d81-4757-a1f1-29037e22b35c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:53.519290 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 192/374] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:53 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:53.525102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdbd89-4d81-4757-a1f1-29037e22b35c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:53.536186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:53.651278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdbd89-4d81-4757-a1f1-29037e22b35c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:53.687862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 183/375] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:53.693242 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06399020-e678-47e1-807f-1b233e4a5969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:53.693806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff43dd6-e396-472f-a8a1-20f1ce6fa7e1 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:53.694988 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06399020-e678-47e1-807f-1b233e4a5969 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:53.695472 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06399020-e678-47e1-807f-1b233e4a5969 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:53.695959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06399020-e678-47e1-807f-1b233e4a5969 None admin] PATH_INFO: `/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:53.697689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06399020-e678-47e1-807f-1b233e4a5969 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b1bc1f5a134ced8d3a1e7860ca6585)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:53.700253 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06399020-e678-47e1-807f-1b233e4a5969 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:53.702430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 193/376] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jul 28 05:12:53 2022] GET /identity/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:53.708449 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06399020-e678-47e1-807f-1b233e4a5969 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:53.725355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:53.805868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff43dd6-e396-472f-a8a1-20f1ce6fa7e1 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:53.825041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06399020-e678-47e1-807f-1b233e4a5969 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:53.850731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67ff22-1d56-40b6-a77c-4e89b3a4d6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:53.851402 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67ff22-1d56-40b6-a77c-4e89b3a4d6ee None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:53.853544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67ff22-1d56-40b6-a77c-4e89b3a4d6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:53.853544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67ff22-1d56-40b6-a77c-4e89b3a4d6ee None admin] PATH_INFO: `/v3/projects/44e83cd79a56499f92e288b2c69de397` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:53.857107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67ff22-1d56-40b6-a77c-4e89b3a4d6ee None admin] RBAC: Authorizing `identity:get_project(project_id=44e83cd79a56499f92e288b2c69de397)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:53.857107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67ff22-1d56-40b6-a77c-4e89b3a4d6ee None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:53.858405 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 184/377] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:53 2022] GET /identity/v3/projects/44e83cd79a56499f92e288b2c69de397 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:53.864003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67ff22-1d56-40b6-a77c-4e89b3a4d6ee None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:53.873335 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322b535-1d45-4d63-ab2c-b718d0b42b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:53.874390 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322b535-1d45-4d63-ab2c-b718d0b42b04 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:53.874890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322b535-1d45-4d63-ab2c-b718d0b42b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:53.875438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:53.875916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322b535-1d45-4d63-ab2c-b718d0b42b04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:53.876778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322b535-1d45-4d63-ab2c-b718d0b42b04 None admin] RBAC: Adding query filter params (group.id=b2b1bc1f5a134ced8d3a1e7860ca6585, role.id=07a2273f06f649d4a7f2117b3cf6b34d, scope.project.id=4c563dccc823490ba5fc84b8bd242ab6) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:53.877105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322b535-1d45-4d63-ab2c-b718d0b42b04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:53.879372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322b535-1d45-4d63-ab2c-b718d0b42b04 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:53.888766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 194/378] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jul 28 05:12:53 2022] GET /identity/v3/role_assignments?group.id=b2b1bc1f5a134ced8d3a1e7860ca6585&scope.project.id=4c563dccc823490ba5fc84b8bd242ab6&role.id=07a2273f06f649d4a7f2117b3cf6b34d => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:53.991394 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67ff22-1d56-40b6-a77c-4e89b3a4d6ee None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:54.029798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca4171-9305-4c83-ab2a-d3eef83ff60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:54.030483 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca4171-9305-4c83-ab2a-d3eef83ff60b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:54.030767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca4171-9305-4c83-ab2a-d3eef83ff60b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:54.031051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca4171-9305-4c83-ab2a-d3eef83ff60b None admin] PATH_INFO: `/v3/groups/32cbe047193949ceaee99a3b75b435cc` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:54.036824 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca4171-9305-4c83-ab2a-d3eef83ff60b None admin] RBAC: Authorizing `identity:get_group(group_id=32cbe047193949ceaee99a3b75b435cc)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:54.038893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca4171-9305-4c83-ab2a-d3eef83ff60b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:54.041025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 185/379] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jul 28 05:12:53 2022] GET /identity/v3/groups/32cbe047193949ceaee99a3b75b435cc => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:54.048014 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322b535-1d45-4d63-ab2c-b718d0b42b04 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:54.101234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da9899-5472-4920-b880-b46886aae722 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:54.101561 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da9899-5472-4920-b880-b46886aae722 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:54.101753 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da9899-5472-4920-b880-b46886aae722 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:54.103254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 186/380] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:54.109634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1d72e-9b34-49e6-8a9a-cf99959733d1 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:54.109924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1d72e-9b34-49e6-8a9a-cf99959733d1 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:54.110207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1d72e-9b34-49e6-8a9a-cf99959733d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:54.133272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-b4a1d72e-9b34-49e6-8a9a-cf99959733d1 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:54.134928 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-b4a1d72e-9b34-49e6-8a9a-cf99959733d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:54.142745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:54.173835 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322b535-1d45-4d63-ab2c-b718d0b42b04 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:54.215330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9f792-7cc5-43f7-819a-8f0c87277e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:54.216025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9f792-7cc5-43f7-819a-8f0c87277e1d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:54.216411 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9f792-7cc5-43f7-819a-8f0c87277e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:54.216697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9f792-7cc5-43f7-819a-8f0c87277e1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:54.217561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9f792-7cc5-43f7-819a-8f0c87277e1d None admin] RBAC: Adding query filter params (group.id=32cbe047193949ceaee99a3b75b435cc, role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=44e83cd79a56499f92e288b2c69de397) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:54.217838 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9f792-7cc5-43f7-819a-8f0c87277e1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:54.219384 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9f792-7cc5-43f7-819a-8f0c87277e1d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:54.220331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:54.229498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 187/381] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:54.232074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 195/382] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jul 28 05:12:54 2022] GET /identity/v3/role_assignments?group.id=32cbe047193949ceaee99a3b75b435cc&scope.project.id=44e83cd79a56499f92e288b2c69de397&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:54.250730 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1d72e-9b34-49e6-8a9a-cf99959733d1 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:54.379497 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1d72e-9b34-49e6-8a9a-cf99959733d1 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:54.418328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8919c3f-9e4f-478f-bf95-f2a7eb5a8f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:54.418992 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8919c3f-9e4f-478f-bf95-f2a7eb5a8f83 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:54.419277 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8919c3f-9e4f-478f-bf95-f2a7eb5a8f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:54.419584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8919c3f-9e4f-478f-bf95-f2a7eb5a8f83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:54.430741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8919c3f-9e4f-478f-bf95-f2a7eb5a8f83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:54.435947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-d8919c3f-9e4f-478f-bf95-f2a7eb5a8f83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:54.435947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:54.435947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:54.435947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:54.435947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:54.435947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:54.435947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:54.435947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:54.435947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:54.435947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:54.435947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:54.435947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:54.435947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:54.435947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:54.435947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:54.435947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:54.436796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:54.436796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:54.436796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:54.436796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:54.436796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:54.436796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:54.436796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:54.436796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:54.436796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:54.436796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:54.436796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:54.436796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:54.436796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:54.436796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:54.436796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:54.436796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:54.437591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:54.437591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:54.437591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:54.437591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:54.437591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:54.437591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:54.437591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:54.437591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:54.437591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:54.437591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:54.437591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:54.437591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:54.437591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 188/383] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:12:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:54.445947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9f792-7cc5-43f7-819a-8f0c87277e1d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:54.610444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9f792-7cc5-43f7-819a-8f0c87277e1d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:54.647100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff00a7-77b7-4d11-9709-3ec83301a71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:54.647691 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff00a7-77b7-4d11-9709-3ec83301a71a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:54.647975 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff00a7-77b7-4d11-9709-3ec83301a71a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:54.648253 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff00a7-77b7-4d11-9709-3ec83301a71a None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:54.648980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff00a7-77b7-4d11-9709-3ec83301a71a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:54.649287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff00a7-77b7-4d11-9709-3ec83301a71a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:54.650696 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff00a7-77b7-4d11-9709-3ec83301a71a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:54.659445 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 196/384] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:12:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:54.664920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8919c3f-9e4f-478f-bf95-f2a7eb5a8f83 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:54.745607 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:54.790803 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8919c3f-9e4f-478f-bf95-f2a7eb5a8f83 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:54.828501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631456a7-16c0-4f15-a130-039da81decf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:54.829162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631456a7-16c0-4f15-a130-039da81decf4 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:54.829447 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631456a7-16c0-4f15-a130-039da81decf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:54.829754 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631456a7-16c0-4f15-a130-039da81decf4 None admin] PATH_INFO: `/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:54.830932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631456a7-16c0-4f15-a130-039da81decf4 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b1bc1f5a134ced8d3a1e7860ca6585)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:54.832367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631456a7-16c0-4f15-a130-039da81decf4 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:54.834304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 189/385] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jul 28 05:12:54 2022] GET /identity/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:54.840135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff00a7-77b7-4d11-9709-3ec83301a71a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:54.852310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:54.855666 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684549c-7d17-4b44-80dc-d8883aae9107 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:54.855958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684549c-7d17-4b44-80dc-d8883aae9107 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:54.856239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684549c-7d17-4b44-80dc-d8883aae9107 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:54.857683 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 190/386] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:54.863149 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e98b6-7b78-4e4f-a15a-c1b1ddc33534 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:54.863431 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e98b6-7b78-4e4f-a15a-c1b1ddc33534 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:54.863769 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e98b6-7b78-4e4f-a15a-c1b1ddc33534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:54.884401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-b80e98b6-7b78-4e4f-a15a-c1b1ddc33534 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:54.886004 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-b80e98b6-7b78-4e4f-a15a-c1b1ddc33534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:55.002586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 191/387] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:55.039369 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff00a7-77b7-4d11-9709-3ec83301a71a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:55.060296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e98b6-7b78-4e4f-a15a-c1b1ddc33534 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:55.106976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22b4b5-d596-49b0-9c89-0195e00a06ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:55.107926 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22b4b5-d596-49b0-9c89-0195e00a06ae None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:55.108215 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22b4b5-d596-49b0-9c89-0195e00a06ae None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:55.108497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22b4b5-d596-49b0-9c89-0195e00a06ae None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:55.114755 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22b4b5-d596-49b0-9c89-0195e00a06ae None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:55.116849 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22b4b5-d596-49b0-9c89-0195e00a06ae None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:55.119094 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 197/388] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:54 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:55.135072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22b4b5-d596-49b0-9c89-0195e00a06ae None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:55.151725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:55.220018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e98b6-7b78-4e4f-a15a-c1b1ddc33534 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:55.273458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:55.293837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21904432-8aea-4afc-8748-858e2fd053da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:55.294498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21904432-8aea-4afc-8748-858e2fd053da None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:55.294779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21904432-8aea-4afc-8748-858e2fd053da None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:55.295056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21904432-8aea-4afc-8748-858e2fd053da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:55.315764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21904432-8aea-4afc-8748-858e2fd053da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:55.323093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-21904432-8aea-4afc-8748-858e2fd053da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:55.323093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:55.323093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:55.323093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:55.323093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:55.323093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:55.323093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:55.323093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:55.323093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:55.323093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:55.323093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:55.323093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:55.323093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:55.323093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:55.323093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:55.323093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:55.323956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:55.323956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:55.323956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:55.323956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:55.323956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:55.323956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:55.323956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:55.323956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:55.323956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:55.323956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:55.323956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:55.323956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:55.323956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:55.323956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:55.323956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:55.323956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:55.324790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:55.324790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:55.324790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:55.324790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:55.324790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:55.324790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:55.324790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:55.324790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:55.324790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:55.324790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:55.324790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:55.324790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:55.327511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 192/389] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:12:55.333447 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21904432-8aea-4afc-8748-858e2fd053da None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:55.352596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22b4b5-d596-49b0-9c89-0195e00a06ae None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:55.424970 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd3deb-99c1-4989-83d2-985485d0ec2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:55.426155 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd3deb-99c1-4989-83d2-985485d0ec2d None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:55.426815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd3deb-99c1-4989-83d2-985485d0ec2d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:55.428451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd3deb-99c1-4989-83d2-985485d0ec2d None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72/groups/b2b1bc1f5a134ced8d3a1e7860ca6585/roles/07a2273f06f649d4a7f2117b3cf6b34d` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:55.435043 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd3deb-99c1-4989-83d2-985485d0ec2d None admin] RBAC: Authorizing `identity:create_grant(project_id=a6a583ed824940e18ba5dd2fab4e5c72, group_id=b2b1bc1f5a134ced8d3a1e7860ca6585, role_id=07a2273f06f649d4a7f2117b3cf6b34d)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:55.436785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd3deb-99c1-4989-83d2-985485d0ec2d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:55.491043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21904432-8aea-4afc-8748-858e2fd053da None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:55.511266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:55.532027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 198/390] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Jul 28 05:12:55 2022] PUT /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72/groups/b2b1bc1f5a134ced8d3a1e7860ca6585/roles/07a2273f06f649d4a7f2117b3cf6b34d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:12:55.542388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63121e67-9883-43f3-889a-6141c0749c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:55.543540 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63121e67-9883-43f3-889a-6141c0749c7d None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:55.544054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63121e67-9883-43f3-889a-6141c0749c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:55.544590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63121e67-9883-43f3-889a-6141c0749c7d None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:55.545961 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63121e67-9883-43f3-889a-6141c0749c7d None admin] RBAC: Adding query filter params (name=member) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:55.546697 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63121e67-9883-43f3-889a-6141c0749c7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:55.549150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63121e67-9883-43f3-889a-6141c0749c7d None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:55.561306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 193/391] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:55.569532 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd3deb-99c1-4989-83d2-985485d0ec2d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:55.750409 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd3deb-99c1-4989-83d2-985485d0ec2d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:55.790765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:55.797149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e543d-e253-4238-8d20-9fc7c040037d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:55.797838 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e543d-e253-4238-8d20-9fc7c040037d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:55.798121 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e543d-e253-4238-8d20-9fc7c040037d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:55.804032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e543d-e253-4238-8d20-9fc7c040037d None admin] PATH_INFO: `/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:55.804032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e543d-e253-4238-8d20-9fc7c040037d None admin] RBAC: Authorizing `identity:get_group(group_id=b2b1bc1f5a134ced8d3a1e7860ca6585)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:55.804032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e543d-e253-4238-8d20-9fc7c040037d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:55.805947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 199/392] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jul 28 05:12:55 2022] GET /identity/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:55.811632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63121e67-9883-43f3-889a-6141c0749c7d None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:55.969839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63121e67-9883-43f3-889a-6141c0749c7d None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:56.010861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24092b6-437e-4f36-b8ec-c0b4d1103acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:56.011781 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24092b6-437e-4f36-b8ec-c0b4d1103acd None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:56.012296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24092b6-437e-4f36-b8ec-c0b4d1103acd None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:56.012729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24092b6-437e-4f36-b8ec-c0b4d1103acd None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:56.014170 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24092b6-437e-4f36-b8ec-c0b4d1103acd None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:56.015764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24092b6-437e-4f36-b8ec-c0b4d1103acd None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:56.017932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 194/393] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:55 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:56.026853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e543d-e253-4238-8d20-9fc7c040037d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:56.126558 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30453d2f-49e8-484c-bb89-03c7c72c8c05 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:56.127183 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30453d2f-49e8-484c-bb89-03c7c72c8c05 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:56.127678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30453d2f-49e8-484c-bb89-03c7c72c8c05 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:56.129240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 195/394] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:56.134768 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b679fd-1fcb-4bc9-a011-892e36c6abff None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:56.135352 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b679fd-1fcb-4bc9-a011-892e36c6abff None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:56.135841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b679fd-1fcb-4bc9-a011-892e36c6abff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:56.171481 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-d1b679fd-1fcb-4bc9-a011-892e36c6abff None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:56.173080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d1b679fd-1fcb-4bc9-a011-892e36c6abff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:56.181646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e543d-e253-4238-8d20-9fc7c040037d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:56.220532 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c0191-d315-4d9a-b8fb-fea368555320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:56.221375 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c0191-d315-4d9a-b8fb-fea368555320 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:56.221749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c0191-d315-4d9a-b8fb-fea368555320 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:56.222826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c0191-d315-4d9a-b8fb-fea368555320 None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72/groups/b2b1bc1f5a134ced8d3a1e7860ca6585/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:56.224222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c0191-d315-4d9a-b8fb-fea368555320 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6a583ed824940e18ba5dd2fab4e5c72, group_id=b2b1bc1f5a134ced8d3a1e7860ca6585, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:56.226543 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c0191-d315-4d9a-b8fb-fea368555320 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:56.251561 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:56.278807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 196/395] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:56.304007 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b679fd-1fcb-4bc9-a011-892e36c6abff None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:56.330136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 200/396] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Jul 28 05:12:56 2022] PUT /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72/groups/b2b1bc1f5a134ced8d3a1e7860ca6585/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:12:56.446180 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b679fd-1fcb-4bc9-a011-892e36c6abff None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:56.493711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e01b6e-e18c-4cb9-abda-b8c12844e6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:56.494391 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e01b6e-e18c-4cb9-abda-b8c12844e6aa None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:56.494673 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e01b6e-e18c-4cb9-abda-b8c12844e6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:56.494944 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e01b6e-e18c-4cb9-abda-b8c12844e6aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:56.512538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e01b6e-e18c-4cb9-abda-b8c12844e6aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:56.517822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-84e01b6e-e18c-4cb9-abda-b8c12844e6aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:56.517822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:56.517822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:56.517822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:56.517822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:56.517822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:56.517822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:56.517822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:56.517822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:56.517822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:56.517822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:56.517822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:56.517822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:56.517822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:56.517822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:56.517822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:56.518841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:56.518841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:56.518841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:56.518841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:56.518841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:56.518841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:56.518841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:56.518841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:56.518841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:56.518841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:56.518841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:56.518841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:56.518841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:56.518841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:56.518841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:56.518841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:56.519658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:56.519658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:56.519658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:56.519658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:56.519658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:56.519658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:56.519658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:56.519658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:56.519658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:56.519658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:56.519658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:56.519658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:56.519658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 197/397] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:12:56.525321 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c0191-d315-4d9a-b8fb-fea368555320 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:56.604709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:56.629078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065d9ad-a30e-4688-b6c6-e5c7a31b3ee4 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:56.629582 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065d9ad-a30e-4688-b6c6-e5c7a31b3ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:56.629963 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065d9ad-a30e-4688-b6c6-e5c7a31b3ee4 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:56.632259 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 198/398] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:56.637297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74dd3d-0a9f-4b80-8741-bd1460f5db94 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:56.637712 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74dd3d-0a9f-4b80-8741-bd1460f5db94 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:56.638110 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74dd3d-0a9f-4b80-8741-bd1460f5db94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:56.654865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c0191-d315-4d9a-b8fb-fea368555320 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:56.657777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-9d74dd3d-0a9f-4b80-8741-bd1460f5db94 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:56.658984 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9d74dd3d-0a9f-4b80-8741-bd1460f5db94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:56.694032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755ba55-70aa-4906-b235-4cafeb89b905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:56.695270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:56.695379 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755ba55-70aa-4906-b235-4cafeb89b905 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:56.695758 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755ba55-70aa-4906-b235-4cafeb89b905 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:56.696040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755ba55-70aa-4906-b235-4cafeb89b905 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:56.696828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755ba55-70aa-4906-b235-4cafeb89b905 None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:56.697086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755ba55-70aa-4906-b235-4cafeb89b905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:56.698512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755ba55-70aa-4906-b235-4cafeb89b905 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:56.710279 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 201/399] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:56.715807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755ba55-70aa-4906-b235-4cafeb89b905 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:56.744269 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 199/400] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:56.782173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74dd3d-0a9f-4b80-8741-bd1460f5db94 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:56.829449 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755ba55-70aa-4906-b235-4cafeb89b905 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:56.865846 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:56.875048 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02697c24-594e-465e-9ed3-7ff52cbca5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:56.876016 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02697c24-594e-465e-9ed3-7ff52cbca5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:56.876357 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02697c24-594e-465e-9ed3-7ff52cbca5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:56.876909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02697c24-594e-465e-9ed3-7ff52cbca5e5 None admin] PATH_INFO: `/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:56.878869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02697c24-594e-465e-9ed3-7ff52cbca5e5 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b1bc1f5a134ced8d3a1e7860ca6585)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:56.881050 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02697c24-594e-465e-9ed3-7ff52cbca5e5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:56.883542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 202/401] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jul 28 05:12:56 2022] GET /identity/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:56.887521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ec27c-3eb8-4c86-979e-1515fc1798f0 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:56.887521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ec27c-3eb8-4c86-979e-1515fc1798f0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:56.887521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ec27c-3eb8-4c86-979e-1515fc1798f0 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:56.887762 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 203/402] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:56.888555 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ec27c-3eb8-4c86-979e-1515fc1798f0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:56.947314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74dd3d-0a9f-4b80-8741-bd1460f5db94 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:56.983252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69189103-a319-4347-8048-6f1bb909ee4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:56.983933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69189103-a319-4347-8048-6f1bb909ee4b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:56.984217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69189103-a319-4347-8048-6f1bb909ee4b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:56.984495 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69189103-a319-4347-8048-6f1bb909ee4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:56.998579 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69189103-a319-4347-8048-6f1bb909ee4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:57.005820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-69189103-a319-4347-8048-6f1bb909ee4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:57.005820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:57.005820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:57.005820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:57.005820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:57.005820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:57.005820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:57.005820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:57.005820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:57.005820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:57.005820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:57.005820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:57.005820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:57.005820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:57.005820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:57.005820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:57.007330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:57.007330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:57.007330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:57.007330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:57.007330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:57.007330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:57.007330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:57.007330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:57.007330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:57.007330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:57.007330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:57.007330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:57.007330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:57.007330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:57.007330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:57.007330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:57.008111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:57.008111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:57.008111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:57.008111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:57.008111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:57.008111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:57.008111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:57.008111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:57.008111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:57.008111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:57.008111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:57.008111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:57.009982 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 200/403] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:12:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:57.011371 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21096767-bf16-4a88-a80b-10a6f5d0ee58 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:57.011371 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21096767-bf16-4a88-a80b-10a6f5d0ee58 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:57.011371 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21096767-bf16-4a88-a80b-10a6f5d0ee58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:57.020161 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ec27c-3eb8-4c86-979e-1515fc1798f0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:57.033313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-21096767-bf16-4a88-a80b-10a6f5d0ee58 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:57.034817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-21096767-bf16-4a88-a80b-10a6f5d0ee58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:57.058143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b60b7f-11c4-4c0a-9f0a-3669fd63b7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:57.059180 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b60b7f-11c4-4c0a-9f0a-3669fd63b7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:57.059675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b60b7f-11c4-4c0a-9f0a-3669fd63b7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:57.060161 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b60b7f-11c4-4c0a-9f0a-3669fd63b7e6 None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:57.061572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b60b7f-11c4-4c0a-9f0a-3669fd63b7e6 None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:57.063331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b60b7f-11c4-4c0a-9f0a-3669fd63b7e6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:57.064994 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:57.065783 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 204/404] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:56 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:57.066739 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b60b7f-11c4-4c0a-9f0a-3669fd63b7e6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:57.128274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 201/405] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:57.128908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21096767-bf16-4a88-a80b-10a6f5d0ee58 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:57.135491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:57.183763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b60b7f-11c4-4c0a-9f0a-3669fd63b7e6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:57.221073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35158a51-2bd1-4dc9-b2d4-ea12bc1be14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:57.222083 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35158a51-2bd1-4dc9-b2d4-ea12bc1be14e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:57.222568 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35158a51-2bd1-4dc9-b2d4-ea12bc1be14e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:57.223066 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35158a51-2bd1-4dc9-b2d4-ea12bc1be14e None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:57.223986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35158a51-2bd1-4dc9-b2d4-ea12bc1be14e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:57.224492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35158a51-2bd1-4dc9-b2d4-ea12bc1be14e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:57.226857 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35158a51-2bd1-4dc9-b2d4-ea12bc1be14e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:57.235535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 205/406] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:12:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:57.236629 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35158a51-2bd1-4dc9-b2d4-ea12bc1be14e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:57.244338 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21096767-bf16-4a88-a80b-10a6f5d0ee58 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:57.287267 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11976893-5992-45bd-8e60-b1d8af98d0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:57.288508 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11976893-5992-45bd-8e60-b1d8af98d0ca None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:57.288787 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11976893-5992-45bd-8e60-b1d8af98d0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:57.289061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11976893-5992-45bd-8e60-b1d8af98d0ca None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6/groups/b2b1bc1f5a134ced8d3a1e7860ca6585/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:57.292786 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11976893-5992-45bd-8e60-b1d8af98d0ca None admin] RBAC: Authorizing `identity:create_grant(project_id=4c563dccc823490ba5fc84b8bd242ab6, group_id=b2b1bc1f5a134ced8d3a1e7860ca6585, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:57.294811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11976893-5992-45bd-8e60-b1d8af98d0ca None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:57.359978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35158a51-2bd1-4dc9-b2d4-ea12bc1be14e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:57.378641 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:57.395571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c985c1e-5206-4a59-a852-7fce72c472ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:57.397847 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c985c1e-5206-4a59-a852-7fce72c472ab None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:57.398405 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c985c1e-5206-4a59-a852-7fce72c472ab None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:57.398767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c985c1e-5206-4a59-a852-7fce72c472ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:57.409638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 202/407] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Jul 28 05:12:57 2022] PUT /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6/groups/b2b1bc1f5a134ced8d3a1e7860ca6585/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:12:57.411014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11976893-5992-45bd-8e60-b1d8af98d0ca None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:57.417519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c985c1e-5206-4a59-a852-7fce72c472ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:57.423535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-9c985c1e-5206-4a59-a852-7fce72c472ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:57.423535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:57.423535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:57.423535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:57.423535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:57.423535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:57.423535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:57.423535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:57.423535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:57.423535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:57.423535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:57.423535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:57.423535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:57.423535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:57.423535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:57.423535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:57.424451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:57.424451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:57.424451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:57.424451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:57.424451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:57.424451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:57.424451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:57.424451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:57.424451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:57.424451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:57.424451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:57.424451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:57.424451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:57.424451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:57.424451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:57.424451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:57.437917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:57.437917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:57.437917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:57.437917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:57.437917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:57.437917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:57.437917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:57.437917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:57.437917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:57.437917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:57.437917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:12:57.437917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:57.437917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 206/408] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:12:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:57.437917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c985c1e-5206-4a59-a852-7fce72c472ab None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:57.466404 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:57.542813 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c985c1e-5206-4a59-a852-7fce72c472ab None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:57.594332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4fb6d-d62f-461d-ad89-769313ab7a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:57.595092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4fb6d-d62f-461d-ad89-769313ab7a2d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:57.595374 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4fb6d-d62f-461d-ad89-769313ab7a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:57.595650 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4fb6d-d62f-461d-ad89-769313ab7a2d None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:57.596383 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4fb6d-d62f-461d-ad89-769313ab7a2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:57.596691 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4fb6d-d62f-461d-ad89-769313ab7a2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:57.598114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4fb6d-d62f-461d-ad89-769313ab7a2d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:57.623199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 207/409] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:57.624188 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4fb6d-d62f-461d-ad89-769313ab7a2d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:57.655679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11976893-5992-45bd-8e60-b1d8af98d0ca None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:57.706276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:57.715637 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abb63f-cbac-44bc-99b8-34a9ac744551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:57.719873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abb63f-cbac-44bc-99b8-34a9ac744551 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:57.719873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abb63f-cbac-44bc-99b8-34a9ac744551 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:57.719873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abb63f-cbac-44bc-99b8-34a9ac744551 None admin] PATH_INFO: `/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:57.719873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abb63f-cbac-44bc-99b8-34a9ac744551 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b1bc1f5a134ced8d3a1e7860ca6585)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:57.720742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abb63f-cbac-44bc-99b8-34a9ac744551 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:57.723234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 203/410] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jul 28 05:12:57 2022] GET /identity/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585 => generated 226 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:57.730328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abb63f-cbac-44bc-99b8-34a9ac744551 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:57.816446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4fb6d-d62f-461d-ad89-769313ab7a2d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:57.835695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:57.848348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abb63f-cbac-44bc-99b8-34a9ac744551 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:57.889588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58ba5e-0371-48ff-93e9-39dd171f6c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:57.890621 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58ba5e-0371-48ff-93e9-39dd171f6c8c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:57.891104 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58ba5e-0371-48ff-93e9-39dd171f6c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:57.891573 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58ba5e-0371-48ff-93e9-39dd171f6c8c None admin] PATH_INFO: `/v3/groups/32cbe047193949ceaee99a3b75b435cc` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:57.893002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58ba5e-0371-48ff-93e9-39dd171f6c8c None admin] RBAC: Authorizing `identity:get_group(group_id=32cbe047193949ceaee99a3b75b435cc)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:57.894689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58ba5e-0371-48ff-93e9-39dd171f6c8c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:57.896808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 208/411] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jul 28 05:12:57 2022] GET /identity/v3/groups/32cbe047193949ceaee99a3b75b435cc => generated 229 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:57.902588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58ba5e-0371-48ff-93e9-39dd171f6c8c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:57.907325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62dd79-9389-4968-b0cc-a5eee5c29ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:57.908257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62dd79-9389-4968-b0cc-a5eee5c29ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:57.908756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62dd79-9389-4968-b0cc-a5eee5c29ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:57.909225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62dd79-9389-4968-b0cc-a5eee5c29ce8 None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:57.911571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62dd79-9389-4968-b0cc-a5eee5c29ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:57.918407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62dd79-9389-4968-b0cc-a5eee5c29ce8 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:57.920685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 204/412] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:57 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:57.930835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62dd79-9389-4968-b0cc-a5eee5c29ce8 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:58.111606 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58ba5e-0371-48ff-93e9-39dd171f6c8c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:58.126317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62dd79-9389-4968-b0cc-a5eee5c29ce8 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:58.130402 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:58.186162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d84d0-b3b5-407b-83c4-31bb226d9179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:58.187201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d84d0-b3b5-407b-83c4-31bb226d9179 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:58.187693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d84d0-b3b5-407b-83c4-31bb226d9179 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:58.188166 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d84d0-b3b5-407b-83c4-31bb226d9179 None admin] PATH_INFO: `/v3/projects/44e83cd79a56499f92e288b2c69de397` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:58.190531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d84d0-b3b5-407b-83c4-31bb226d9179 None admin] RBAC: Authorizing `identity:get_project(project_id=44e83cd79a56499f92e288b2c69de397)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:58.194072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d84d0-b3b5-407b-83c4-31bb226d9179 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:58.197370 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 209/413] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:57 2022] GET /identity/v3/projects/44e83cd79a56499f92e288b2c69de397 => generated 344 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:58.203812 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d84d0-b3b5-407b-83c4-31bb226d9179 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:58.205574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203081e1-5413-4ead-8882-f3db41b516ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:58.206894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203081e1-5413-4ead-8882-f3db41b516ca None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:58.209125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203081e1-5413-4ead-8882-f3db41b516ca None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:58.209664 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203081e1-5413-4ead-8882-f3db41b516ca None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6/groups/b2b1bc1f5a134ced8d3a1e7860ca6585/roles/07a2273f06f649d4a7f2117b3cf6b34d` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:58.213258 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203081e1-5413-4ead-8882-f3db41b516ca None admin] RBAC: Authorizing `identity:create_grant(project_id=4c563dccc823490ba5fc84b8bd242ab6, group_id=b2b1bc1f5a134ced8d3a1e7860ca6585, role_id=07a2273f06f649d4a7f2117b3cf6b34d)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:58.215151 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203081e1-5413-4ead-8882-f3db41b516ca None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:58.320871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 205/414] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Jul 28 05:12:57 2022] PUT /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6/groups/b2b1bc1f5a134ced8d3a1e7860ca6585/roles/07a2273f06f649d4a7f2117b3cf6b34d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:12:58.324815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b426a16-5c0b-42d8-be0b-b88ee5c5748f None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:58.325114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b426a16-5c0b-42d8-be0b-b88ee5c5748f None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:58.326422 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b426a16-5c0b-42d8-be0b-b88ee5c5748f None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:58.332691 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 206/415] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:58.337091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c01583-89b1-4ec6-871f-48a67c21e633 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:58.337398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c01583-89b1-4ec6-871f-48a67c21e633 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:58.338034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c01583-89b1-4ec6-871f-48a67c21e633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:58.362440 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-f9c01583-89b1-4ec6-871f-48a67c21e633 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:58.363601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f9c01583-89b1-4ec6-871f-48a67c21e633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:58.387113 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:58.478101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d84d0-b3b5-407b-83c4-31bb226d9179 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:58.494785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 207/416] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:12:58.532344 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c01583-89b1-4ec6-871f-48a67c21e633 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:58.552648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64129985-afda-4072-a98c-eb17146f635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:58.553354 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64129985-afda-4072-a98c-eb17146f635f None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:58.553702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64129985-afda-4072-a98c-eb17146f635f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:58.554178 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64129985-afda-4072-a98c-eb17146f635f None admin] PATH_INFO: `/v3/projects/44e83cd79a56499f92e288b2c69de397/groups/32cbe047193949ceaee99a3b75b435cc/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:58.560087 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64129985-afda-4072-a98c-eb17146f635f None admin] RBAC: Authorizing `identity:create_grant(project_id=44e83cd79a56499f92e288b2c69de397, group_id=32cbe047193949ceaee99a3b75b435cc, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:58.565193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64129985-afda-4072-a98c-eb17146f635f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:58.653330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 210/417] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Jul 28 05:12:58 2022] PUT /identity/v3/projects/44e83cd79a56499f92e288b2c69de397/groups/32cbe047193949ceaee99a3b75b435cc/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:12:58.737726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c01583-89b1-4ec6-871f-48a67c21e633 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:58.791195 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cabac-dc86-4bc8-ad0e-d5510f1f6db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:58.791885 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cabac-dc86-4bc8-ad0e-d5510f1f6db0 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:58.792168 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cabac-dc86-4bc8-ad0e-d5510f1f6db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:58.792451 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cabac-dc86-4bc8-ad0e-d5510f1f6db0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:58.812237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cabac-dc86-4bc8-ad0e-d5510f1f6db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:58.818273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-287cabac-dc86-4bc8-ad0e-d5510f1f6db0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:58.818273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:58.818273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:58.818273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:58.818273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:58.818273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:58.818273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:58.818273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:58.818273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:58.818273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:58.818273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:58.818273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:58.818273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:58.818273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:58.818273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:58.818273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:58.819735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:58.819735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:58.819735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:58.819735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:58.819735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:58.819735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:58.819735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:58.819735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:58.819735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:58.819735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:58.819735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:58.819735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:58.819735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:58.819735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:58.819735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:58.819735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:58.820652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:58.820652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:58.820652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:58.820652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:58.820652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:58.820652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:58.820652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:58.820652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:58.820652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:58.820652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:58.820652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:12:58.820652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:12:58.820652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 208/418] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:12:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:58.827822 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64129985-afda-4072-a98c-eb17146f635f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:58.873339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:58.911106 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232f29e-e800-47e7-800f-c69080e6f1b3 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:58.911386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232f29e-e800-47e7-800f-c69080e6f1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:58.911581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232f29e-e800-47e7-800f-c69080e6f1b3 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:58.913151 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 209/419] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:12:58.918744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa485e6-dc78-475b-8517-44723fcff124 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:58.919007 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa485e6-dc78-475b-8517-44723fcff124 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:58.919287 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa485e6-dc78-475b-8517-44723fcff124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:58.929596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:58.952267 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-0aa485e6-dc78-475b-8517-44723fcff124 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:12:58.953521 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-0aa485e6-dc78-475b-8517-44723fcff124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:12:58.991817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64129985-afda-4072-a98c-eb17146f635f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:59.054431 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 210/420] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:12:59.071624 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f61c2-f5bf-4245-9874-fe3597ef1562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:59.072476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f61c2-f5bf-4245-9874-fe3597ef1562 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:59.072958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f61c2-f5bf-4245-9874-fe3597ef1562 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:59.073421 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f61c2-f5bf-4245-9874-fe3597ef1562 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:59.074349 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f61c2-f5bf-4245-9874-fe3597ef1562 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:59.074836 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f61c2-f5bf-4245-9874-fe3597ef1562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:59.076473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f61c2-f5bf-4245-9874-fe3597ef1562 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:59.090165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 211/421] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:12:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:59.096088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa485e6-dc78-475b-8517-44723fcff124 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:59.102373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f61c2-f5bf-4245-9874-fe3597ef1562 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:59.282916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:59.287497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f61c2-f5bf-4245-9874-fe3597ef1562 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:59.289798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa485e6-dc78-475b-8517-44723fcff124 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:59.334653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b974d4-17c3-49d7-95d8-f16a4fd5bb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:59.335837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b974d4-17c3-49d7-95d8-f16a4fd5bb64 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:59.336121 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b974d4-17c3-49d7-95d8-f16a4fd5bb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:59.336397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b974d4-17c3-49d7-95d8-f16a4fd5bb64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:59.355937 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d257e1-a1f8-40af-a734-b30c5c52d48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:59.356580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d257e1-a1f8-40af-a734-b30c5c52d48e None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:59.356865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d257e1-a1f8-40af-a734-b30c5c52d48e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:59.357139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d257e1-a1f8-40af-a734-b30c5c52d48e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:59.359916 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:59.370656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b974d4-17c3-49d7-95d8-f16a4fd5bb64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:12:59.376330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-02b974d4-17c3-49d7-95d8-f16a4fd5bb64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:59.376330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:12:59.376330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:12:59.376330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:12:59.376330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:12:59.376330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:12:59.376330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:12:59.376330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:12:59.376330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:12:59.376330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:12:59.376330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:12:59.376330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:12:59.376330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:12:59.376330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:12:59.376330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:12:59.376330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:12:59.377186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:12:59.377186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:12:59.377186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:12:59.377186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:12:59.377186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:12:59.377186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:12:59.377186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:12:59.377186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:12:59.377186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:12:59.377186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:12:59.377186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:12:59.377186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:12:59.377186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:12:59.377186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:12:59.377186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:12:59.377186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:12:59.378585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:12:59.378585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:12:59.378585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:12:59.378585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:12:59.378585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:12:59.378585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:12:59.378585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:12:59.378585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:12:59.378585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:12:59.378585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:12:59.378585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:12:59.378585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:12:59.380061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 212/422] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:12:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:12:59.384685 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b974d4-17c3-49d7-95d8-f16a4fd5bb64 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:59.482324 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d257e1-a1f8-40af-a734-b30c5c52d48e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:59.483802 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d257e1-a1f8-40af-a734-b30c5c52d48e None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:59.574548 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b974d4-17c3-49d7-95d8-f16a4fd5bb64 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:59.646576 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bf6fb-2f2b-4699-b744-51112b05bc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:59.647229 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bf6fb-2f2b-4699-b744-51112b05bc0c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:59.647687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bf6fb-2f2b-4699-b744-51112b05bc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:59.648191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bf6fb-2f2b-4699-b744-51112b05bc0c None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:59.648965 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bf6fb-2f2b-4699-b744-51112b05bc0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:12:59.649276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bf6fb-2f2b-4699-b744-51112b05bc0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:59.652083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 211/423] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:12:59.653491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bf6fb-2f2b-4699-b744-51112b05bc0c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:59.657491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d257e1-a1f8-40af-a734-b30c5c52d48e None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:59.671043 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 213/424] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:12:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:12:59.677849 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bf6fb-2f2b-4699-b744-51112b05bc0c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:12:59.716704 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:59.721831 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:59.811529 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bf6fb-2f2b-4699-b744-51112b05bc0c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:59.847124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93762d66-a230-4cc2-832e-d0bdf3b0223b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:59.847724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93762d66-a230-4cc2-832e-d0bdf3b0223b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:59.848004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93762d66-a230-4cc2-832e-d0bdf3b0223b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:59.848280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93762d66-a230-4cc2-832e-d0bdf3b0223b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:59.868119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d257e1-a1f8-40af-a734-b30c5c52d48e None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:12:59.918376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93762d66-a230-4cc2-832e-d0bdf3b0223b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:59.919845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93762d66-a230-4cc2-832e-d0bdf3b0223b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:59.941641 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:59.962615 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f76711-17be-4c35-88e8-c4627f37b5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:12:59.963673 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f76711-17be-4c35-88e8-c4627f37b5af None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:59.964187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f76711-17be-4c35-88e8-c4627f37b5af None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:59.964687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f76711-17be-4c35-88e8-c4627f37b5af None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:59.968834 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f76711-17be-4c35-88e8-c4627f37b5af None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:12:59.970525 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f76711-17be-4c35-88e8-c4627f37b5af None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:12:59.972757 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 212/425] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:12:59 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:12:59.974271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b7c4f-d26f-432d-9797-8a5222f9a72d None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:12:59.976648 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b7c4f-d26f-432d-9797-8a5222f9a72d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:12:59.977187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b7c4f-d26f-432d-9797-8a5222f9a72d None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:12:59.979117 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 213/426] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:12:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:12:59.980096 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b7c4f-d26f-432d-9797-8a5222f9a72d None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:00.028271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 214/427] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:00.029862 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034d3a1-f0bc-47c8-9063-de72e612943e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:00.030151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034d3a1-f0bc-47c8-9063-de72e612943e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:00.030426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034d3a1-f0bc-47c8-9063-de72e612943e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:00.049970 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2034d3a1-f0bc-47c8-9063-de72e612943e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:00.051176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2034d3a1-f0bc-47c8-9063-de72e612943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:00.100007 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b7c4f-d26f-432d-9797-8a5222f9a72d None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:00.102137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:00.124947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 215/428] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:00.126168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034d3a1-f0bc-47c8-9063-de72e612943e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:00.139024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf2d60-bd44-4cc8-9501-e0951bfb4aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:00.139676 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf2d60-bd44-4cc8-9501-e0951bfb4aca None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:00.139956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf2d60-bd44-4cc8-9501-e0951bfb4aca None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:00.140233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf2d60-bd44-4cc8-9501-e0951bfb4aca None admin] PATH_INFO: `/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:00.141397 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf2d60-bd44-4cc8-9501-e0951bfb4aca None admin] RBAC: Authorizing `identity:get_group(group_id=b2b1bc1f5a134ced8d3a1e7860ca6585)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:00.142878 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf2d60-bd44-4cc8-9501-e0951bfb4aca None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:00.144797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 214/429] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jul 28 05:12:59 2022] GET /identity/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:00.151366 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf2d60-bd44-4cc8-9501-e0951bfb4aca None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:00.187942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:00.242484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034d3a1-f0bc-47c8-9063-de72e612943e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:00.270690 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf2d60-bd44-4cc8-9501-e0951bfb4aca None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:00.280791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec59e7-99c4-4423-828f-7420ca8986d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:00.281792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec59e7-99c4-4423-828f-7420ca8986d3 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:00.282242 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec59e7-99c4-4423-828f-7420ca8986d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:00.282701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec59e7-99c4-4423-828f-7420ca8986d3 None admin] PATH_INFO: `/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:00.284157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec59e7-99c4-4423-828f-7420ca8986d3 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a583ed824940e18ba5dd2fab4e5c72)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:00.286017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec59e7-99c4-4423-828f-7420ca8986d3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:00.292528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 216/430] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:13:00 2022] GET /identity/v3/projects/a6a583ed824940e18ba5dd2fab4e5c72 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:00.293653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec59e7-99c4-4423-828f-7420ca8986d3 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:00.311722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc434b-f0c2-4360-8eb5-fd2d1f207bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:00.312437 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc434b-f0c2-4360-8eb5-fd2d1f207bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:00.312810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc434b-f0c2-4360-8eb5-fd2d1f207bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:00.313158 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc434b-f0c2-4360-8eb5-fd2d1f207bf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:00.314562 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc434b-f0c2-4360-8eb5-fd2d1f207bf3 None admin] RBAC: Adding query filter params (group.id=b2b1bc1f5a134ced8d3a1e7860ca6585, role.id=07a2273f06f649d4a7f2117b3cf6b34d, scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:00.314945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc434b-f0c2-4360-8eb5-fd2d1f207bf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:00.316851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc434b-f0c2-4360-8eb5-fd2d1f207bf3 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:00.333497 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 215/431] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jul 28 05:13:00 2022] GET /identity/v3/role_assignments?group.id=b2b1bc1f5a134ced8d3a1e7860ca6585&scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72&role.id=07a2273f06f649d4a7f2117b3cf6b34d => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:00.333497 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc434b-f0c2-4360-8eb5-fd2d1f207bf3 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:00.436604 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec59e7-99c4-4423-828f-7420ca8986d3 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:00.458912 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:00.468191 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:00.489019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ed9a5-0652-4378-a77e-e8a3e6abe962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:00.489704 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ed9a5-0652-4378-a77e-e8a3e6abe962 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:00.489983 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ed9a5-0652-4378-a77e-e8a3e6abe962 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:00.490253 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ed9a5-0652-4378-a77e-e8a3e6abe962 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:00.517715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ed9a5-0652-4378-a77e-e8a3e6abe962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:00.524718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-7c7ed9a5-0652-4378-a77e-e8a3e6abe962 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:13:00.524718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:00.524718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:00.524718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:00.524718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:00.524718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:00.524718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:00.524718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:00.524718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:00.524718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:00.524718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:00.524718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:00.524718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:00.524718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:00.524718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:00.524718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:00.528538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:00.528538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:00.528538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:00.528538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:00.528538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:00.528538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:00.528538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:00.528538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:00.528538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:00.528538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:00.528538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:00.528538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:00.528538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:00.528538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:00.528538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:00.528538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:00.529344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:00.529344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:00.529344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:00.529344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:00.529344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:00.529344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:00.529344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:00.529344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:00.529344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:00.529344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:00.529344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:13:00.529344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:00.529344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 217/432] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:13:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:00.538952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ed9a5-0652-4378-a77e-e8a3e6abe962 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:00.569889 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc434b-f0c2-4360-8eb5-fd2d1f207bf3 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:00.609658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c6b8b-c3f0-45dd-b218-43b4c34f892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:00.610324 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c6b8b-c3f0-45dd-b218-43b4c34f892a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:00.610614 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c6b8b-c3f0-45dd-b218-43b4c34f892a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:00.610894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c6b8b-c3f0-45dd-b218-43b4c34f892a None admin] PATH_INFO: `/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:00.612069 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c6b8b-c3f0-45dd-b218-43b4c34f892a None admin] RBAC: Authorizing `identity:get_group(group_id=b2b1bc1f5a134ced8d3a1e7860ca6585)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:00.613558 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c6b8b-c3f0-45dd-b218-43b4c34f892a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:00.615475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 216/433] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jul 28 05:13:00 2022] GET /identity/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585 => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:00.622962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c6b8b-c3f0-45dd-b218-43b4c34f892a None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:00.665745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ed9a5-0652-4378-a77e-e8a3e6abe962 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:00.704073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5e558-8437-44a8-803d-69181723f710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:00.704624 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e558-8437-44a8-803d-69181723f710 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:00.704998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e558-8437-44a8-803d-69181723f710 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:00.705280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e558-8437-44a8-803d-69181723f710 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:00.706115 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5e558-8437-44a8-803d-69181723f710 None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:00.706423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5e558-8437-44a8-803d-69181723f710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:00.707789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5e558-8437-44a8-803d-69181723f710 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:00.717628 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 218/434] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:13:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:00.723424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5e558-8437-44a8-803d-69181723f710 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:00.754478 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c6b8b-c3f0-45dd-b218-43b4c34f892a None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:00.756699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:00.777203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:00.798417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd603fe-1f0a-49e3-874b-b2a01c67948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:00.798950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd603fe-1f0a-49e3-874b-b2a01c67948b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:00.799229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd603fe-1f0a-49e3-874b-b2a01c67948b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:00.801660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd603fe-1f0a-49e3-874b-b2a01c67948b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:00.801660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd603fe-1f0a-49e3-874b-b2a01c67948b None admin] RBAC: Adding query filter params (group.id=b2b1bc1f5a134ced8d3a1e7860ca6585, role.id=d481402a8f1b4e189c0ecc05bce560e6, scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:00.801660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd603fe-1f0a-49e3-874b-b2a01c67948b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:00.802015 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd603fe-1f0a-49e3-874b-b2a01c67948b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:00.813946 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 217/435] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jul 28 05:13:00 2022] GET /identity/v3/role_assignments?group.id=b2b1bc1f5a134ced8d3a1e7860ca6585&scope.project.id=a6a583ed824940e18ba5dd2fab4e5c72&role.id=d481402a8f1b4e189c0ecc05bce560e6 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:00.815634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4dfd0-c4eb-42d4-8374-e779727e557c None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:00.816025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4dfd0-c4eb-42d4-8374-e779727e557c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:00.816407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4dfd0-c4eb-42d4-8374-e779727e557c None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:00.818754 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 218/436] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:00.825339 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dde28-4854-4e31-8ee1-8a14745eeeb9 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:00.825752 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dde28-4854-4e31-8ee1-8a14745eeeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:00.826097 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dde28-4854-4e31-8ee1-8a14745eeeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:00.847179 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-4a0dde28-4854-4e31-8ee1-8a14745eeeb9 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:00.848526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4a0dde28-4854-4e31-8ee1-8a14745eeeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:00.854474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5e558-8437-44a8-803d-69181723f710 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:00.902354 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d60b7-a962-4596-b728-f87dd87a3ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:00.903341 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d60b7-a962-4596-b728-f87dd87a3ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:00.903807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d60b7-a962-4596-b728-f87dd87a3ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:00.904425 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d60b7-a962-4596-b728-f87dd87a3ab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:00.941964 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 219/437] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:13:00.958132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dde28-4854-4e31-8ee1-8a14745eeeb9 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:00.995746 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d60b7-a962-4596-b728-f87dd87a3ab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:00.997114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d60b7-a962-4596-b728-f87dd87a3ab6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:01.055834 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:01.085977 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:01.092884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dde28-4854-4e31-8ee1-8a14745eeeb9 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:01.132075 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 219/438] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:13:01.132556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327deb7-65ce-4a6c-b280-0289505c2a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:01.133672 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327deb7-65ce-4a6c-b280-0289505c2a88 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:01.133952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327deb7-65ce-4a6c-b280-0289505c2a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:01.134230 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327deb7-65ce-4a6c-b280-0289505c2a88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:01.134435 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f79d48-842f-4aef-a89c-06a8fc62b7cf None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:01.134726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f79d48-842f-4aef-a89c-06a8fc62b7cf None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:01.135005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f79d48-842f-4aef-a89c-06a8fc62b7cf None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:01.136729 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 220/439] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:01.139160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f79d48-842f-4aef-a89c-06a8fc62b7cf None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:01.147881 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327deb7-65ce-4a6c-b280-0289505c2a88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:01.153043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-c327deb7-65ce-4a6c-b280-0289505c2a88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:13:01.153043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:01.153043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:01.153043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:01.153043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:01.153043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:01.153043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:01.153043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:01.153043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:01.153043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:01.153043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:01.153043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:01.153043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:01.153043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:01.153043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:01.153043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:01.153968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:01.153968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:01.153968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:01.153968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:01.153968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:01.153968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:01.153968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:01.153968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:01.153968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:01.153968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:01.153968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:01.153968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:01.153968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:01.153968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:01.153968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:01.153968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:01.154747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:01.154747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:01.154747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:01.154747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:01.154747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:01.154747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:01.154747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:01.154747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:01.154747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:01.154747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:01.154747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:13:01.154747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:01.154747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 220/440] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:13:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:01.155888 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3befd-3ea4-4cb5-b119-ec232923620d None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:01.155888 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3befd-3ea4-4cb5-b119-ec232923620d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:01.156058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3befd-3ea4-4cb5-b119-ec232923620d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:01.176309 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-f4a3befd-3ea4-4cb5-b119-ec232923620d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:01.177727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f4a3befd-3ea4-4cb5-b119-ec232923620d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:01.258593 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f79d48-842f-4aef-a89c-06a8fc62b7cf None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:01.275378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 221/441] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:01.276485 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3befd-3ea4-4cb5-b119-ec232923620d None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:01.300019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104852ef-e573-4710-91eb-32ae021328dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:01.300791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104852ef-e573-4710-91eb-32ae021328dc None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:01.301179 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104852ef-e573-4710-91eb-32ae021328dc None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:01.301499 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104852ef-e573-4710-91eb-32ae021328dc None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:01.302673 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104852ef-e573-4710-91eb-32ae021328dc None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:01.304359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104852ef-e573-4710-91eb-32ae021328dc None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:01.306215 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 221/442] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:13:01 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:01.309558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104852ef-e573-4710-91eb-32ae021328dc None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:01.320950 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:01.376683 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:01.392004 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3befd-3ea4-4cb5-b119-ec232923620d None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:01.415807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104852ef-e573-4710-91eb-32ae021328dc None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:01.426329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c2c22-3a81-435e-980f-84b81fc30c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:01.426958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c2c22-3a81-435e-980f-84b81fc30c7a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:01.427240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c2c22-3a81-435e-980f-84b81fc30c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:01.427517 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c2c22-3a81-435e-980f-84b81fc30c7a None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:01.428233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c2c22-3a81-435e-980f-84b81fc30c7a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:01.429079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c2c22-3a81-435e-980f-84b81fc30c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:01.430636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c2c22-3a81-435e-980f-84b81fc30c7a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:01.438514 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 222/443] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:01.439847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c2c22-3a81-435e-980f-84b81fc30c7a None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:01.455499 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d286bec-929a-4aeb-810b-ecd5f13530d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:01.456144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d286bec-929a-4aeb-810b-ecd5f13530d8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:01.456424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d286bec-929a-4aeb-810b-ecd5f13530d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:01.456697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d286bec-929a-4aeb-810b-ecd5f13530d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:01.467077 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d286bec-929a-4aeb-810b-ecd5f13530d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:01.472029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-0d286bec-929a-4aeb-810b-ecd5f13530d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:13:01.472029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:01.472029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:01.472029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:01.472029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:01.472029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:01.472029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:01.472029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:01.472029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:01.472029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:01.472029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:01.472029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:01.472029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:01.472029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:01.472029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:01.472029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:01.473060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:01.473060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:01.473060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:01.473060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:01.473060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:01.473060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:01.473060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:01.473060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:01.473060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:01.473060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:01.473060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:01.473060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:01.473060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:01.473060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:01.473060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:01.473060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:01.473891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:01.473891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:01.473891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:01.473891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:01.473891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:01.473891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:01.473891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:01.473891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:01.473891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:01.473891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:01.473891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:13:01.473891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:01.473891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 222/444] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:13:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:01.474539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d286bec-929a-4aeb-810b-ecd5f13530d8 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:01.542165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c2c22-3a81-435e-980f-84b81fc30c7a None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:01.543911 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:01.576310 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857997b-a80e-4825-8bad-ccfde5a641a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:01.576956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857997b-a80e-4825-8bad-ccfde5a641a2 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:01.577236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857997b-a80e-4825-8bad-ccfde5a641a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:01.577541 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857997b-a80e-4825-8bad-ccfde5a641a2 None admin] PATH_INFO: `/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:01.578083 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d286bec-929a-4aeb-810b-ecd5f13530d8 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:01.578708 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857997b-a80e-4825-8bad-ccfde5a641a2 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b1bc1f5a134ced8d3a1e7860ca6585)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:01.580144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857997b-a80e-4825-8bad-ccfde5a641a2 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:01.581939 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 223/445] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jul 28 05:13:01 2022] GET /identity/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:01.582515 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857997b-a80e-4825-8bad-ccfde5a641a2 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:01.600414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:01.612730 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792023f-8b8f-4c55-8b7a-2b9c3c546757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:01.613380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792023f-8b8f-4c55-8b7a-2b9c3c546757 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:01.613692 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792023f-8b8f-4c55-8b7a-2b9c3c546757 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:01.613968 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792023f-8b8f-4c55-8b7a-2b9c3c546757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:01.681313 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792023f-8b8f-4c55-8b7a-2b9c3c546757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:01.682797 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792023f-8b8f-4c55-8b7a-2b9c3c546757 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:01.682900 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857997b-a80e-4825-8bad-ccfde5a641a2 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:01.717527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37a6ae-2c62-4307-bb76-2257418c6bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:01.718139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37a6ae-2c62-4307-bb76-2257418c6bca None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:01.718442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37a6ae-2c62-4307-bb76-2257418c6bca None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:01.718714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37a6ae-2c62-4307-bb76-2257418c6bca None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:01.719412 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37a6ae-2c62-4307-bb76-2257418c6bca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:01.719718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37a6ae-2c62-4307-bb76-2257418c6bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:01.721058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37a6ae-2c62-4307-bb76-2257418c6bca None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:01.729642 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 224/446] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:13:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:01.730426 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37a6ae-2c62-4307-bb76-2257418c6bca None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:01.746863 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:01.781549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 223/447] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:01.782377 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792023f-8b8f-4c55-8b7a-2b9c3c546757 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:01.811763 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:01.834297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37a6ae-2c62-4307-bb76-2257418c6bca None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:01.867563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde4025-6a7e-4e8e-aec2-1bbbbc602356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:01.868186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde4025-6a7e-4e8e-aec2-1bbbbc602356 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:01.868473 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde4025-6a7e-4e8e-aec2-1bbbbc602356 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:01.868757 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde4025-6a7e-4e8e-aec2-1bbbbc602356 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:01.869576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde4025-6a7e-4e8e-aec2-1bbbbc602356 None admin] RBAC: Adding query filter params (group.id=b2b1bc1f5a134ced8d3a1e7860ca6585, role.id=d481402a8f1b4e189c0ecc05bce560e6, scope.project.id=4c563dccc823490ba5fc84b8bd242ab6) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:01.869899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde4025-6a7e-4e8e-aec2-1bbbbc602356 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:01.871322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde4025-6a7e-4e8e-aec2-1bbbbc602356 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:01.877297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 225/448] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jul 28 05:13:01 2022] GET /identity/v3/role_assignments?group.id=b2b1bc1f5a134ced8d3a1e7860ca6585&scope.project.id=4c563dccc823490ba5fc84b8bd242ab6&role.id=d481402a8f1b4e189c0ecc05bce560e6 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:01.878110 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde4025-6a7e-4e8e-aec2-1bbbbc602356 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:01.887504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792023f-8b8f-4c55-8b7a-2b9c3c546757 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:01.926461 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f661a-eac1-403c-b341-454448d74b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:01.927134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f661a-eac1-403c-b341-454448d74b92 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:01.927420 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f661a-eac1-403c-b341-454448d74b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:01.927699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f661a-eac1-403c-b341-454448d74b92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:01.970213 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:02.005765 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde4025-6a7e-4e8e-aec2-1bbbbc602356 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:02.008344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f661a-eac1-403c-b341-454448d74b92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:02.010005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f661a-eac1-403c-b341-454448d74b92 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:02.048246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa77a9-271e-4b97-9cf3-03d735ad7df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:02.048907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa77a9-271e-4b97-9cf3-03d735ad7df5 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:02.049192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa77a9-271e-4b97-9cf3-03d735ad7df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:02.049489 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa77a9-271e-4b97-9cf3-03d735ad7df5 None admin] PATH_INFO: `/v3/projects/4c563dccc823490ba5fc84b8bd242ab6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:02.050714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa77a9-271e-4b97-9cf3-03d735ad7df5 None admin] RBAC: Authorizing `identity:get_project(project_id=4c563dccc823490ba5fc84b8bd242ab6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:02.052145 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa77a9-271e-4b97-9cf3-03d735ad7df5 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:02.055429 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 226/449] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:13:01 2022] GET /identity/v3/projects/4c563dccc823490ba5fc84b8bd242ab6 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:02.061141 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa77a9-271e-4b97-9cf3-03d735ad7df5 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:02.075638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:02.134876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 224/450] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:02.140535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f661a-eac1-403c-b341-454448d74b92 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:02.187043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa77a9-271e-4b97-9cf3-03d735ad7df5 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:02.218875 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:02.225410 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c23e5-5ad9-4121-9269-d70ad9e23537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:02.226546 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c23e5-5ad9-4121-9269-d70ad9e23537 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:02.226896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c23e5-5ad9-4121-9269-d70ad9e23537 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:02.236319 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c23e5-5ad9-4121-9269-d70ad9e23537 None admin] PATH_INFO: `/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:02.236319 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c23e5-5ad9-4121-9269-d70ad9e23537 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b1bc1f5a134ced8d3a1e7860ca6585)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:02.236319 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c23e5-5ad9-4121-9269-d70ad9e23537 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:02.236319 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 227/451] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jul 28 05:13:02 2022] GET /identity/v3/groups/b2b1bc1f5a134ced8d3a1e7860ca6585 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:02.237250 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c23e5-5ad9-4121-9269-d70ad9e23537 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:02.259830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f661a-eac1-403c-b341-454448d74b92 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:02.294766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae7398-3c09-4d64-b9f6-fd8559517456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:02.295405 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae7398-3c09-4d64-b9f6-fd8559517456 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:02.295682 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae7398-3c09-4d64-b9f6-fd8559517456 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:02.295957 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae7398-3c09-4d64-b9f6-fd8559517456 None admin] PATH_INFO: `/v3/projects/44e83cd79a56499f92e288b2c69de397` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:02.297100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae7398-3c09-4d64-b9f6-fd8559517456 None admin] RBAC: Authorizing `identity:get_project(project_id=44e83cd79a56499f92e288b2c69de397)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:02.298579 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae7398-3c09-4d64-b9f6-fd8559517456 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:02.300217 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 225/452] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:13:02 2022] GET /identity/v3/projects/44e83cd79a56499f92e288b2c69de397 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:02.306297 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae7398-3c09-4d64-b9f6-fd8559517456 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:02.317686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:02.339804 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c23e5-5ad9-4121-9269-d70ad9e23537 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:02.373935 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b836ce-b173-4b15-9e72-e6b2b0d27d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:02.374555 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b836ce-b173-4b15-9e72-e6b2b0d27d05 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:02.374838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b836ce-b173-4b15-9e72-e6b2b0d27d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:02.375112 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b836ce-b173-4b15-9e72-e6b2b0d27d05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:02.375907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b836ce-b173-4b15-9e72-e6b2b0d27d05 None admin] RBAC: Adding query filter params (group.id=b2b1bc1f5a134ced8d3a1e7860ca6585, role.id=07a2273f06f649d4a7f2117b3cf6b34d, scope.project.id=4c563dccc823490ba5fc84b8bd242ab6) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:02.376222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b836ce-b173-4b15-9e72-e6b2b0d27d05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:02.377657 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b836ce-b173-4b15-9e72-e6b2b0d27d05 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:02.383747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 228/453] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jul 28 05:13:02 2022] GET /identity/v3/role_assignments?group.id=b2b1bc1f5a134ced8d3a1e7860ca6585&scope.project.id=4c563dccc823490ba5fc84b8bd242ab6&role.id=07a2273f06f649d4a7f2117b3cf6b34d => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:02.406947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae7398-3c09-4d64-b9f6-fd8559517456 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:02.444476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a1fad-f275-4bc8-88a8-cc4bee4e4d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:02.445140 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a1fad-f275-4bc8-88a8-cc4bee4e4d38 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:02.445423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a1fad-f275-4bc8-88a8-cc4bee4e4d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:02.445730 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a1fad-f275-4bc8-88a8-cc4bee4e4d38 None admin] PATH_INFO: `/v3/groups/32cbe047193949ceaee99a3b75b435cc` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:02.446982 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a1fad-f275-4bc8-88a8-cc4bee4e4d38 None admin] RBAC: Authorizing `identity:get_group(group_id=32cbe047193949ceaee99a3b75b435cc)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:02.448449 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a1fad-f275-4bc8-88a8-cc4bee4e4d38 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:02.450161 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 226/454] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jul 28 05:13:02 2022] GET /identity/v3/groups/32cbe047193949ceaee99a3b75b435cc => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:02.456202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b836ce-b173-4b15-9e72-e6b2b0d27d05 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:02.561145 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b836ce-b173-4b15-9e72-e6b2b0d27d05 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:02.596533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b713016-c879-48c5-8176-38b56efec0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:02.597095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b713016-c879-48c5-8176-38b56efec0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:02.597377 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b713016-c879-48c5-8176-38b56efec0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:02.597686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b713016-c879-48c5-8176-38b56efec0c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:02.598484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b713016-c879-48c5-8176-38b56efec0c5 None admin] RBAC: Adding query filter params (group.id=32cbe047193949ceaee99a3b75b435cc, role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=44e83cd79a56499f92e288b2c69de397) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:02.598794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b713016-c879-48c5-8176-38b56efec0c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:02.600228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b713016-c879-48c5-8176-38b56efec0c5 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:02.606453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 229/455] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jul 28 05:13:02 2022] GET /identity/v3/role_assignments?group.id=32cbe047193949ceaee99a3b75b435cc&scope.project.id=44e83cd79a56499f92e288b2c69de397&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:05.211295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e05204-d8f6-4d6f-b48a-db760c6b48a0 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:05.211809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e05204-d8f6-4d6f-b48a-db760c6b48a0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:05.211809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e05204-d8f6-4d6f-b48a-db760c6b48a0 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:05.213161 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 227/456] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:05.227992 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd078a0-2d78-4c47-85a6-ea8796c41698 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:05.228491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa316634-a96c-48ac-a40b-653b963cd048 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:05.228569 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd078a0-2d78-4c47-85a6-ea8796c41698 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:05.228636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa316634-a96c-48ac-a40b-653b963cd048 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:05.228732 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd078a0-2d78-4c47-85a6-ea8796c41698 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:05.228802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa316634-a96c-48ac-a40b-653b963cd048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:05.230141 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 230/457] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:05.235318 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cd9d2-b62f-4e58-a60d-41eebe2fdbdc None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:05.235596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cd9d2-b62f-4e58-a60d-41eebe2fdbdc None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:05.235933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cd9d2-b62f-4e58-a60d-41eebe2fdbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:05.237954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:05.253205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-aa316634-a96c-48ac-a40b-653b963cd048 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:05.254422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-aa316634-a96c-48ac-a40b-653b963cd048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:05.259228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:05.268859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-a85cd9d2-b62f-4e58-a60d-41eebe2fdbdc None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:05.270127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-a85cd9d2-b62f-4e58-a60d-41eebe2fdbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:05.382342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 228/458] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:05.386802 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 231/459] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:13:05.400085 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f36dd-bb81-42c9-81f1-341112dfde5b None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:05.400372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f36dd-bb81-42c9-81f1-341112dfde5b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:05.400649 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f36dd-bb81-42c9-81f1-341112dfde5b None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:05.402103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 229/460] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:05.406428 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cd9d2-b62f-4e58-a60d-41eebe2fdbdc None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:05.406926 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5707f7d-c2da-459f-84a6-b98eac148b82 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:05.407369 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5707f7d-c2da-459f-84a6-b98eac148b82 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:05.407799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5707f7d-c2da-459f-84a6-b98eac148b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:05.431187 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b5707f7d-c2da-459f-84a6-b98eac148b82 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:05.433154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b5707f7d-c2da-459f-84a6-b98eac148b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:05.514656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 230/461] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:13:05.515711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cd9d2-b62f-4e58-a60d-41eebe2fdbdc None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:05.515909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5707f7d-c2da-459f-84a6-b98eac148b82 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:05.559102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413cc34-d47c-4a90-bced-88320a6ec85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:05.561079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413cc34-d47c-4a90-bced-88320a6ec85d None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:05.561482 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413cc34-d47c-4a90-bced-88320a6ec85d None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:05.561869 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413cc34-d47c-4a90-bced-88320a6ec85d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:05.565181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:05.576449 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413cc34-d47c-4a90-bced-88320a6ec85d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:05.578710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413cc34-d47c-4a90-bced-88320a6ec85d None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:05.591941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:05.596616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-6413cc34-d47c-4a90-bced-88320a6ec85d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:05.596616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:05.596616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:05.596616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:05.596616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:05.596616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:05.596616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:05.596616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:05.596616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:05.596616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:05.596616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:05.596616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:05.596616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:05.596616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:05.596616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:05.597516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:05.598364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:05.598364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:05.598364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:05.598364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:05.601213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 232/462] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:05.602366 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413cc34-d47c-4a90-bced-88320a6ec85d None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:05.651097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5707f7d-c2da-459f-84a6-b98eac148b82 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:05.700339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14325f1-2ec6-4fa4-aa64-59712e6fd722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:05.701100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14325f1-2ec6-4fa4-aa64-59712e6fd722 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:05.701445 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14325f1-2ec6-4fa4-aa64-59712e6fd722 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:05.701810 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14325f1-2ec6-4fa4-aa64-59712e6fd722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:05.717002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14325f1-2ec6-4fa4-aa64-59712e6fd722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:05.718488 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413cc34-d47c-4a90-bced-88320a6ec85d None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:05.718678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14325f1-2ec6-4fa4-aa64-59712e6fd722 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:05.736549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-f14325f1-2ec6-4fa4-aa64-59712e6fd722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:05.736549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:05.736549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:05.736549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:05.736549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:05.736549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:05.736549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:05.736549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:05.736549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:05.736549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:05.736549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:05.736549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:05.736549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:05.736549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:05.736549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:05.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:05.738406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:05.738406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:05.738406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:05.738406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:05.738406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 231/463] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:05.738688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14325f1-2ec6-4fa4-aa64-59712e6fd722 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:05.757325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6c472-0c9c-4e7e-b8f5-9513cc867bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:05.758265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6c472-0c9c-4e7e-b8f5-9513cc867bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:05.758265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6c472-0c9c-4e7e-b8f5-9513cc867bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:05.758559 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6c472-0c9c-4e7e-b8f5-9513cc867bf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:05.769960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6c472-0c9c-4e7e-b8f5-9513cc867bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:05.771686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6c472-0c9c-4e7e-b8f5-9513cc867bf1 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:05.787066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-8cc6c472-0c9c-4e7e-b8f5-9513cc867bf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:05.787066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:05.787066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:05.787066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:05.787066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:05.787066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:05.787066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:05.787066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:05.787066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:05.787066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:05.787066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:05.787066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:05.787066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:05.787066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:05.787066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:05.788727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:05.789738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:05.789738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:05.789738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:05.789738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:05.789738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 233/464] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:05.790349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9509a-5acb-4458-bf21-7184180e029c None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:05.790349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9509a-5acb-4458-bf21-7184180e029c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:05.790615 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9509a-5acb-4458-bf21-7184180e029c None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:05.792157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 234/465] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:05.792855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9509a-5acb-4458-bf21-7184180e029c None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:05.837377 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:05.860897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14325f1-2ec6-4fa4-aa64-59712e6fd722 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:05.881125 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:05.900231 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9509a-5acb-4458-bf21-7184180e029c None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:05.900376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a89689-26c6-46ae-9483-9aa2f33b22a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:05.900858 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a89689-26c6-46ae-9483-9aa2f33b22a5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:05.901141 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a89689-26c6-46ae-9483-9aa2f33b22a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:05.901422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a89689-26c6-46ae-9483-9aa2f33b22a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:05.902171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a89689-26c6-46ae-9483-9aa2f33b22a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:05.903176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a89689-26c6-46ae-9483-9aa2f33b22a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:05.903952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a89689-26c6-46ae-9483-9aa2f33b22a5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:05.916347 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 232/466] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:05.921745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a89689-26c6-46ae-9483-9aa2f33b22a5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:05.937743 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc2a83-3b09-4515-b01e-f989d01474a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:05.938369 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc2a83-3b09-4515-b01e-f989d01474a9 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:05.938907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc2a83-3b09-4515-b01e-f989d01474a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:05.939186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc2a83-3b09-4515-b01e-f989d01474a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:05.939873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc2a83-3b09-4515-b01e-f989d01474a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:05.940181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc2a83-3b09-4515-b01e-f989d01474a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:05.941686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc2a83-3b09-4515-b01e-f989d01474a9 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:05.960310 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 235/467] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:05.961671 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9d433-7df4-4faa-99e9-3d536e9a545a None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:05.961860 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9d433-7df4-4faa-99e9-3d536e9a545a None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:05.962128 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9d433-7df4-4faa-99e9-3d536e9a545a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:05.982878 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-05d9d433-7df4-4faa-99e9-3d536e9a545a None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:05.984107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-05d9d433-7df4-4faa-99e9-3d536e9a545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:06.036126 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a89689-26c6-46ae-9483-9aa2f33b22a5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:06.065040 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 236/468] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:06.065040 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9d433-7df4-4faa-99e9-3d536e9a545a None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:06.075125 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c478544-4378-4d90-92a1-26ab0855be7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:06.075756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c478544-4378-4d90-92a1-26ab0855be7a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:06.076037 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c478544-4378-4d90-92a1-26ab0855be7a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:06.076340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c478544-4378-4d90-92a1-26ab0855be7a None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:06.077040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c478544-4378-4d90-92a1-26ab0855be7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:06.077348 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c478544-4378-4d90-92a1-26ab0855be7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:06.078813 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c478544-4378-4d90-92a1-26ab0855be7a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:06.091423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 233/469] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:06.092287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c478544-4378-4d90-92a1-26ab0855be7a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:06.098378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:06.130743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:06.169394 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9d433-7df4-4faa-99e9-3d536e9a545a None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:06.201722 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c478544-4378-4d90-92a1-26ab0855be7a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:06.204444 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469a2a5-ef5c-40ec-a3ec-60e7bb328318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:06.205063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469a2a5-ef5c-40ec-a3ec-60e7bb328318 None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:06.205341 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469a2a5-ef5c-40ec-a3ec-60e7bb328318 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:06.205644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469a2a5-ef5c-40ec-a3ec-60e7bb328318 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:06.206312 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469a2a5-ef5c-40ec-a3ec-60e7bb328318 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:06.207742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469a2a5-ef5c-40ec-a3ec-60e7bb328318 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:06.239068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184b121-ca0c-436c-90bd-6215ec58e547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:06.239720 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184b121-ca0c-436c-90bd-6215ec58e547 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:06.240005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184b121-ca0c-436c-90bd-6215ec58e547 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:06.240288 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184b121-ca0c-436c-90bd-6215ec58e547 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:06.241365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184b121-ca0c-436c-90bd-6215ec58e547 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:06.242831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184b121-ca0c-436c-90bd-6215ec58e547 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:06.305347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 237/470] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:13:06 2022] POST /identity/v3/users => generated 248 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:13:06.306742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469a2a5-ef5c-40ec-a3ec-60e7bb328318 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:06.341674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 234/471] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:13:06 2022] POST /identity/v3/users => generated 246 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:13:06.342997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184b121-ca0c-436c-90bd-6215ec58e547 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:06.477800 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:06.496480 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469a2a5-ef5c-40ec-a3ec-60e7bb328318 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:06.516150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:06.529369 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184b121-ca0c-436c-90bd-6215ec58e547 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:06.541821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c25e05-1363-4408-9fb9-ff42c6b78fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:06.542734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c25e05-1363-4408-9fb9-ff42c6b78fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:06.543165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c25e05-1363-4408-9fb9-ff42c6b78fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:06.543607 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c25e05-1363-4408-9fb9-ff42c6b78fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:06.555480 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c25e05-1363-4408-9fb9-ff42c6b78fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:06.557196 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c25e05-1363-4408-9fb9-ff42c6b78fb1 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:06.570348 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c2cab-7e84-4b06-a40a-a125a0c24287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:06.571102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c2cab-7e84-4b06-a40a-a125a0c24287 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:06.571891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c2cab-7e84-4b06-a40a-a125a0c24287 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:06.571891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c2cab-7e84-4b06-a40a-a125a0c24287 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:06.572327 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c2cab-7e84-4b06-a40a-a125a0c24287 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:06.574655 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c2cab-7e84-4b06-a40a-a125a0c24287 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:06.575163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-80c25e05-1363-4408-9fb9-ff42c6b78fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:06.575163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:06.575163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:06.575163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:06.575163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:06.575163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:06.575163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:06.575163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:06.575163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:06.575163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:06.575163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:06.575163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:06.575163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:06.575163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:06.575163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:06.576024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:06.576871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:06.576871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:06.576871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:06.576871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:06.576871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 238/472] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:06.583830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c25e05-1363-4408-9fb9-ff42c6b78fb1 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:06.680741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 235/473] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:13:06 2022] POST /identity/v3/users => generated 248 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:13:06.682488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9bf32-fbb9-472f-b3e3-a7aa6bdac66a None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:06.682775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9bf32-fbb9-472f-b3e3-a7aa6bdac66a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:06.683299 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9bf32-fbb9-472f-b3e3-a7aa6bdac66a None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:06.685395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 236/474] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:06.691338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62404b97-86d4-4788-b436-2b8d9d7fc4f9 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:06.691763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62404b97-86d4-4788-b436-2b8d9d7fc4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:06.692300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62404b97-86d4-4788-b436-2b8d9d7fc4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:06.708396 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c25e05-1363-4408-9fb9-ff42c6b78fb1 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:06.713848 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-62404b97-86d4-4788-b436-2b8d9d7fc4f9 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:06.715108 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-62404b97-86d4-4788-b436-2b8d9d7fc4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:06.756323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9584615-9426-4498-9932-83834d96cd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:06.758101 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9584615-9426-4498-9932-83834d96cd06 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:06.758385 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9584615-9426-4498-9932-83834d96cd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:06.758663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9584615-9426-4498-9932-83834d96cd06 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:06.759380 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9584615-9426-4498-9932-83834d96cd06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:06.759690 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9584615-9426-4498-9932-83834d96cd06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:06.761112 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9584615-9426-4498-9932-83834d96cd06 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:06.769839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:06.778239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 239/475] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:06.782970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9584615-9426-4498-9932-83834d96cd06 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:06.808598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 237/476] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:06.843581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62404b97-86d4-4788-b436-2b8d9d7fc4f9 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:06.951876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9584615-9426-4498-9932-83834d96cd06 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:06.979309 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:06.998751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8c252-24bc-402f-ad08-fce96886a671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:06.999523 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8c252-24bc-402f-ad08-fce96886a671 None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:06.999905 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8c252-24bc-402f-ad08-fce96886a671 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:07.000287 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8c252-24bc-402f-ad08-fce96886a671 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:07.001071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8c252-24bc-402f-ad08-fce96886a671 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:07.002805 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8c252-24bc-402f-ad08-fce96886a671 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:07.005300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62404b97-86d4-4788-b436-2b8d9d7fc4f9 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:07.049315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b1629-b766-43d2-9d08-e454d41a1f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:07.049993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b1629-b766-43d2-9d08-e454d41a1f4b None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:07.050278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b1629-b766-43d2-9d08-e454d41a1f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:07.050556 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b1629-b766-43d2-9d08-e454d41a1f4b None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:07.051290 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b1629-b766-43d2-9d08-e454d41a1f4b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:07.052826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b1629-b766-43d2-9d08-e454d41a1f4b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:07.089446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 240/477] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:13:06 2022] POST /identity/v3/users => generated 249 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:13:07.106215 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.sql.core [None req-340b1629-b766-43d2-9d08-e454d41a1f4b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 05:13:07.106215 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 05:13:07.106215 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [parameters: {'id': '2b89ebfcab644926a58d2cc6c5e7d8cb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 05:13:07.106215 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80267) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 05:13:07.123191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-340b1629-b766-43d2-9d08-e454d41a1f4b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 05:13:07.123191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:07.123191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:13:07.123191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:13:07.123191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:13:07.123191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:13:07.123191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:13:07.123191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:13:07.123191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:13:07.123191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:13:07.123191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:13:07.123191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:13:07.123191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:13:07.123191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result.read() Jul 28 05:13:07.123191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:13:07.124177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application yield resource Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise self.value Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application session.commit() Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 05:13:07.125368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.session.flush() Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application compat.raise_( Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 05:13:07.126766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 05:13:07.127842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 05:13:07.127842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 05:13:07.127842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 05:13:07.127842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 05:13:07.127842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 05:13:07.127842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 05:13:07.127842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 05:13:07.127842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 05:13:07.127842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 05:13:07.127842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 05:13:07.127842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 05:13:07.127842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 05:13:07.127842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 05:13:07.127842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 05:13:07.127842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:13:07.127842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception Jul 28 05:13:07.128861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:13:07.128861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:13:07.128861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:13:07.128861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:13:07.128861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:13:07.128861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:13:07.128861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:13:07.128861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:13:07.128861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:13:07.128861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:13:07.128861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:13:07.128861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result.read() Jul 28 05:13:07.128861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:13:07.128861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:13:07.128861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:13:07.128861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:13:07.131034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:13:07.131034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:13:07.131034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:13:07.131034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:13:07.131034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 05:13:07.131034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 05:13:07.131034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [parameters: {'id': '2b89ebfcab644926a58d2cc6c5e7d8cb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 05:13:07.131034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 05:13:07.131034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:07.131034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:07.131034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:07.131034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:07.131034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:07.131034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:07.131034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:07.131034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:07.133636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:07.133636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:07.133636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:07.133636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:07.133636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:07.133636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:07.133636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 05:13:07.133636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 05:13:07.133636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:07.133636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:07.133636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 05:13:07.133636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 05:13:07.133636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 05:13:07.133636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 05:13:07.133636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 05:13:07.133636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:07.145283 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 238/478] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Jul 28 05:13:06 2022] POST /identity/v3/roles => generated 144 bytes in 282 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:07.145366 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8c252-24bc-402f-ad08-fce96886a671 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:07.220510 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:07.298060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8c252-24bc-402f-ad08-fce96886a671 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:07.334593 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8043e-bf7b-4930-82d2-23331a8c65f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:07.335827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8043e-bf7b-4930-82d2-23331a8c65f9 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:07.336010 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8043e-bf7b-4930-82d2-23331a8c65f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:07.336295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8043e-bf7b-4930-82d2-23331a8c65f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:07.347082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8043e-bf7b-4930-82d2-23331a8c65f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:07.352789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-31b8043e-bf7b-4930-82d2-23331a8c65f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:13:07.352789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:07.352789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:07.352789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:07.352789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:07.352789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:07.352789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:07.352789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:07.352789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:07.352789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:07.352789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:07.352789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:07.352789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:07.352789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:07.352789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:07.352789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:07.353682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:07.353682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:07.353682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:07.353682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:07.353682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:07.353682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:07.353682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:07.353682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:07.353682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:07.353682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:07.353682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:07.353682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:07.353682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:07.353682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:07.353682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:07.353682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:07.354759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:07.354759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:07.354759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:07.354759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:07.354759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:07.354759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:07.354759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:07.354759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:07.354759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:07.354759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:07.354759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:13:07.354759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:07.354759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 241/479] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:13:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:07.359947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b1629-b766-43d2-9d08-e454d41a1f4b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:07.467538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b1629-b766-43d2-9d08-e454d41a1f4b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:07.502844 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c697e0f-8075-4200-82d8-a10398647795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:07.503538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697e0f-8075-4200-82d8-a10398647795 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:07.503829 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697e0f-8075-4200-82d8-a10398647795 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:07.504104 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697e0f-8075-4200-82d8-a10398647795 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:07.504831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c697e0f-8075-4200-82d8-a10398647795 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:07.505142 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c697e0f-8075-4200-82d8-a10398647795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:07.506587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c697e0f-8075-4200-82d8-a10398647795 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:07.515273 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 239/480] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:08.804632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e634fe7-84f7-4529-8152-0df8f6c564e9 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:08.805202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e634fe7-84f7-4529-8152-0df8f6c564e9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:08.805202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e634fe7-84f7-4529-8152-0df8f6c564e9 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:08.806919 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 242/481] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:08.812738 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8ec3d-97bf-40f5-b19a-a896ac294646 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:08.813226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8ec3d-97bf-40f5-b19a-a896ac294646 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:08.813311 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8ec3d-97bf-40f5-b19a-a896ac294646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:08.824323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:08.827948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb9fc5-16ec-484e-9fba-5dc77925a258 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:08.828236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb9fc5-16ec-484e-9fba-5dc77925a258 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:08.828514 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb9fc5-16ec-484e-9fba-5dc77925a258 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:08.830221 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 243/482] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:08.835554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d60c53-22b0-4f75-9a20-ed7fddba2425 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:08.835859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d60c53-22b0-4f75-9a20-ed7fddba2425 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:08.836230 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d60c53-22b0-4f75-9a20-ed7fddba2425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:08.887924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-c0d60c53-22b0-4f75-9a20-ed7fddba2425 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:08.889142 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c0d60c53-22b0-4f75-9a20-ed7fddba2425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:08.894567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-98f8ec3d-97bf-40f5-b19a-a896ac294646 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:08.896010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-98f8ec3d-97bf-40f5-b19a-a896ac294646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:08.973948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 244/483] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:08.995454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d60c53-22b0-4f75-9a20-ed7fddba2425 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:09.041314 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 240/484] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:13:09.076596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8ec3d-97bf-40f5-b19a-a896ac294646 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:09.089875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:09.168452 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d60c53-22b0-4f75-9a20-ed7fddba2425 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:09.249838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541e0ad-6df9-4f0a-a020-92e51d90fba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:09.250491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541e0ad-6df9-4f0a-a020-92e51d90fba0 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:09.250771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541e0ad-6df9-4f0a-a020-92e51d90fba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:09.251044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541e0ad-6df9-4f0a-a020-92e51d90fba0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:09.279386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541e0ad-6df9-4f0a-a020-92e51d90fba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:09.285082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-9541e0ad-6df9-4f0a-a020-92e51d90fba0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:09.285082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:09.285082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:09.285082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:09.285082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:09.285082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:09.285082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:09.285082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:09.285082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:09.285082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:09.285082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:09.285082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:09.285082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:09.285082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:09.285082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:09.285082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:09.286161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:09.286161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:09.286161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:09.286161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:09.286161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:09.286161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:09.286161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:09.286161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:09.286161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:09.286161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:09.286161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:09.286161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:09.286161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:09.286161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:09.286161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:09.286161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:09.287159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:09.287159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:09.287159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:09.287159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:09.287159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:09.287159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:09.287159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:09.287159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:09.287159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:09.287159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:09.287159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:09.287159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:09.293491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8ec3d-97bf-40f5-b19a-a896ac294646 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:09.293860 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 245/485] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:09.297826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541e0ad-6df9-4f0a-a020-92e51d90fba0 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:09.346616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33ba6d-251f-4e91-9301-6cd045357c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:09.347498 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33ba6d-251f-4e91-9301-6cd045357c42 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:09.347924 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33ba6d-251f-4e91-9301-6cd045357c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:09.348358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33ba6d-251f-4e91-9301-6cd045357c42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:09.350882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:09.362941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33ba6d-251f-4e91-9301-6cd045357c42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:09.370143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-8a33ba6d-251f-4e91-9301-6cd045357c42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:09.370143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:09.370143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:09.370143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:09.370143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:09.370143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:09.370143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:09.370143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:09.370143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:09.370143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:09.370143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:09.370143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:09.370143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:09.370143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:09.370143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:09.370143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:09.371200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:09.371200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:09.371200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:09.371200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:09.371200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:09.371200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:09.371200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:09.371200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:09.371200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:09.371200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:09.371200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:09.371200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:09.371200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:09.371200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:09.371200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:09.371200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:09.372167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:09.372167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:09.372167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:09.372167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:09.372167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:09.372167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:09.372167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:09.372167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:09.372167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:09.372167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:09.372167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:09.372167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:09.375055 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 241/486] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:09.377583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3ca3d-1171-46e5-9878-39489c05d372 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:09.378166 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3ca3d-1171-46e5-9878-39489c05d372 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:09.378899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3ca3d-1171-46e5-9878-39489c05d372 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:09.381163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 242/487] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:09.382582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3ca3d-1171-46e5-9878-39489c05d372 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:09.437158 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541e0ad-6df9-4f0a-a020-92e51d90fba0 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:09.440577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:09.486351 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1baaba-1ff9-4014-87a8-3c625357789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:09.487251 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1baaba-1ff9-4014-87a8-3c625357789c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:09.487683 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1baaba-1ff9-4014-87a8-3c625357789c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:09.488102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1baaba-1ff9-4014-87a8-3c625357789c None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:09.489499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1baaba-1ff9-4014-87a8-3c625357789c None admin] RBAC: Adding query filter params (name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:09.490239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1baaba-1ff9-4014-87a8-3c625357789c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:09.492746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1baaba-1ff9-4014-87a8-3c625357789c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:09.509503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 246/488] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:09.509503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8db2c-15c1-479f-8a92-de2e4e190f11 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:09.509503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8db2c-15c1-479f-8a92-de2e4e190f11 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:09.509503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8db2c-15c1-479f-8a92-de2e4e190f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:09.513308 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3ca3d-1171-46e5-9878-39489c05d372 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:09.535476 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-82f8db2c-15c1-479f-8a92-de2e4e190f11 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:09.538431 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-82f8db2c-15c1-479f-8a92-de2e4e190f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:09.556073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a00a3-5076-43db-9122-b6da4ee57fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:09.557253 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a00a3-5076-43db-9122-b6da4ee57fbc None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:09.558001 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a00a3-5076-43db-9122-b6da4ee57fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:09.558476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a00a3-5076-43db-9122-b6da4ee57fbc None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:09.559719 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a00a3-5076-43db-9122-b6da4ee57fbc None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:09.560228 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a00a3-5076-43db-9122-b6da4ee57fbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:09.562432 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a00a3-5076-43db-9122-b6da4ee57fbc None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:09.574790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 243/489] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:09.575820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a00a3-5076-43db-9122-b6da4ee57fbc None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:09.626094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 247/490] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:09.627319 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8db2c-15c1-479f-8a92-de2e4e190f11 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:09.656947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:09.707265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a00a3-5076-43db-9122-b6da4ee57fbc None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:09.742365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:09.745163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da038fc2-e0f8-49d6-a6af-646a90a78cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:09.745913 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da038fc2-e0f8-49d6-a6af-646a90a78cea None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:09.746133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da038fc2-e0f8-49d6-a6af-646a90a78cea None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:09.746416 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da038fc2-e0f8-49d6-a6af-646a90a78cea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:09.750552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8db2c-15c1-479f-8a92-de2e4e190f11 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:09.759561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da038fc2-e0f8-49d6-a6af-646a90a78cea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:09.761081 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da038fc2-e0f8-49d6-a6af-646a90a78cea None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:09.778702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-da038fc2-e0f8-49d6-a6af-646a90a78cea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:09.778702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:09.778702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:09.778702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:09.778702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:09.778702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:09.778702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:09.778702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:09.778702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:09.778702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:09.778702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:09.778702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:09.778702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:09.778702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:09.778702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:09.779591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:09.780410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:09.780410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:09.780410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:09.780410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:09.780410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 244/491] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:09.785975 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da038fc2-e0f8-49d6-a6af-646a90a78cea None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:09.800591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a88f7-f470-4f12-94f0-51ac696b8a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:09.802847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a88f7-f470-4f12-94f0-51ac696b8a9c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:09.802847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a88f7-f470-4f12-94f0-51ac696b8a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:09.802847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a88f7-f470-4f12-94f0-51ac696b8a9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:09.816876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a88f7-f470-4f12-94f0-51ac696b8a9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:09.819608 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a88f7-f470-4f12-94f0-51ac696b8a9c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:09.839685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-386a88f7-f470-4f12-94f0-51ac696b8a9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:09.839685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:09.839685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:09.839685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:09.839685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:09.839685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:09.839685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:09.839685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:09.839685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:09.839685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:09.839685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:09.839685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:09.839685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:09.839685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:09.839685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:09.840565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:09.841868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:09.841868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:09.841868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:09.841868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:09.841868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 248/492] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:09.841868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a88f7-f470-4f12-94f0-51ac696b8a9c None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:09.911438 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da038fc2-e0f8-49d6-a6af-646a90a78cea None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:09.922158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:09.950842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0687570-3ecb-479b-8e04-c9cd4c48d382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:09.951457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a88f7-f470-4f12-94f0-51ac696b8a9c None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:09.951702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0687570-3ecb-479b-8e04-c9cd4c48d382 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:09.951972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0687570-3ecb-479b-8e04-c9cd4c48d382 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:09.952682 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0687570-3ecb-479b-8e04-c9cd4c48d382 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:09.965962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0687570-3ecb-479b-8e04-c9cd4c48d382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:09.971954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c0687570-3ecb-479b-8e04-c9cd4c48d382 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:09.971954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:09.971954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:09.971954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:09.971954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:09.971954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:09.971954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:09.971954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:09.971954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:09.971954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:09.971954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:09.971954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:09.971954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:09.971954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:09.971954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:09.971954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:09.972976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:09.972976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:09.972976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:09.972976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:09.972976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:09.972976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:09.972976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:09.972976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:09.972976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:09.972976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:09.972976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:09.972976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:09.972976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:09.972976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:09.972976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:09.972976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:09.979639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:09.979639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:09.979639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:09.979639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:09.979639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:09.979639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:09.979639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:09.979639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:09.979639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:09.979639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:09.979639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:09.979639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:09.979639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 245/493] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:09.979639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897f77b-7896-476d-af76-6140d05cbff3 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:09.980755 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897f77b-7896-476d-af76-6140d05cbff3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:09.980755 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897f77b-7896-476d-af76-6140d05cbff3 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:09.980755 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 246/494] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:09.980755 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897f77b-7896-476d-af76-6140d05cbff3 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:09.995541 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400da8a-4c50-48ad-b433-2c5a94b2dc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:09.996173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400da8a-4c50-48ad-b433-2c5a94b2dc01 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:09.996458 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400da8a-4c50-48ad-b433-2c5a94b2dc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:09.996737 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400da8a-4c50-48ad-b433-2c5a94b2dc01 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:09.997437 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400da8a-4c50-48ad-b433-2c5a94b2dc01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:09.997795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400da8a-4c50-48ad-b433-2c5a94b2dc01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:09.999165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400da8a-4c50-48ad-b433-2c5a94b2dc01 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:10.012588 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 249/495] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:10.017380 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400da8a-4c50-48ad-b433-2c5a94b2dc01 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:10.027739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:10.092684 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897f77b-7896-476d-af76-6140d05cbff3 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:10.123160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400da8a-4c50-48ad-b433-2c5a94b2dc01 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:10.127955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a1e3f-6550-4fec-8bc2-7fcbefb3b63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:10.128652 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a1e3f-6550-4fec-8bc2-7fcbefb3b63e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:10.129004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a1e3f-6550-4fec-8bc2-7fcbefb3b63e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:10.129348 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a1e3f-6550-4fec-8bc2-7fcbefb3b63e None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:10.130140 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a1e3f-6550-4fec-8bc2-7fcbefb3b63e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:10.130546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a1e3f-6550-4fec-8bc2-7fcbefb3b63e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:10.132012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a1e3f-6550-4fec-8bc2-7fcbefb3b63e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:10.143559 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 247/496] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:10.144720 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88a503-b779-4f40-b9cd-2274630b4e48 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:10.145009 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88a503-b779-4f40-b9cd-2274630b4e48 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:10.145287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88a503-b779-4f40-b9cd-2274630b4e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:10.158772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485eebc4-33e2-4469-87e4-af7bea8766ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:10.159386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485eebc4-33e2-4469-87e4-af7bea8766ed None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:10.159669 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485eebc4-33e2-4469-87e4-af7bea8766ed None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:10.159948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485eebc4-33e2-4469-87e4-af7bea8766ed None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:10.160667 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485eebc4-33e2-4469-87e4-af7bea8766ed None admin] RBAC: Adding query filter params (name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:10.160975 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485eebc4-33e2-4469-87e4-af7bea8766ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:10.162443 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485eebc4-33e2-4469-87e4-af7bea8766ed None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:10.163480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-eb88a503-b779-4f40-b9cd-2274630b4e48 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:10.164658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-eb88a503-b779-4f40-b9cd-2274630b4e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:10.171038 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 250/497] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:10.171827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485eebc4-33e2-4469-87e4-af7bea8766ed None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:10.189009 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:10.233961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 248/498] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:10.235212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26206a07-9f33-4dc4-bc2a-d3b6e838020d None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:10.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26206a07-9f33-4dc4-bc2a-d3b6e838020d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:10.235781 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26206a07-9f33-4dc4-bc2a-d3b6e838020d None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:10.237010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 249/499] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:10.237736 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26206a07-9f33-4dc4-bc2a-d3b6e838020d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:10.245596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:10.281152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485eebc4-33e2-4469-87e4-af7bea8766ed None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:10.315430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0da3a-9e6d-425d-bc72-a2dd10dabaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:10.316066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0da3a-9e6d-425d-bc72-a2dd10dabaab None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:10.316342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0da3a-9e6d-425d-bc72-a2dd10dabaab None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:10.316609 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0da3a-9e6d-425d-bc72-a2dd10dabaab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:10.324114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0da3a-9e6d-425d-bc72-a2dd10dabaab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:10.325590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0da3a-9e6d-425d-bc72-a2dd10dabaab None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:10.340290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-1fe0da3a-9e6d-425d-bc72-a2dd10dabaab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:13:10.340290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:10.340290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:10.340290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:10.340290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:10.340290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:10.340290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:10.340290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:10.340290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:10.340290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:10.340290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:10.340290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:10.340290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:10.340290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:10.340290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:10.340290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:10.341254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:10.342414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:10.342414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:10.342414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:10.342414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:10.342414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:10.342414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:10.342414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:10.342414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:10.342414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:13:10.342414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:10.342414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 251/500] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jul 28 05:13:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:10.343931 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0da3a-9e6d-425d-bc72-a2dd10dabaab None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:10.354648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26206a07-9f33-4dc4-bc2a-d3b6e838020d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:10.388086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab179e4-be39-42bc-ad3c-00f9fd4127c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:10.388733 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab179e4-be39-42bc-ad3c-00f9fd4127c4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:10.389013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab179e4-be39-42bc-ad3c-00f9fd4127c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:10.389296 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab179e4-be39-42bc-ad3c-00f9fd4127c4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:10.396179 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab179e4-be39-42bc-ad3c-00f9fd4127c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:10.398258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab179e4-be39-42bc-ad3c-00f9fd4127c4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:10.411004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-9ab179e4-be39-42bc-ad3c-00f9fd4127c4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:13:10.411004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:10.411004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:10.411004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:10.411004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:10.411004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:10.411004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:10.411004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:10.411004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:10.411004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:10.411004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:10.411004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:10.411004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:10.411004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:10.411004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:10.411004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:10.412052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:10.413956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:10.413956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:10.413956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:10.413956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:10.413956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:10.413956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:10.413956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:10.413956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:10.413956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:13:10.413956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:10.413956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 250/501] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:13:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:10.414645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfb075-de02-4b2a-970c-a366d1a6099f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:10.414645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfb075-de02-4b2a-970c-a366d1a6099f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:10.414645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfb075-de02-4b2a-970c-a366d1a6099f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:10.431815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e0dfb075-de02-4b2a-970c-a366d1a6099f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:10.433012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e0dfb075-de02-4b2a-970c-a366d1a6099f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:10.446188 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:10.447745 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0da3a-9e6d-425d-bc72-a2dd10dabaab None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:10.476422 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:10.482100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191ee31-0a76-42d0-a2ea-31de8fe64f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:10.482743 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191ee31-0a76-42d0-a2ea-31de8fe64f8e None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:10.483022 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191ee31-0a76-42d0-a2ea-31de8fe64f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:10.483512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191ee31-0a76-42d0-a2ea-31de8fe64f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:10.493979 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191ee31-0a76-42d0-a2ea-31de8fe64f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:10.495454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191ee31-0a76-42d0-a2ea-31de8fe64f8e None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:10.499163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 251/502] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:10.499983 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfb075-de02-4b2a-970c-a366d1a6099f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:10.510322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-f191ee31-0a76-42d0-a2ea-31de8fe64f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:10.510322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:10.510322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:10.510322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:10.510322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:10.510322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:10.510322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:10.510322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:10.510322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:10.510322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:10.510322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:10.510322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:10.510322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:10.510322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:10.510322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:10.511331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:10.512498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:10.512498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:10.512498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:10.512498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:10.513628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 252/503] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:10.514931 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191ee31-0a76-42d0-a2ea-31de8fe64f8e None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:10.601034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfb075-de02-4b2a-970c-a366d1a6099f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:10.619197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191ee31-0a76-42d0-a2ea-31de8fe64f8e None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:10.633851 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc7459-12cb-485b-bc9b-15b14e6017b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:10.634492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc7459-12cb-485b-bc9b-15b14e6017b1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:10.634778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc7459-12cb-485b-bc9b-15b14e6017b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:10.635051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc7459-12cb-485b-bc9b-15b14e6017b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:10.644809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc7459-12cb-485b-bc9b-15b14e6017b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:10.650367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-5fcc7459-12cb-485b-bc9b-15b14e6017b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:10.650367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:10.650367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:10.650367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:10.650367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:10.650367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:10.650367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:10.650367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:10.650367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:10.650367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:10.650367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:10.650367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:10.650367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:10.650367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:10.650367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:10.650367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:10.651469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:10.651469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:10.651469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:10.651469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:10.651469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:10.651469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:10.651469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:10.651469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:10.651469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:10.651469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:10.651469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:10.651469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:10.651469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:10.651469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:10.651469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:10.651469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:10.652271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:10.652271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:10.652271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:10.652271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:10.652271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:10.652271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:10.652271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:10.652271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:10.652271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:10.652271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:10.652271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:10.652271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:10.652271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 252/504] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:10.652271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc7459-12cb-485b-bc9b-15b14e6017b1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:10.653817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef93bb-41a2-4697-9b6b-b645cdff7293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:10.654437 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef93bb-41a2-4697-9b6b-b645cdff7293 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:10.654719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef93bb-41a2-4697-9b6b-b645cdff7293 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:10.654992 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef93bb-41a2-4697-9b6b-b645cdff7293 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:10.655819 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef93bb-41a2-4697-9b6b-b645cdff7293 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:10.656330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef93bb-41a2-4697-9b6b-b645cdff7293 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:10.657579 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef93bb-41a2-4697-9b6b-b645cdff7293 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:10.664089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:10.694478 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 253/505] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jul 28 05:13:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:10.695309 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef93bb-41a2-4697-9b6b-b645cdff7293 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:10.738105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:10.752566 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc7459-12cb-485b-bc9b-15b14e6017b1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:10.786802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b554a30-cdbe-4d58-b17b-455e35c23831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:10.787417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b554a30-cdbe-4d58-b17b-455e35c23831 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:10.787729 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b554a30-cdbe-4d58-b17b-455e35c23831 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:10.787995 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b554a30-cdbe-4d58-b17b-455e35c23831 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:10.788883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b554a30-cdbe-4d58-b17b-455e35c23831 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:10.789192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b554a30-cdbe-4d58-b17b-455e35c23831 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:10.790635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b554a30-cdbe-4d58-b17b-455e35c23831 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:10.795961 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef93bb-41a2-4697-9b6b-b645cdff7293 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:10.827643 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 253/506] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jul 28 05:13:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:10.828456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b554a30-cdbe-4d58-b17b-455e35c23831 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:10.829494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749296b-f414-4d3e-a897-8e5267fd8a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:10.830105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749296b-f414-4d3e-a897-8e5267fd8a2b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:10.830387 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749296b-f414-4d3e-a897-8e5267fd8a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:10.830662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749296b-f414-4d3e-a897-8e5267fd8a2b None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:10.831345 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749296b-f414-4d3e-a897-8e5267fd8a2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:10.831655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749296b-f414-4d3e-a897-8e5267fd8a2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:10.833459 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749296b-f414-4d3e-a897-8e5267fd8a2b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:10.845533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 254/507] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:10.846337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749296b-f414-4d3e-a897-8e5267fd8a2b None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:10.895606 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:10.929972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b554a30-cdbe-4d58-b17b-455e35c23831 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:10.943087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:10.947037 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749296b-f414-4d3e-a897-8e5267fd8a2b None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:10.964128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913350f9-bf4e-48c1-b98d-c92db5a4d52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:10.964772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913350f9-bf4e-48c1-b98d-c92db5a4d52d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:10.965051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913350f9-bf4e-48c1-b98d-c92db5a4d52d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:10.965324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913350f9-bf4e-48c1-b98d-c92db5a4d52d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:10.975173 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913350f9-bf4e-48c1-b98d-c92db5a4d52d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:10.976617 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913350f9-bf4e-48c1-b98d-c92db5a4d52d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:10.985783 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3d483-1685-4996-9b09-9dd49c793a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:10.986423 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3d483-1685-4996-9b09-9dd49c793a95 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:10.986885 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3d483-1685-4996-9b09-9dd49c793a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:10.987441 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3d483-1685-4996-9b09-9dd49c793a95 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:10.988236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3d483-1685-4996-9b09-9dd49c793a95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:10.988547 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3d483-1685-4996-9b09-9dd49c793a95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:10.989944 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3d483-1685-4996-9b09-9dd49c793a95 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:10.991648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-913350f9-bf4e-48c1-b98d-c92db5a4d52d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:10.991648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:10.991648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:10.991648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:10.991648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:10.991648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:10.991648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:10.991648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:10.991648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:10.991648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:10.991648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:10.991648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:10.991648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:10.991648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:10.991648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:10.992508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:10.993504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:10.993504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:10.993504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:10.993504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:10.993504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 254/508] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:10.993837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913350f9-bf4e-48c1-b98d-c92db5a4d52d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:11.004460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 255/509] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:11.004460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3d483-1685-4996-9b09-9dd49c793a95 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:11.094820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913350f9-bf4e-48c1-b98d-c92db5a4d52d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:11.104297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3d483-1685-4996-9b09-9dd49c793a95 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:11.111099 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:11.127819 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49044b0-faad-498b-8540-2e1790fc054f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:11.128445 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49044b0-faad-498b-8540-2e1790fc054f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:11.128730 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49044b0-faad-498b-8540-2e1790fc054f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:11.129007 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49044b0-faad-498b-8540-2e1790fc054f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:11.138731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2961e-4787-49c6-8f98-06550fe50c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:11.139342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2961e-4787-49c6-8f98-06550fe50c15 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:11.139617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2961e-4787-49c6-8f98-06550fe50c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:11.139891 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2961e-4787-49c6-8f98-06550fe50c15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:11.168817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:11.197938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49044b0-faad-498b-8540-2e1790fc054f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:11.199329 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49044b0-faad-498b-8540-2e1790fc054f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:11.206871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2961e-4787-49c6-8f98-06550fe50c15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:11.208340 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2961e-4787-49c6-8f98-06550fe50c15 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:11.299568 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 255/510] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:11.300415 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49044b0-faad-498b-8540-2e1790fc054f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:11.314779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 256/511] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:11.315734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2961e-4787-49c6-8f98-06550fe50c15 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:11.320625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:11.378887 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:11.401865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49044b0-faad-498b-8540-2e1790fc054f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:11.417892 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2961e-4787-49c6-8f98-06550fe50c15 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:11.436064 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dddd4-97b1-411b-b553-34bfd87273d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:11.436709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dddd4-97b1-411b-b553-34bfd87273d3 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:11.436996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dddd4-97b1-411b-b553-34bfd87273d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:11.437283 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dddd4-97b1-411b-b553-34bfd87273d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:11.444519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dddd4-97b1-411b-b553-34bfd87273d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:11.446016 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dddd4-97b1-411b-b553-34bfd87273d3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:11.451022 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af4819-6635-47de-8c40-62b63b8f248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:11.451584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af4819-6635-47de-8c40-62b63b8f248e None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:11.451865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af4819-6635-47de-8c40-62b63b8f248e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:11.452140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af4819-6635-47de-8c40-62b63b8f248e None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:11.452829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af4819-6635-47de-8c40-62b63b8f248e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:11.453132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af4819-6635-47de-8c40-62b63b8f248e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:11.454507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af4819-6635-47de-8c40-62b63b8f248e None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:11.457585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-432dddd4-97b1-411b-b553-34bfd87273d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:13:11.457585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:11.457585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:11.457585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:11.457585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:11.457585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:11.457585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:11.457585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:11.457585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:11.457585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:11.457585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:11.457585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:11.457585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:11.457585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:11.457585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:11.457585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:11.458607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:11.460200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:11.460200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:11.460200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:11.460200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:11.460200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:11.460200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:11.460200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:11.460200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:11.460200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:13:11.460200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:11.460200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 256/512] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:13:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:11.460200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dddd4-97b1-411b-b553-34bfd87273d3 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:11.470399 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 257/513] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:11.470399 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af4819-6635-47de-8c40-62b63b8f248e None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:11.541601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:11.562674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dddd4-97b1-411b-b553-34bfd87273d3 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:11.569655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af4819-6635-47de-8c40-62b63b8f248e None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:11.592070 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:11.598236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c263e39-75ac-4c54-a44c-4dab952087ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:11.598885 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c263e39-75ac-4c54-a44c-4dab952087ba None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:11.599169 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c263e39-75ac-4c54-a44c-4dab952087ba None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:11.599452 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c263e39-75ac-4c54-a44c-4dab952087ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:11.603559 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529e24b-c085-40be-a37f-f6c9f70e614f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:11.604192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529e24b-c085-40be-a37f-f6c9f70e614f None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:11.605594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529e24b-c085-40be-a37f-f6c9f70e614f None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:11.605594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529e24b-c085-40be-a37f-f6c9f70e614f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:11.610955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c263e39-75ac-4c54-a44c-4dab952087ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:11.612410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c263e39-75ac-4c54-a44c-4dab952087ba None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:11.615127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529e24b-c085-40be-a37f-f6c9f70e614f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:11.617551 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529e24b-c085-40be-a37f-f6c9f70e614f None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:11.627475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-8c263e39-75ac-4c54-a44c-4dab952087ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:11.627475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:11.627475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:11.627475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:11.627475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:11.627475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:11.627475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:11.627475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:11.627475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:11.627475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:11.627475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:11.627475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:11.627475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:11.627475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:11.627475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:11.628481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:11.629574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:11.629574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:11.629574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:11.629574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:11.629574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 257/514] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:11.629847 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c263e39-75ac-4c54-a44c-4dab952087ba None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:11.632314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-0529e24b-c085-40be-a37f-f6c9f70e614f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:11.632314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:11.632314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:11.632314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:11.632314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:11.632314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:11.632314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:11.632314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:11.632314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:11.632314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:11.632314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:11.632314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:11.632314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:11.632314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:11.632314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:11.633081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:11.634233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:11.634233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:11.634233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:11.634233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:11.634233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 258/515] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:11.634547 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529e24b-c085-40be-a37f-f6c9f70e614f None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:11.732862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529e24b-c085-40be-a37f-f6c9f70e614f None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:11.733059 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c263e39-75ac-4c54-a44c-4dab952087ba None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:11.760923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:11.766558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1aa3de-c918-4c86-a10d-5c5dbce4bad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:11.767204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1aa3de-c918-4c86-a10d-5c5dbce4bad3 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:11.771980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1aa3de-c918-4c86-a10d-5c5dbce4bad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:11.772081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d05723-d2c2-4982-82c3-8e99cde247f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:11.772181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1aa3de-c918-4c86-a10d-5c5dbce4bad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:11.772264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d05723-d2c2-4982-82c3-8e99cde247f7 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:11.772264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d05723-d2c2-4982-82c3-8e99cde247f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:11.772264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d05723-d2c2-4982-82c3-8e99cde247f7 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:11.772264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d05723-d2c2-4982-82c3-8e99cde247f7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:11.772264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d05723-d2c2-4982-82c3-8e99cde247f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:11.772264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d05723-d2c2-4982-82c3-8e99cde247f7 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:11.778077 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1aa3de-c918-4c86-a10d-5c5dbce4bad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:11.779513 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1aa3de-c918-4c86-a10d-5c5dbce4bad3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:11.788631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 259/516] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jul 28 05:13:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:11.789453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d05723-d2c2-4982-82c3-8e99cde247f7 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:11.794741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-7d1aa3de-c918-4c86-a10d-5c5dbce4bad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:11.794741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:11.794741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:11.794741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:11.794741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:11.794741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:11.794741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:11.794741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:11.794741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:11.794741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:11.794741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:11.794741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:11.794741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:11.794741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:11.794741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:11.795772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:11.796666 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:11.796666 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:11.796666 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:11.796666 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:11.796666 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 258/517] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:11.797198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1aa3de-c918-4c86-a10d-5c5dbce4bad3 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:11.820144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:11.889678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d05723-d2c2-4982-82c3-8e99cde247f7 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:11.899312 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1aa3de-c918-4c86-a10d-5c5dbce4bad3 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:11.924124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a16304-c390-494e-9c22-aaa4a30592fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:11.924741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a16304-c390-494e-9c22-aaa4a30592fd None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:11.925018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a16304-c390-494e-9c22-aaa4a30592fd None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:11.925297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a16304-c390-494e-9c22-aaa4a30592fd None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:11.926016 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a16304-c390-494e-9c22-aaa4a30592fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:11.927469 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a16304-c390-494e-9c22-aaa4a30592fd None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:11.933232 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f809a26-e498-40da-af99-6cf3bec80053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:11.933886 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809a26-e498-40da-af99-6cf3bec80053 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:11.934170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809a26-e498-40da-af99-6cf3bec80053 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:11.934450 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809a26-e498-40da-af99-6cf3bec80053 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:11.935138 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f809a26-e498-40da-af99-6cf3bec80053 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:11.935449 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f809a26-e498-40da-af99-6cf3bec80053 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:11.936816 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f809a26-e498-40da-af99-6cf3bec80053 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:11.949344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 259/518] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:11.951226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f809a26-e498-40da-af99-6cf3bec80053 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:11.992305 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:12.001936 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 260/519] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:13:11 2022] POST /identity/v3/users => generated 247 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:13:12.002834 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a16304-c390-494e-9c22-aaa4a30592fd None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:12.057559 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f809a26-e498-40da-af99-6cf3bec80053 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:12.097556 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54b764-319e-48cb-8497-1c1d9c98a165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:12.098168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54b764-319e-48cb-8497-1c1d9c98a165 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:12.098454 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54b764-319e-48cb-8497-1c1d9c98a165 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:12.098732 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54b764-319e-48cb-8497-1c1d9c98a165 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:12.099484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54b764-319e-48cb-8497-1c1d9c98a165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:12.099823 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54b764-319e-48cb-8497-1c1d9c98a165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:12.101670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54b764-319e-48cb-8497-1c1d9c98a165 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:12.114405 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 260/520] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:12.115297 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54b764-319e-48cb-8497-1c1d9c98a165 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:12.127454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:12.143929 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a16304-c390-494e-9c22-aaa4a30592fd None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:12.185609 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775bb2e-a5e9-47db-ae1e-c9dff0bed69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:12.185813 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775bb2e-a5e9-47db-ae1e-c9dff0bed69e None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:12.186106 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775bb2e-a5e9-47db-ae1e-c9dff0bed69e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:12.186592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775bb2e-a5e9-47db-ae1e-c9dff0bed69e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:12.232224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54b764-319e-48cb-8497-1c1d9c98a165 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:12.233937 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:12.269164 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9b0b7-fddb-4b96-a0b1-ce116dbf4736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:12.269823 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9b0b7-fddb-4b96-a0b1-ce116dbf4736 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:12.270099 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9b0b7-fddb-4b96-a0b1-ce116dbf4736 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:12.270376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9b0b7-fddb-4b96-a0b1-ce116dbf4736 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:12.271124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9b0b7-fddb-4b96-a0b1-ce116dbf4736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:12.271435 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9b0b7-fddb-4b96-a0b1-ce116dbf4736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:12.273353 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9b0b7-fddb-4b96-a0b1-ce116dbf4736 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:12.276599 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775bb2e-a5e9-47db-ae1e-c9dff0bed69e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:12.278090 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775bb2e-a5e9-47db-ae1e-c9dff0bed69e None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:12.291690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 261/521] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:12.291690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9b0b7-fddb-4b96-a0b1-ce116dbf4736 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:12.375541 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:12.389906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 261/522] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:12.391082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775bb2e-a5e9-47db-ae1e-c9dff0bed69e None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:12.403206 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9b0b7-fddb-4b96-a0b1-ce116dbf4736 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:12.440533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051ca96-ef0f-41d2-9d4c-5593efdea7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:12.441598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051ca96-ef0f-41d2-9d4c-5593efdea7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:12.442058 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051ca96-ef0f-41d2-9d4c-5593efdea7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:12.442535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051ca96-ef0f-41d2-9d4c-5593efdea7e6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:12.451265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051ca96-ef0f-41d2-9d4c-5593efdea7e6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:12.453145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051ca96-ef0f-41d2-9d4c-5593efdea7e6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:12.469030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-0051ca96-ef0f-41d2-9d4c-5593efdea7e6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:13:12.469030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:12.469030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:12.469030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:12.469030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:12.469030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:12.469030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:12.469030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:12.469030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:12.469030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:12.469030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:12.469030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:12.469030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:12.469030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:12.469030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:12.469030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:12.470338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:12.471202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:12.471202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:12.471202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:12.471202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:12.471202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:12.471202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:12.471202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:12.471202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:12.471202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:13:12.471202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:12.472345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 262/523] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:12.473187 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051ca96-ef0f-41d2-9d4c-5593efdea7e6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:12.497605 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775bb2e-a5e9-47db-ae1e-c9dff0bed69e None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:12.497794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:12.537929 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb2da0-b0db-4e59-9caa-9c24a18704d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:12.538529 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb2da0-b0db-4e59-9caa-9c24a18704d1 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:12.538839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb2da0-b0db-4e59-9caa-9c24a18704d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:12.539072 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb2da0-b0db-4e59-9caa-9c24a18704d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:12.545871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb2da0-b0db-4e59-9caa-9c24a18704d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:12.547298 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb2da0-b0db-4e59-9caa-9c24a18704d1 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:12.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-1dcb2da0-b0db-4e59-9caa-9c24a18704d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:12.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:12.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:12.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:12.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:12.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:12.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:12.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:12.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:12.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:12.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:12.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:12.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:12.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:12.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:12.560212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:12.561750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:12.561750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:12.561750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:12.561750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:12.561750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:12.561750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:12.561750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:12.561750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:12.561750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 262/524] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:12.561750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb2da0-b0db-4e59-9caa-9c24a18704d1 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:12.587331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051ca96-ef0f-41d2-9d4c-5593efdea7e6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:12.622431 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:12.622825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e5682-3b29-4625-aab3-8a6a1f48e2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:12.623484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e5682-3b29-4625-aab3-8a6a1f48e2da None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:12.624117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e5682-3b29-4625-aab3-8a6a1f48e2da None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:12.624481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e5682-3b29-4625-aab3-8a6a1f48e2da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:12.632393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e5682-3b29-4625-aab3-8a6a1f48e2da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:12.633899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e5682-3b29-4625-aab3-8a6a1f48e2da None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:12.646316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-4e5e5682-3b29-4625-aab3-8a6a1f48e2da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:12.646316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:12.646316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:12.646316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:12.646316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:12.646316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:12.646316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:12.646316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:12.646316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:12.646316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:12.646316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:12.646316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:12.646316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:12.646316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:12.646316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:12.647269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:12.653158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:12.653158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:12.653158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:12.653158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:12.653158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:12.653158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:12.653158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:12.653158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:12.653158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 263/525] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:12.653158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e5682-3b29-4625-aab3-8a6a1f48e2da None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:12.682384 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb2da0-b0db-4e59-9caa-9c24a18704d1 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:12.719801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42accf1-a757-47be-a532-975aa340fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:12.720443 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42accf1-a757-47be-a532-975aa340fe7c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:12.720721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42accf1-a757-47be-a532-975aa340fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:12.720988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42accf1-a757-47be-a532-975aa340fe7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:12.733374 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42accf1-a757-47be-a532-975aa340fe7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:12.734847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42accf1-a757-47be-a532-975aa340fe7c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:12.743482 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:12.750063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-a42accf1-a757-47be-a532-975aa340fe7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:12.750063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:12.750063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:12.750063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:12.750063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:12.750063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:12.750063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:12.750063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:12.750063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:12.750063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:12.750063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:12.750063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:12.750063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:12.750063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:12.750063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:12.750926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:12.751751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:12.751751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:12.751751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:12.751751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:12.751751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 263/526] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:12.752034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42accf1-a757-47be-a532-975aa340fe7c None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:12.764589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e5682-3b29-4625-aab3-8a6a1f48e2da None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:12.803418 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85481502-7b7b-4233-9bba-d26b320f268f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:12.804054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85481502-7b7b-4233-9bba-d26b320f268f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:12.804346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85481502-7b7b-4233-9bba-d26b320f268f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:12.804624 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85481502-7b7b-4233-9bba-d26b320f268f None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:12.805423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85481502-7b7b-4233-9bba-d26b320f268f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:12.805763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85481502-7b7b-4233-9bba-d26b320f268f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:12.807284 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85481502-7b7b-4233-9bba-d26b320f268f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:12.829589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 264/527] 10.222.0.33 () {56 vars in 1139 bytes} [Thu Jul 28 05:13:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:12.829589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85481502-7b7b-4233-9bba-d26b320f268f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:12.865550 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:12.869275 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42accf1-a757-47be-a532-975aa340fe7c None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:12.905424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc084d9-11cb-427f-b2dc-3bad4d63157e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:12.906053 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc084d9-11cb-427f-b2dc-3bad4d63157e None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:12.906317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc084d9-11cb-427f-b2dc-3bad4d63157e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:12.906586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc084d9-11cb-427f-b2dc-3bad4d63157e None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:12.907333 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc084d9-11cb-427f-b2dc-3bad4d63157e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:12.907636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc084d9-11cb-427f-b2dc-3bad4d63157e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:12.909060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc084d9-11cb-427f-b2dc-3bad4d63157e None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:12.927872 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 264/528] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:12.928790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc084d9-11cb-427f-b2dc-3bad4d63157e None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:12.938380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85481502-7b7b-4233-9bba-d26b320f268f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:12.975026 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c5cb4-5ad5-4612-8a7d-761fa4e65408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:12.976171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c5cb4-5ad5-4612-8a7d-761fa4e65408 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:12.976454 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c5cb4-5ad5-4612-8a7d-761fa4e65408 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:12.976758 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c5cb4-5ad5-4612-8a7d-761fa4e65408 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:12.977786 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c5cb4-5ad5-4612-8a7d-761fa4e65408 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:12.977786 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c5cb4-5ad5-4612-8a7d-761fa4e65408 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:12.979229 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c5cb4-5ad5-4612-8a7d-761fa4e65408 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:12.994076 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:13.002486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 265/529] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:13.002486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c5cb4-5ad5-4612-8a7d-761fa4e65408 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:13.033127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc084d9-11cb-427f-b2dc-3bad4d63157e None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:13.070805 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace8c13-ca9e-4bca-bf94-0ba397942572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:13.071354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace8c13-ca9e-4bca-bf94-0ba397942572 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:13.071635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace8c13-ca9e-4bca-bf94-0ba397942572 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:13.071910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace8c13-ca9e-4bca-bf94-0ba397942572 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:13.072600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace8c13-ca9e-4bca-bf94-0ba397942572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:13.073061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace8c13-ca9e-4bca-bf94-0ba397942572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:13.074295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace8c13-ca9e-4bca-bf94-0ba397942572 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:13.086488 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 265/530] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:13.087188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace8c13-ca9e-4bca-bf94-0ba397942572 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:13.110464 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:13.118185 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c5cb4-5ad5-4612-8a7d-761fa4e65408 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:13.155064 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b507ddf-b48f-450e-8245-dade69e049e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:13.155719 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b507ddf-b48f-450e-8245-dade69e049e0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:13.156000 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b507ddf-b48f-450e-8245-dade69e049e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:13.156284 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b507ddf-b48f-450e-8245-dade69e049e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:13.196536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace8c13-ca9e-4bca-bf94-0ba397942572 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:13.231461 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:13.233458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b507ddf-b48f-450e-8245-dade69e049e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:13.233604 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b79a8-d7e0-4633-9e11-ae8f441f1eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:13.234223 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b79a8-d7e0-4633-9e11-ae8f441f1eab None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:13.234503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b79a8-d7e0-4633-9e11-ae8f441f1eab None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:13.234779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b79a8-d7e0-4633-9e11-ae8f441f1eab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:13.234931 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b507ddf-b48f-450e-8245-dade69e049e0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:13.235571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b79a8-d7e0-4633-9e11-ae8f441f1eab None admin] RBAC: Adding query filter params (role.id=04fcac2c505f40a89923fa2f26cf548c, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=99d8c709e6f4462c98c055cb03eebf42) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:13.235881 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b79a8-d7e0-4633-9e11-ae8f441f1eab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:13.238096 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b79a8-d7e0-4633-9e11-ae8f441f1eab None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:13.243336 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 266/531] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:13 2022] GET /identity/v3/role_assignments?user.id=99d8c709e6f4462c98c055cb03eebf42&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=04fcac2c505f40a89923fa2f26cf548c => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:13.253451 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b79a8-d7e0-4633-9e11-ae8f441f1eab None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:13.364966 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:13.375553 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 266/532] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:13.377286 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b507ddf-b48f-450e-8245-dade69e049e0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:13.383424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b79a8-d7e0-4633-9e11-ae8f441f1eab None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:13.430108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9497f-4af0-4168-aedd-4feb02a91e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:13.430792 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9497f-4af0-4168-aedd-4feb02a91e0e None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:13.431517 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9497f-4af0-4168-aedd-4feb02a91e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:13.431838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9497f-4af0-4168-aedd-4feb02a91e0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:13.433052 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9497f-4af0-4168-aedd-4feb02a91e0e None admin] RBAC: Adding query filter params (role.id=04fcac2c505f40a89923fa2f26cf548c, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=628ef75fa7194253bcf6cd6c85211738) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:13.433539 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9497f-4af0-4168-aedd-4feb02a91e0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:13.435348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9497f-4af0-4168-aedd-4feb02a91e0e None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:13.443129 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 267/533] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:13 2022] GET /identity/v3/role_assignments?user.id=628ef75fa7194253bcf6cd6c85211738&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=04fcac2c505f40a89923fa2f26cf548c => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:13.445683 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9497f-4af0-4168-aedd-4feb02a91e0e None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:13.509319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:13.517292 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b507ddf-b48f-450e-8245-dade69e049e0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:13.601263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286071f-0fb8-458a-90a6-70b39387bd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:13.602259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286071f-0fb8-458a-90a6-70b39387bd41 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:13.602544 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286071f-0fb8-458a-90a6-70b39387bd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:13.602817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286071f-0fb8-458a-90a6-70b39387bd41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:13.618716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286071f-0fb8-458a-90a6-70b39387bd41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:13.620122 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286071f-0fb8-458a-90a6-70b39387bd41 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:13.636323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9497f-4af0-4168-aedd-4feb02a91e0e None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:13.643644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-7286071f-0fb8-458a-90a6-70b39387bd41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:13.643644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:13.643644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:13.643644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:13.643644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:13.643644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:13.643644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:13.643644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:13.643644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:13.643644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:13.643644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:13.643644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:13.643644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:13.643644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:13.643644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:13.644486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:13.645339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:13.645339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:13.645339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:13.645339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:13.645339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:13.645339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:13.645339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:13.645339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:13.650105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 267/534] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:13.655814 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286071f-0fb8-458a-90a6-70b39387bd41 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:13.694440 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f62f61-661a-4811-9324-51a232271bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:13.695101 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f62f61-661a-4811-9324-51a232271bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:13.695385 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f62f61-661a-4811-9324-51a232271bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:13.695663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f62f61-661a-4811-9324-51a232271bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:13.712407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f62f61-661a-4811-9324-51a232271bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:13.713930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f62f61-661a-4811-9324-51a232271bc4 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:13.735737 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:13.744668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-85f62f61-661a-4811-9324-51a232271bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:13.744668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:13.744668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:13.744668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:13.744668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:13.744668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:13.744668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:13.744668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:13.744668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:13.744668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:13.744668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:13.744668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:13.744668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:13.744668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:13.744668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:13.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:13.754880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:13.754880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:13.754880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:13.754880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:13.754880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 268/535] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:13.758152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f62f61-661a-4811-9324-51a232271bc4 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:13.849207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286071f-0fb8-458a-90a6-70b39387bd41 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:13.875165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f62f61-661a-4811-9324-51a232271bc4 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:13.914909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b2fe1-97e4-44c2-8da1-680934049622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:13.915993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b2fe1-97e4-44c2-8da1-680934049622 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:13.916100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7e421-55fd-415d-85de-2e0d63503918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:13.916644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7e421-55fd-415d-85de-2e0d63503918 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:13.916933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7e421-55fd-415d-85de-2e0d63503918 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:13.917213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7e421-55fd-415d-85de-2e0d63503918 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:13.917561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b2fe1-97e4-44c2-8da1-680934049622 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:13.917959 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7e421-55fd-415d-85de-2e0d63503918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:13.918228 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b2fe1-97e4-44c2-8da1-680934049622 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:13.918341 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7e421-55fd-415d-85de-2e0d63503918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:13.919276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b2fe1-97e4-44c2-8da1-680934049622 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:13.919635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7e421-55fd-415d-85de-2e0d63503918 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:13.919993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b2fe1-97e4-44c2-8da1-680934049622 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:13.921749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b2fe1-97e4-44c2-8da1-680934049622 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:13.933092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 269/536] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:13.938872 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7e421-55fd-415d-85de-2e0d63503918 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:13.947545 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 268/537] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:13.954553 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b2fe1-97e4-44c2-8da1-680934049622 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:14.001235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:14.076383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:14.116485 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b2fe1-97e4-44c2-8da1-680934049622 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:14.140413 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7e421-55fd-415d-85de-2e0d63503918 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:14.160490 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbf773-3d1f-4496-95ec-1e51a7e0c0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:14.161115 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbf773-3d1f-4496-95ec-1e51a7e0c0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:14.161942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbf773-3d1f-4496-95ec-1e51a7e0c0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:14.162227 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbf773-3d1f-4496-95ec-1e51a7e0c0e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:14.163326 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbf773-3d1f-4496-95ec-1e51a7e0c0e7 None admin] RBAC: Adding query filter params (role.id=04fcac2c505f40a89923fa2f26cf548c, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=bae981c7273843d4ac734dd876bebe5f) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:14.163642 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbf773-3d1f-4496-95ec-1e51a7e0c0e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:14.165793 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbf773-3d1f-4496-95ec-1e51a7e0c0e7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:14.173695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 269/538] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:13 2022] GET /identity/v3/role_assignments?user.id=bae981c7273843d4ac734dd876bebe5f&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=04fcac2c505f40a89923fa2f26cf548c => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:14.174900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f38b0-5d41-4660-8fb4-e445edd05545 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:14.175188 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f38b0-5d41-4660-8fb4-e445edd05545 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:14.175468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f38b0-5d41-4660-8fb4-e445edd05545 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:14.176956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 270/539] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:14.180728 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493342d8-4fcc-461f-9b94-2cd8fe3ad375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:14.181402 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493342d8-4fcc-461f-9b94-2cd8fe3ad375 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:14.181731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493342d8-4fcc-461f-9b94-2cd8fe3ad375 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:14.182006 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493342d8-4fcc-461f-9b94-2cd8fe3ad375 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:14.190183 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493342d8-4fcc-461f-9b94-2cd8fe3ad375 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:14.191664 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493342d8-4fcc-461f-9b94-2cd8fe3ad375 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:14.197595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d6824-af4f-4173-b210-a95aa62b21b3 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:14.197883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d6824-af4f-4173-b210-a95aa62b21b3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:14.198152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d6824-af4f-4173-b210-a95aa62b21b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:14.220129 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d99d6824-af4f-4173-b210-a95aa62b21b3 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:14.221354 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d99d6824-af4f-4173-b210-a95aa62b21b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:14.224703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-493342d8-4fcc-461f-9b94-2cd8fe3ad375 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:14.224703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:14.224703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:14.224703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:14.224703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:14.224703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:14.224703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:14.224703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:14.224703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:14.224703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:14.224703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:14.224703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:14.224703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:14.224703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:14.224703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:14.226265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:14.227102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:14.227102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:14.227102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:14.227102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:14.227102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:14.227102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:14.227102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:14.227102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:14.237968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 270/540] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:14.244260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493342d8-4fcc-461f-9b94-2cd8fe3ad375 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:14.302277 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 271/541] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:13:14.353117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d6824-af4f-4173-b210-a95aa62b21b3 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:14.375370 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:14.434807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493342d8-4fcc-461f-9b94-2cd8fe3ad375 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:14.473724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:14.491270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d6824-af4f-4173-b210-a95aa62b21b3 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:14.501596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f73d7-9ba1-4c00-922d-46f57cc9d820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:14.502237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f73d7-9ba1-4c00-922d-46f57cc9d820 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:14.502510 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f73d7-9ba1-4c00-922d-46f57cc9d820 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:14.502779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f73d7-9ba1-4c00-922d-46f57cc9d820 None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:14.503649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f73d7-9ba1-4c00-922d-46f57cc9d820 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:14.503955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f73d7-9ba1-4c00-922d-46f57cc9d820 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:14.505751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f73d7-9ba1-4c00-922d-46f57cc9d820 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:14.532482 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c5c41-fe39-49b9-8cab-59fe6ed72f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:14.533418 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c5c41-fe39-49b9-8cab-59fe6ed72f00 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:14.533806 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c5c41-fe39-49b9-8cab-59fe6ed72f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:14.534085 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c5c41-fe39-49b9-8cab-59fe6ed72f00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:14.535618 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 271/542] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:14.541772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f73d7-9ba1-4c00-922d-46f57cc9d820 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:14.549872 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c5c41-fe39-49b9-8cab-59fe6ed72f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:14.561323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c57c5c41-fe39-49b9-8cab-59fe6ed72f00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:14.561323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:14.561323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:14.561323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:14.561323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:14.561323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:14.561323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:14.561323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:14.561323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:14.561323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:14.561323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:14.561323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:14.561323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:14.561323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:14.561323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:14.561323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:14.562869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:14.562869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:14.562869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:14.562869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:14.562869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:14.562869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:14.562869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:14.562869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:14.562869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:14.562869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:14.562869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:14.562869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:14.562869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:14.562869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:14.562869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:14.562869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:14.563915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:14.563915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:14.563915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:14.563915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:14.563915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:14.563915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:14.563915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:14.563915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:14.563915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:14.563915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:14.563915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:14.563915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:14.563915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 272/543] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:14.569161 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c5c41-fe39-49b9-8cab-59fe6ed72f00 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:14.677607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:14.707636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c5c41-fe39-49b9-8cab-59fe6ed72f00 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:14.747763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6e518-6120-4ca6-904f-63c1153e3545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:14.748360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6e518-6120-4ca6-904f-63c1153e3545 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:14.748642 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6e518-6120-4ca6-904f-63c1153e3545 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:14.748923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6e518-6120-4ca6-904f-63c1153e3545 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:14.749678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6e518-6120-4ca6-904f-63c1153e3545 None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:14.749990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6e518-6120-4ca6-904f-63c1153e3545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:14.751368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6e518-6120-4ca6-904f-63c1153e3545 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:14.760120 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 273/544] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:14.765313 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6e518-6120-4ca6-904f-63c1153e3545 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:14.767496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f73d7-9ba1-4c00-922d-46f57cc9d820 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:14.832775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97791c5-ad81-4e74-9a4e-3500a9827c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:14.833396 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97791c5-ad81-4e74-9a4e-3500a9827c8d None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:14.833710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97791c5-ad81-4e74-9a4e-3500a9827c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:14.833985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97791c5-ad81-4e74-9a4e-3500a9827c8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:14.835534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97791c5-ad81-4e74-9a4e-3500a9827c8d None admin] RBAC: Adding query filter params (role.id=04fcac2c505f40a89923fa2f26cf548c, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=6907d8a429404b1c92805b364900ba60) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:14.835747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97791c5-ad81-4e74-9a4e-3500a9827c8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:14.837341 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97791c5-ad81-4e74-9a4e-3500a9827c8d None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:14.850905 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 272/545] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:14 2022] GET /identity/v3/role_assignments?user.id=6907d8a429404b1c92805b364900ba60&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=04fcac2c505f40a89923fa2f26cf548c => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:14.911808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6e518-6120-4ca6-904f-63c1153e3545 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:14.956146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e45b6-b525-442d-833d-93351aaaf45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:14.956927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e45b6-b525-442d-833d-93351aaaf45f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:14.957114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e45b6-b525-442d-833d-93351aaaf45f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:14.957392 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e45b6-b525-442d-833d-93351aaaf45f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:14.962670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:14.974754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e45b6-b525-442d-833d-93351aaaf45f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:14.977293 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e45b6-b525-442d-833d-93351aaaf45f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:14.998616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c48e45b6-b525-442d-833d-93351aaaf45f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:14.998616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:14.998616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:14.998616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:14.998616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:14.998616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:14.998616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:14.998616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:14.998616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:14.998616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:14.998616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:14.998616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:14.998616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:14.998616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:14.998616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:14.999528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:15.000436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:15.000436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:15.000436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:15.000436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:15.000436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 274/546] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:15.005854 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97791c5-ad81-4e74-9a4e-3500a9827c8d None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:15.076041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:15.160437 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97791c5-ad81-4e74-9a4e-3500a9827c8d None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:15.210865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82719270-7cfc-4b1e-80a9-69762380db4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:15.211862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82719270-7cfc-4b1e-80a9-69762380db4a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:15.212348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82719270-7cfc-4b1e-80a9-69762380db4a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:15.212879 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82719270-7cfc-4b1e-80a9-69762380db4a None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:15.213805 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82719270-7cfc-4b1e-80a9-69762380db4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:15.214328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82719270-7cfc-4b1e-80a9-69762380db4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:15.215898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82719270-7cfc-4b1e-80a9-69762380db4a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:15.228907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 273/547] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:15.234474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e45b6-b525-442d-833d-93351aaaf45f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:15.356088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e45b6-b525-442d-833d-93351aaaf45f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:15.391911 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1336ed-a6a8-4990-bf81-38d972dd71d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:15.392988 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1336ed-a6a8-4990-bf81-38d972dd71d4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:15.393504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1336ed-a6a8-4990-bf81-38d972dd71d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:15.393991 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1336ed-a6a8-4990-bf81-38d972dd71d4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:15.402744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1336ed-a6a8-4990-bf81-38d972dd71d4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:15.404448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1336ed-a6a8-4990-bf81-38d972dd71d4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:15.416633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-0f1336ed-a6a8-4990-bf81-38d972dd71d4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:13:15.416633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:15.416633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:15.416633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:15.416633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:15.416633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:15.416633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:15.416633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:15.416633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:15.416633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:15.416633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:15.416633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:15.416633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:15.416633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:15.416633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:15.416633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:15.417770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:15.418653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:15.418653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:15.418653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:15.418653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:15.418653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:15.418653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:15.418653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:15.418653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:15.418653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:13:15.418653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:15.425400 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 275/548] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:13:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:15.427046 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82719270-7cfc-4b1e-80a9-69762380db4a None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:15.566699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82719270-7cfc-4b1e-80a9-69762380db4a None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:15.569262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:15.616125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4401a-f410-4b38-a287-00465359ed9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:15.616760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4401a-f410-4b38-a287-00465359ed9a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:15.617040 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4401a-f410-4b38-a287-00465359ed9a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:15.617314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4401a-f410-4b38-a287-00465359ed9a None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:15.618214 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4401a-f410-4b38-a287-00465359ed9a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:15.618521 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4401a-f410-4b38-a287-00465359ed9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:15.619990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4401a-f410-4b38-a287-00465359ed9a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:15.639699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 274/549] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jul 28 05:13:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:15.645340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1336ed-a6a8-4990-bf81-38d972dd71d4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:15.689284 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2d2ce-2c41-4377-b159-c0f7d2eb7183 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:15.689633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2d2ce-2c41-4377-b159-c0f7d2eb7183 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:15.689889 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2d2ce-2c41-4377-b159-c0f7d2eb7183 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:15.691379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 275/550] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:15.698556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4a817-fad6-4c88-a20b-f0100a3b0853 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:15.698846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4a817-fad6-4c88-a20b-f0100a3b0853 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:15.699128 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4a817-fad6-4c88-a20b-f0100a3b0853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:15.717441 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:15.726736 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e8e4a817-fad6-4c88-a20b-f0100a3b0853 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:15.727899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e8e4a817-fad6-4c88-a20b-f0100a3b0853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:15.773390 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1336ed-a6a8-4990-bf81-38d972dd71d4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:15.817683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08084b78-ffae-43db-b8ff-3d0d5aae6a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:15.818806 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08084b78-ffae-43db-b8ff-3d0d5aae6a00 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:15.819428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08084b78-ffae-43db-b8ff-3d0d5aae6a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:15.819897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08084b78-ffae-43db-b8ff-3d0d5aae6a00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:15.841730 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 276/551] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:13:15.882178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4a817-fad6-4c88-a20b-f0100a3b0853 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:15.936694 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08084b78-ffae-43db-b8ff-3d0d5aae6a00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:15.938833 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08084b78-ffae-43db-b8ff-3d0d5aae6a00 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:15.997448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:16.041110 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:16.052146 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4a817-fad6-4c88-a20b-f0100a3b0853 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:16.074640 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 276/552] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:16.074961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b0b4e-28fb-4b44-b6f6-660d81d993df None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:16.075166 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b0b4e-28fb-4b44-b6f6-660d81d993df None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:16.075697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b0b4e-28fb-4b44-b6f6-660d81d993df None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:16.078658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 277/553] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:16.080083 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b0b4e-28fb-4b44-b6f6-660d81d993df None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:16.099522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975945fc-8699-43e7-ba3c-85f79398e4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:16.100300 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975945fc-8699-43e7-ba3c-85f79398e4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:16.100483 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975945fc-8699-43e7-ba3c-85f79398e4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:16.100788 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975945fc-8699-43e7-ba3c-85f79398e4c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:16.111906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975945fc-8699-43e7-ba3c-85f79398e4c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:16.117289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-975945fc-8699-43e7-ba3c-85f79398e4c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:16.117289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:16.117289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:16.117289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:16.117289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:16.117289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:16.117289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:16.117289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:16.117289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:16.117289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:16.117289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:16.117289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:16.117289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:16.117289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:16.117289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:16.117289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:16.118354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:16.118354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:16.118354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:16.118354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:16.118354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:16.118354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:16.118354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:16.118354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:16.118354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:16.118354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:16.118354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:16.118354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:16.118354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:16.118354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:16.118354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:16.118354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:16.119532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:16.119532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:16.119532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:16.119532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:16.119532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:16.119532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:16.119532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:16.119532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:16.119532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:16.119532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:16.119532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:16.119532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:16.123335 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 277/554] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:16.124770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d082aab-d331-4a54-8a50-8ca204c175eb None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:16.125058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d082aab-d331-4a54-8a50-8ca204c175eb None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:16.125340 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d082aab-d331-4a54-8a50-8ca204c175eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:16.145660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-5d082aab-d331-4a54-8a50-8ca204c175eb None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:16.147581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5d082aab-d331-4a54-8a50-8ca204c175eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:16.221938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b0b4e-28fb-4b44-b6f6-660d81d993df None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:16.229316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 278/555] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:16.230571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d082aab-d331-4a54-8a50-8ca204c175eb None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:16.275401 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db23d51-d2ab-4cb2-aeaa-960c22b2f5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:16.276803 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db23d51-d2ab-4cb2-aeaa-960c22b2f5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:16.277886 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db23d51-d2ab-4cb2-aeaa-960c22b2f5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:16.278536 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db23d51-d2ab-4cb2-aeaa-960c22b2f5a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:16.295561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db23d51-d2ab-4cb2-aeaa-960c22b2f5a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:16.297803 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db23d51-d2ab-4cb2-aeaa-960c22b2f5a1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:16.309992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:16.321025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-1db23d51-d2ab-4cb2-aeaa-960c22b2f5a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:16.321025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:16.321025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:16.321025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:16.321025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:16.321025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:16.321025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:16.321025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:16.321025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:16.321025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:16.321025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:16.321025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:16.321025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:16.321025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:16.321025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:16.322154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:16.323239 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:16.323239 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:16.323239 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:16.323239 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:16.329963 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 278/556] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:16.330687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db23d51-d2ab-4cb2-aeaa-960c22b2f5a1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:16.353835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:16.380631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d082aab-d331-4a54-8a50-8ca204c175eb None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:16.427012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d983c7-aa3a-4087-bd2f-d3f558e9294b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:16.429088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d983c7-aa3a-4087-bd2f-d3f558e9294b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:16.429619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d983c7-aa3a-4087-bd2f-d3f558e9294b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:16.430087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d983c7-aa3a-4087-bd2f-d3f558e9294b None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:16.431238 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d983c7-aa3a-4087-bd2f-d3f558e9294b None admin] RBAC: Adding query filter params (name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:16.431981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d983c7-aa3a-4087-bd2f-d3f558e9294b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:16.434262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d983c7-aa3a-4087-bd2f-d3f558e9294b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:16.442003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db23d51-d2ab-4cb2-aeaa-960c22b2f5a1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:16.450945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 279/557] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:16.450945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d983c7-aa3a-4087-bd2f-d3f558e9294b None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:16.487064 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8957dd-d17f-4c6b-8f91-fe1ebeff5e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:16.488750 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8957dd-d17f-4c6b-8f91-fe1ebeff5e40 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:16.489211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8957dd-d17f-4c6b-8f91-fe1ebeff5e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:16.489679 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8957dd-d17f-4c6b-8f91-fe1ebeff5e40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:16.503013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8957dd-d17f-4c6b-8f91-fe1ebeff5e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:16.510473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-6d8957dd-d17f-4c6b-8f91-fe1ebeff5e40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:16.510473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:16.510473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:16.510473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:16.510473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:16.510473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:16.510473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:16.510473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:16.510473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:16.510473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:16.510473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:16.510473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:16.510473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:16.510473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:16.510473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:16.510473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:16.511831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:16.511831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:16.511831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:16.511831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:16.511831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:16.511831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:16.511831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:16.511831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:16.511831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:16.511831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:16.511831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:16.511831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:16.511831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:16.511831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:16.511831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:16.511831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:16.512631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:16.512631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:16.512631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:16.512631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:16.512631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:16.512631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:16.512631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:16.512631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:16.512631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:16.512631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:16.512631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:16.512631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:16.515443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 279/558] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:16.516363 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8957dd-d17f-4c6b-8f91-fe1ebeff5e40 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:16.567179 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d983c7-aa3a-4087-bd2f-d3f558e9294b None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:16.591724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:16.604304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d80ff-33eb-4d91-afed-67b470c5192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:16.604932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d80ff-33eb-4d91-afed-67b470c5192d None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:16.605214 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d80ff-33eb-4d91-afed-67b470c5192d None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:16.605507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d80ff-33eb-4d91-afed-67b470c5192d None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:16.608231 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d80ff-33eb-4d91-afed-67b470c5192d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:16.608231 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d80ff-33eb-4d91-afed-67b470c5192d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:16.608231 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d80ff-33eb-4d91-afed-67b470c5192d None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:16.624812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 280/559] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:16.624812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d80ff-33eb-4d91-afed-67b470c5192d None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:16.626264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:16.644997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8957dd-d17f-4c6b-8f91-fe1ebeff5e40 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:16.685010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec302b9-e143-4d92-afae-c797aa6b9180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:16.685690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec302b9-e143-4d92-afae-c797aa6b9180 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:16.685973 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec302b9-e143-4d92-afae-c797aa6b9180 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:16.686563 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec302b9-e143-4d92-afae-c797aa6b9180 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:16.699271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec302b9-e143-4d92-afae-c797aa6b9180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:16.700716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec302b9-e143-4d92-afae-c797aa6b9180 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:16.715603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-aec302b9-e143-4d92-afae-c797aa6b9180 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:16.715603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:16.715603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:16.715603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:16.715603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:16.715603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:16.715603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:16.715603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:16.715603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:16.715603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:16.715603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:16.715603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:16.715603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:16.715603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:16.715603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:16.717799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:16.718653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:16.718653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:16.718653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:16.718653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:16.718653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 280/560] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:16.718653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef24ddd-5667-486b-aed5-2123b1a3959d None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:16.718653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef24ddd-5667-486b-aed5-2123b1a3959d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:16.718653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef24ddd-5667-486b-aed5-2123b1a3959d None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:16.723864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 281/561] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:16.723864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef24ddd-5667-486b-aed5-2123b1a3959d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:16.738544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d80ff-33eb-4d91-afed-67b470c5192d None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:16.779567 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ded05-55ae-4c90-9226-a61895862475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:16.780207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ded05-55ae-4c90-9226-a61895862475 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:16.780468 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ded05-55ae-4c90-9226-a61895862475 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:16.780745 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ded05-55ae-4c90-9226-a61895862475 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:16.781457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ded05-55ae-4c90-9226-a61895862475 None admin] RBAC: Adding query filter params (name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:16.781791 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ded05-55ae-4c90-9226-a61895862475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:16.783157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ded05-55ae-4c90-9226-a61895862475 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:16.791671 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 281/562] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:16.791671 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ded05-55ae-4c90-9226-a61895862475 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:16.835912 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef24ddd-5667-486b-aed5-2123b1a3959d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:16.851327 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:16.867553 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:16.872878 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0584e0-9bf6-47b9-afd9-8c3ce0b74d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:16.873558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0584e0-9bf6-47b9-afd9-8c3ce0b74d9c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:16.873846 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0584e0-9bf6-47b9-afd9-8c3ce0b74d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:16.874130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0584e0-9bf6-47b9-afd9-8c3ce0b74d9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:16.882583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0584e0-9bf6-47b9-afd9-8c3ce0b74d9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:16.884049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0584e0-9bf6-47b9-afd9-8c3ce0b74d9c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:16.895748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-ed0584e0-9bf6-47b9-afd9-8c3ce0b74d9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:16.895748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:16.895748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:16.895748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:16.895748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:16.895748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:16.895748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:16.895748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:16.895748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:16.895748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:16.895748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:16.895748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:16.895748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:16.895748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:16.895748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:16.896726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:16.898431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:16.898431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:16.898431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:16.898431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:16.898431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:16.898431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:16.898431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:16.898431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:16.901613 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 282/563] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:16.903199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb72e81-c167-4b55-a1be-e023fd67a3d2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:16.903601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb72e81-c167-4b55-a1be-e023fd67a3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:16.903903 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb72e81-c167-4b55-a1be-e023fd67a3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:16.909578 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ded05-55ae-4c90-9226-a61895862475 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:16.921379 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-5fb72e81-c167-4b55-a1be-e023fd67a3d2 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:16.922596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5fb72e81-c167-4b55-a1be-e023fd67a3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:16.947459 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bb94e-0c9d-4b61-818b-fb268e8e06fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:16.948093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bb94e-0c9d-4b61-818b-fb268e8e06fe None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:16.948376 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bb94e-0c9d-4b61-818b-fb268e8e06fe None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:16.948730 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bb94e-0c9d-4b61-818b-fb268e8e06fe None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:16.949346 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bb94e-0c9d-4b61-818b-fb268e8e06fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:16.949683 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bb94e-0c9d-4b61-818b-fb268e8e06fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:16.951270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bb94e-0c9d-4b61-818b-fb268e8e06fe None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:16.968848 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 282/564] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:16.968848 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bb94e-0c9d-4b61-818b-fb268e8e06fe None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:16.999282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 283/565] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:17.008906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb72e81-c167-4b55-a1be-e023fd67a3d2 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:17.074629 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bb94e-0c9d-4b61-818b-fb268e8e06fe None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:17.103086 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:17.111871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cd442-2384-445a-8a07-cfd22a0cb952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:17.112525 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cd442-2384-445a-8a07-cfd22a0cb952 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:17.112814 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cd442-2384-445a-8a07-cfd22a0cb952 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:17.113078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cd442-2384-445a-8a07-cfd22a0cb952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:17.123037 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb72e81-c167-4b55-a1be-e023fd67a3d2 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:17.124583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:17.126634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cd442-2384-445a-8a07-cfd22a0cb952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:17.128107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cd442-2384-445a-8a07-cfd22a0cb952 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:17.150619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-ec8cd442-2384-445a-8a07-cfd22a0cb952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:17.150619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:17.150619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:17.150619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:17.150619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:17.150619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:17.150619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:17.150619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:17.150619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:17.150619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:17.150619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:17.150619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:17.150619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:17.150619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:17.150619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:17.151698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:17.152548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:17.152548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:17.152548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:17.152548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:17.152759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 283/566] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:17.153542 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cd442-2384-445a-8a07-cfd22a0cb952 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:17.162035 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3fb9b-3bd8-48d7-b076-ae23fd220fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:17.162707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3fb9b-3bd8-48d7-b076-ae23fd220fed None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:17.162996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3fb9b-3bd8-48d7-b076-ae23fd220fed None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:17.163275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3fb9b-3bd8-48d7-b076-ae23fd220fed None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:17.164043 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3fb9b-3bd8-48d7-b076-ae23fd220fed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:17.164356 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3fb9b-3bd8-48d7-b076-ae23fd220fed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:17.165817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3fb9b-3bd8-48d7-b076-ae23fd220fed None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:17.177637 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 284/567] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:17.178964 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3fb9b-3bd8-48d7-b076-ae23fd220fed None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:17.265503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cd442-2384-445a-8a07-cfd22a0cb952 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:17.285362 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3fb9b-3bd8-48d7-b076-ae23fd220fed None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:17.300747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e7a6d-9549-4288-80c1-c82f92b324bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:17.301392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e7a6d-9549-4288-80c1-c82f92b324bf None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:17.301708 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e7a6d-9549-4288-80c1-c82f92b324bf None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:17.301985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e7a6d-9549-4288-80c1-c82f92b324bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:17.309802 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e7a6d-9549-4288-80c1-c82f92b324bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:17.311243 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e7a6d-9549-4288-80c1-c82f92b324bf None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:17.322405 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c495ca-79e0-49c6-a2d8-43b9c04e259f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:17.322815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-f29e7a6d-9549-4288-80c1-c82f92b324bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:13:17.322815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:17.322815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:17.322815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:17.322815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:17.322815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:17.322815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:17.322815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:17.322815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:17.322815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:17.322815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:17.322815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:17.322815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:17.322815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:17.322815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:17.322815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:17.323721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:17.324652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:17.324652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:17.324652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:17.324652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:17.324652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:17.324652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:17.324652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:17.324652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:17.324652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:13:17.324652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:17.325205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c495ca-79e0-49c6-a2d8-43b9c04e259f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:17.325205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c495ca-79e0-49c6-a2d8-43b9c04e259f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:17.325205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c495ca-79e0-49c6-a2d8-43b9c04e259f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:17.325392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 284/568] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jul 28 05:13:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:17.325392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e7a6d-9549-4288-80c1-c82f92b324bf None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:17.336678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c495ca-79e0-49c6-a2d8-43b9c04e259f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:17.342063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-a0c495ca-79e0-49c6-a2d8-43b9c04e259f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:17.342063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:17.342063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:17.342063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:17.342063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:17.342063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:17.342063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:17.342063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:17.342063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:17.342063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:17.342063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:17.342063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:17.342063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:17.342063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:17.342063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:17.342063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:17.342955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:17.342955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:17.342955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:17.342955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:17.342955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:17.342955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:17.342955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:17.342955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:17.342955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:17.342955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:17.342955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:17.342955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:17.342955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:17.342955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:17.342955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:17.342955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:17.343800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:17.343800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:17.343800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:17.343800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:17.343800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:17.343800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:17.343800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:17.343800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:17.343800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:17.343800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:17.343800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:17.343800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:17.343800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 285/569] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:17.344468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c495ca-79e0-49c6-a2d8-43b9c04e259f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:17.369027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:17.372985 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:17.427201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e7a6d-9549-4288-80c1-c82f92b324bf None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:17.446785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c495ca-79e0-49c6-a2d8-43b9c04e259f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:17.461508 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560890d6-8f8f-46f6-9b7b-eb956d7eaecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:17.462130 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560890d6-8f8f-46f6-9b7b-eb956d7eaecc None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:17.462416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560890d6-8f8f-46f6-9b7b-eb956d7eaecc None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:17.462692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560890d6-8f8f-46f6-9b7b-eb956d7eaecc None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:17.463377 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560890d6-8f8f-46f6-9b7b-eb956d7eaecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:17.463680 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560890d6-8f8f-46f6-9b7b-eb956d7eaecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:17.465033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560890d6-8f8f-46f6-9b7b-eb956d7eaecc None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:17.477271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 285/570] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:17.478438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3093042-8a73-4ab7-800a-86721e564c4d None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:17.478726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3093042-8a73-4ab7-800a-86721e564c4d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:17.479002 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3093042-8a73-4ab7-800a-86721e564c4d None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:17.480199 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 286/571] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:17.480884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3093042-8a73-4ab7-800a-86721e564c4d None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:17.485337 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07273738-aff5-4de8-9340-ae4d62638847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:17.485997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07273738-aff5-4de8-9340-ae4d62638847 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:17.486280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07273738-aff5-4de8-9340-ae4d62638847 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:17.486559 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07273738-aff5-4de8-9340-ae4d62638847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:17.487384 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07273738-aff5-4de8-9340-ae4d62638847 None admin] RBAC: Adding query filter params (role.id=04fcac2c505f40a89923fa2f26cf548c, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=eb89e2ac885f42eb95fe3b67f3808ba9) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:17.487699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07273738-aff5-4de8-9340-ae4d62638847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:17.489126 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07273738-aff5-4de8-9340-ae4d62638847 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:17.494722 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 286/572] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:17 2022] GET /identity/v3/role_assignments?user.id=eb89e2ac885f42eb95fe3b67f3808ba9&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=04fcac2c505f40a89923fa2f26cf548c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:17.495491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07273738-aff5-4de8-9340-ae4d62638847 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:17.597310 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:17.603113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:17.604463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3093042-8a73-4ab7-800a-86721e564c4d None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:17.626753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07273738-aff5-4de8-9340-ae4d62638847 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:17.643519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7878-000a-4e0b-beae-db530d773d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:17.644148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7878-000a-4e0b-beae-db530d773d56 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:17.644427 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7878-000a-4e0b-beae-db530d773d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:17.645369 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7878-000a-4e0b-beae-db530d773d56 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:17.645557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f7878-000a-4e0b-beae-db530d773d56 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:17.645833 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f7878-000a-4e0b-beae-db530d773d56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:17.647336 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f7878-000a-4e0b-beae-db530d773d56 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:17.659622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6b6e-5dda-4b15-81d0-61ccd5e1eaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:17.660257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6b6e-5dda-4b15-81d0-61ccd5e1eaeb None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:17.660546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6b6e-5dda-4b15-81d0-61ccd5e1eaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:17.660823 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6b6e-5dda-4b15-81d0-61ccd5e1eaeb None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:17.661579 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6b6e-5dda-4b15-81d0-61ccd5e1eaeb None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:17.661891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6b6e-5dda-4b15-81d0-61ccd5e1eaeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:17.664478 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6b6e-5dda-4b15-81d0-61ccd5e1eaeb None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:17.671507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 287/573] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jul 28 05:13:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:17.671507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7878-000a-4e0b-beae-db530d773d56 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:17.673600 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 287/574] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:17.674835 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1130-df11-4988-a608-b8b4ab9c2466 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:17.675128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1130-df11-4988-a608-b8b4ab9c2466 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:17.675407 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1130-df11-4988-a608-b8b4ab9c2466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:17.694679 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-58bf1130-df11-4988-a608-b8b4ab9c2466 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:17.695850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-58bf1130-df11-4988-a608-b8b4ab9c2466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:17.767355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 288/575] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:17.769628 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf1130-df11-4988-a608-b8b4ab9c2466 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:17.795267 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7878-000a-4e0b-beae-db530d773d56 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:17.831537 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b8294-acf6-4831-af10-74f641973a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:17.832369 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b8294-acf6-4831-af10-74f641973a52 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:17.832653 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b8294-acf6-4831-af10-74f641973a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:17.832928 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b8294-acf6-4831-af10-74f641973a52 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:17.841257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b8294-acf6-4831-af10-74f641973a52 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:17.843190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b8294-acf6-4831-af10-74f641973a52 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:17.858018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-040b8294-acf6-4831-af10-74f641973a52 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:13:17.858018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:17.858018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:17.858018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:17.858018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:17.858018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:17.858018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:17.858018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:17.858018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:17.858018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:17.858018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:17.858018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:17.858018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:17.858018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:17.858018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:17.858018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:17.858960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:17.859912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:17.859912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:17.859912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:17.859912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:17.859912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:17.859912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:17.859912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:17.859912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:17.859912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:13:17.859912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:17.859912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 288/576] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:13:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:17.859912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b8294-acf6-4831-af10-74f641973a52 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:17.866858 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:17.878649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:17.891901 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf1130-df11-4988-a608-b8b4ab9c2466 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:17.927887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe3ff5-4126-44f2-bd5b-84629da18140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:17.929378 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe3ff5-4126-44f2-bd5b-84629da18140 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:17.929710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe3ff5-4126-44f2-bd5b-84629da18140 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:17.929991 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe3ff5-4126-44f2-bd5b-84629da18140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:17.941148 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe3ff5-4126-44f2-bd5b-84629da18140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:17.942629 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe3ff5-4126-44f2-bd5b-84629da18140 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:17.958909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-8efe3ff5-4126-44f2-bd5b-84629da18140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:17.958909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:17.958909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:17.958909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:17.958909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:17.958909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:17.958909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:17.958909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:17.958909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:17.958909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:17.958909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:17.958909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:17.958909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:17.958909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:17.958909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:17.960118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:17.961013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:17.961013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:17.961013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:17.961013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:17.961013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 289/577] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:17.961284 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe3ff5-4126-44f2-bd5b-84629da18140 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:17.970232 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b8294-acf6-4831-af10-74f641973a52 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:18.011009 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c7d0d-7194-46e5-9adc-fa0d6a1a9efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:18.011659 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c7d0d-7194-46e5-9adc-fa0d6a1a9efd None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:18.011944 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c7d0d-7194-46e5-9adc-fa0d6a1a9efd None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:18.012217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c7d0d-7194-46e5-9adc-fa0d6a1a9efd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:18.023224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c7d0d-7194-46e5-9adc-fa0d6a1a9efd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:18.024669 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c7d0d-7194-46e5-9adc-fa0d6a1a9efd None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:18.039280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-553c7d0d-7194-46e5-9adc-fa0d6a1a9efd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:18.039280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:18.039280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:18.039280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:18.039280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:18.039280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:18.039280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:18.039280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:18.039280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:18.039280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:18.039280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:18.039280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:18.039280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:18.039280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:18.039280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:18.040171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:18.041064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:18.041064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:18.041064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:18.041064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:18.041064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 289/578] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:18.041912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c7d0d-7194-46e5-9adc-fa0d6a1a9efd None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:18.078283 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe3ff5-4126-44f2-bd5b-84629da18140 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:18.106801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:18.113148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:18.114443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d29b7c-61e9-43b2-9cd9-0598da4af17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:18.119011 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d29b7c-61e9-43b2-9cd9-0598da4af17e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:18.119011 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d29b7c-61e9-43b2-9cd9-0598da4af17e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:18.119011 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d29b7c-61e9-43b2-9cd9-0598da4af17e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:18.129905 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d29b7c-61e9-43b2-9cd9-0598da4af17e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:18.135598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-e9d29b7c-61e9-43b2-9cd9-0598da4af17e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:18.135598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:18.135598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:18.135598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:18.135598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:18.135598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:18.135598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:18.135598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:18.135598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:18.135598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:18.135598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:18.135598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:18.135598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:18.135598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:18.135598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:18.135598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:18.136571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:18.136571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:18.136571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:18.136571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:18.136571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:18.136571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:18.136571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:18.136571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:18.136571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:18.136571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:18.136571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:18.136571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:18.136571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:18.136571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:18.136571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:18.136571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:18.137453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:18.137453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:18.137453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:18.137453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:18.137453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:18.137453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:18.137453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:18.137453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:18.137453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:18.137453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:18.137453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:18.137453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:18.137453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 290/579] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:18.139115 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d29b7c-61e9-43b2-9cd9-0598da4af17e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:18.154231 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c7d0d-7194-46e5-9adc-fa0d6a1a9efd None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:18.189958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671974b-1a69-4029-8e46-45da9533811e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:18.190586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671974b-1a69-4029-8e46-45da9533811e None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:18.190871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671974b-1a69-4029-8e46-45da9533811e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:18.191153 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671974b-1a69-4029-8e46-45da9533811e None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:18.191950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671974b-1a69-4029-8e46-45da9533811e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:18.192266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671974b-1a69-4029-8e46-45da9533811e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:18.194323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671974b-1a69-4029-8e46-45da9533811e None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:18.212688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 290/580] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jul 28 05:13:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:18.213548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671974b-1a69-4029-8e46-45da9533811e None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:18.254192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d29b7c-61e9-43b2-9cd9-0598da4af17e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:18.290908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23107a96-811e-4a3e-8101-03a28efbf309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:18.291532 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23107a96-811e-4a3e-8101-03a28efbf309 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:18.291811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23107a96-811e-4a3e-8101-03a28efbf309 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:18.292084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23107a96-811e-4a3e-8101-03a28efbf309 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:18.292770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23107a96-811e-4a3e-8101-03a28efbf309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:18.293077 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23107a96-811e-4a3e-8101-03a28efbf309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:18.294470 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23107a96-811e-4a3e-8101-03a28efbf309 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:18.307076 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 291/581] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:18.307867 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23107a96-811e-4a3e-8101-03a28efbf309 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:18.332712 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671974b-1a69-4029-8e46-45da9533811e None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:18.361628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:18.364981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:18.371684 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a740264-1c21-42ac-b9f8-1f9d842ebbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:18.372303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a740264-1c21-42ac-b9f8-1f9d842ebbce None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:18.372585 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a740264-1c21-42ac-b9f8-1f9d842ebbce None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:18.372861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a740264-1c21-42ac-b9f8-1f9d842ebbce None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:18.381766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a740264-1c21-42ac-b9f8-1f9d842ebbce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:18.381766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a740264-1c21-42ac-b9f8-1f9d842ebbce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:18.381766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a740264-1c21-42ac-b9f8-1f9d842ebbce None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:18.391460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 291/582] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:18.391460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a740264-1c21-42ac-b9f8-1f9d842ebbce None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:18.416194 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23107a96-811e-4a3e-8101-03a28efbf309 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:18.453871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76a22b-e819-45a3-940e-95b464eb6d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:18.454501 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76a22b-e819-45a3-940e-95b464eb6d23 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:18.454783 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76a22b-e819-45a3-940e-95b464eb6d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:18.455058 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76a22b-e819-45a3-940e-95b464eb6d23 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:18.455773 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76a22b-e819-45a3-940e-95b464eb6d23 None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:18.456081 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76a22b-e819-45a3-940e-95b464eb6d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:18.457451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76a22b-e819-45a3-940e-95b464eb6d23 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:18.471387 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 292/583] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:18.471387 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76a22b-e819-45a3-940e-95b464eb6d23 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:18.496292 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a740264-1c21-42ac-b9f8-1f9d842ebbce None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:18.531735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06c12c-4830-48c0-878a-7a77f1594ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:18.532380 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06c12c-4830-48c0-878a-7a77f1594ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:18.532665 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06c12c-4830-48c0-878a-7a77f1594ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:18.532944 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06c12c-4830-48c0-878a-7a77f1594ae7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:18.545513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06c12c-4830-48c0-878a-7a77f1594ae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:18.546151 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06c12c-4830-48c0-878a-7a77f1594ae7 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:18.566330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-1a06c12c-4830-48c0-878a-7a77f1594ae7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:18.566330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:18.566330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:18.566330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:18.566330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:18.566330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:18.566330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:18.566330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:18.566330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:18.566330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:18.566330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:18.566330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:18.566330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:18.566330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:18.566330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:18.567438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:18.568557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:18.568557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:18.568557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:18.568557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:18.572424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 292/584] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:18.573303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06c12c-4830-48c0-878a-7a77f1594ae7 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:18.581674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76a22b-e819-45a3-940e-95b464eb6d23 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:18.598199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:18.619941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ad2a0-ad35-4375-ac47-3c0b075d5d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:18.620594 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ad2a0-ad35-4375-ac47-3c0b075d5d33 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:18.620871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ad2a0-ad35-4375-ac47-3c0b075d5d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:18.621093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:18.621210 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ad2a0-ad35-4375-ac47-3c0b075d5d33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:18.628031 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ad2a0-ad35-4375-ac47-3c0b075d5d33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:18.629461 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ad2a0-ad35-4375-ac47-3c0b075d5d33 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:18.642112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-200ad2a0-ad35-4375-ac47-3c0b075d5d33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:18.642112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:18.642112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:18.642112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:18.642112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:18.642112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:18.642112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:18.642112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:18.642112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:18.642112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:18.642112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:18.642112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:18.642112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:18.642112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:18.642112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:18.642966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:18.643831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:18.643831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:18.643831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:18.643831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:18.643831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:18.643831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:18.643831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:18.643831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:18.643831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 293/585] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:18.644301 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ad2a0-ad35-4375-ac47-3c0b075d5d33 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:18.690658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06c12c-4830-48c0-878a-7a77f1594ae7 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:18.728278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f88b4d-da76-44b1-a46b-e754e9afbcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:18.728920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f88b4d-da76-44b1-a46b-e754e9afbcaa None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:18.729200 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f88b4d-da76-44b1-a46b-e754e9afbcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:18.729651 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f88b4d-da76-44b1-a46b-e754e9afbcaa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:18.737260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f88b4d-da76-44b1-a46b-e754e9afbcaa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:18.738733 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f88b4d-da76-44b1-a46b-e754e9afbcaa None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:18.750512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-47f88b4d-da76-44b1-a46b-e754e9afbcaa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:13:18.750512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:18.750512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:18.750512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:18.750512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:18.750512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:18.750512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:18.750512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:18.750512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:18.750512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:18.750512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:18.750512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:18.750512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:18.750512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:18.750512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:18.750512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:18.751409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:18.752342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:18.752342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:18.752342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:18.752342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:18.752342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:18.752342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:18.752342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:18.752342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:18.752342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:13:18.752342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:18.752856 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ad2a0-ad35-4375-ac47-3c0b075d5d33 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:18.756315 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 293/586] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:13:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:18.757365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f88b4d-da76-44b1-a46b-e754e9afbcaa None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:18.789381 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aaa96-70f8-4920-8ead-3951208d05d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:18.790062 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aaa96-70f8-4920-8ead-3951208d05d8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:18.790373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aaa96-70f8-4920-8ead-3951208d05d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:18.790649 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aaa96-70f8-4920-8ead-3951208d05d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:18.801433 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936aaa96-70f8-4920-8ead-3951208d05d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:18.803454 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936aaa96-70f8-4920-8ead-3951208d05d8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:18.819778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-936aaa96-70f8-4920-8ead-3951208d05d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:18.819778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:18.819778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:18.819778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:18.819778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:18.819778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:18.819778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:18.819778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:18.819778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:18.819778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:18.819778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:18.819778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:18.819778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:18.819778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:18.819778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:18.820653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:18.821587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:18.821587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:18.821587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:18.821587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:18.821587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 294/587] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:18.821869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aaa96-70f8-4920-8ead-3951208d05d8 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:18.850272 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:18.867145 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:18.871327 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f88b4d-da76-44b1-a46b-e754e9afbcaa None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:18.907882 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97a7d7-afac-4153-9643-2df6a7f4de73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:18.908786 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97a7d7-afac-4153-9643-2df6a7f4de73 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:18.909243 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97a7d7-afac-4153-9643-2df6a7f4de73 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:18.909732 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97a7d7-afac-4153-9643-2df6a7f4de73 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:18.910610 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97a7d7-afac-4153-9643-2df6a7f4de73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:18.911100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97a7d7-afac-4153-9643-2df6a7f4de73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:18.912673 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97a7d7-afac-4153-9643-2df6a7f4de73 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:18.924959 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 294/588] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:18.926018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97a7d7-afac-4153-9643-2df6a7f4de73 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:18.936359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aaa96-70f8-4920-8ead-3951208d05d8 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:18.972492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59dfa8-4e87-4848-ba8e-ceb22ab8db23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:18.973114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59dfa8-4e87-4848-ba8e-ceb22ab8db23 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:18.973402 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59dfa8-4e87-4848-ba8e-ceb22ab8db23 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:18.973708 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59dfa8-4e87-4848-ba8e-ceb22ab8db23 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:18.974456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59dfa8-4e87-4848-ba8e-ceb22ab8db23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:18.975346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59dfa8-4e87-4848-ba8e-ceb22ab8db23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:18.976962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59dfa8-4e87-4848-ba8e-ceb22ab8db23 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:18.994789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 295/589] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:18.994789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59dfa8-4e87-4848-ba8e-ceb22ab8db23 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:19.039735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97a7d7-afac-4153-9643-2df6a7f4de73 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:19.078929 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8bded-0f76-40d4-a288-3d76e7ebffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:19.079550 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8bded-0f76-40d4-a288-3d76e7ebffab None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:19.079827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8bded-0f76-40d4-a288-3d76e7ebffab None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:19.080102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8bded-0f76-40d4-a288-3d76e7ebffab None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:19.080575 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:19.082032 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8bded-0f76-40d4-a288-3d76e7ebffab None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:19.082344 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8bded-0f76-40d4-a288-3d76e7ebffab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:19.083756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8bded-0f76-40d4-a288-3d76e7ebffab None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:19.096075 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59dfa8-4e87-4848-ba8e-ceb22ab8db23 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:19.102343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 295/590] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jul 28 05:13:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:19.103169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8bded-0f76-40d4-a288-3d76e7ebffab None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:19.133793 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:19.136701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab99e5-912c-4fb7-8c57-bd6dd21a9b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:19.137455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab99e5-912c-4fb7-8c57-bd6dd21a9b4b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:19.137768 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab99e5-912c-4fb7-8c57-bd6dd21a9b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:19.138047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab99e5-912c-4fb7-8c57-bd6dd21a9b4b None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:19.138739 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab99e5-912c-4fb7-8c57-bd6dd21a9b4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:19.139047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab99e5-912c-4fb7-8c57-bd6dd21a9b4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:19.140413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab99e5-912c-4fb7-8c57-bd6dd21a9b4b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:19.156619 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 296/591] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:19.156619 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab99e5-912c-4fb7-8c57-bd6dd21a9b4b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:19.237185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8bded-0f76-40d4-a288-3d76e7ebffab None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:19.257520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab99e5-912c-4fb7-8c57-bd6dd21a9b4b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:19.281609 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bbcc6-f33b-48fc-a496-ee020b60b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:19.282256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bbcc6-f33b-48fc-a496-ee020b60b679 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:19.282536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bbcc6-f33b-48fc-a496-ee020b60b679 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:19.282812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bbcc6-f33b-48fc-a496-ee020b60b679 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:19.290436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bbcc6-f33b-48fc-a496-ee020b60b679 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:19.291903 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bbcc6-f33b-48fc-a496-ee020b60b679 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:19.302347 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e9c90-9517-4d3e-b1ff-a65a4ab4df66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:19.303891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e9c90-9517-4d3e-b1ff-a65a4ab4df66 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:19.304343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-9d3bbcc6-f33b-48fc-a496-ee020b60b679 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:19.304343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:19.304343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:19.304343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:19.304343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:19.304343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:19.304343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:19.304343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:19.304343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:19.304343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:19.304343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:19.304343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:19.304343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:19.304343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:19.304343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:19.305163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:19.311198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:19.311198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:19.311198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:19.311198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:19.311198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:19.311198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:19.311198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:19.311198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:19.311198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 296/592] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:19.311672 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e9c90-9517-4d3e-b1ff-a65a4ab4df66 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:19.311672 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e9c90-9517-4d3e-b1ff-a65a4ab4df66 None admin] PATH_INFO: `/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/99d8c709e6f4462c98c055cb03eebf42/roles/04fcac2c505f40a89923fa2f26cf548c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:19.311828 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bbcc6-f33b-48fc-a496-ee020b60b679 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:19.326569 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e9c90-9517-4d3e-b1ff-a65a4ab4df66 None admin] RBAC: Authorizing `identity:create_grant(project_id=089d8f58fc104484b617ec4a1317dbeb, user_id=99d8c709e6f4462c98c055cb03eebf42, role_id=04fcac2c505f40a89923fa2f26cf548c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:19.328016 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e9c90-9517-4d3e-b1ff-a65a4ab4df66 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:19.330274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:19.389530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:19.401852 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 297/593] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:13:19 2022] PUT /identity/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/99d8c709e6f4462c98c055cb03eebf42/roles/04fcac2c505f40a89923fa2f26cf548c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:13:19.403010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e9c90-9517-4d3e-b1ff-a65a4ab4df66 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:19.422981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bbcc6-f33b-48fc-a496-ee020b60b679 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:19.476703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f21b8-cf55-423b-8faa-f1df0cf090c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:19.477811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f21b8-cf55-423b-8faa-f1df0cf090c5 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:19.478297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f21b8-cf55-423b-8faa-f1df0cf090c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:19.478769 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f21b8-cf55-423b-8faa-f1df0cf090c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:19.491710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f21b8-cf55-423b-8faa-f1df0cf090c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:19.493616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f21b8-cf55-423b-8faa-f1df0cf090c5 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:19.511093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-d97f21b8-cf55-423b-8faa-f1df0cf090c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:19.511093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:19.511093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:19.511093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:19.511093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:19.511093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:19.511093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:19.511093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:19.511093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:19.511093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:19.511093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:19.511093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:19.511093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:19.511093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:19.511093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:19.512036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:19.512906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:19.512906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:19.512906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:19.512906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:19.515302 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 297/594] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:19.516457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f21b8-cf55-423b-8faa-f1df0cf090c5 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:19.549246 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e9c90-9517-4d3e-b1ff-a65a4ab4df66 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:19.589457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277a85d-9553-404d-886c-d070c979265a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:19.590194 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277a85d-9553-404d-886c-d070c979265a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:19.590477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277a85d-9553-404d-886c-d070c979265a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:19.590750 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277a85d-9553-404d-886c-d070c979265a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:19.598248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277a85d-9553-404d-886c-d070c979265a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:19.599689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277a85d-9553-404d-886c-d070c979265a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:19.613207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-6277a85d-9553-404d-886c-d070c979265a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:13:19.613207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:19.613207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:19.613207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:19.613207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:19.613207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:19.613207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:19.613207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:19.613207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:19.613207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:19.613207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:19.613207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:19.613207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:19.613207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:19.613207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:19.613207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:19.614233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:19.615614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:19.615614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:19.615614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:19.615614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:19.615614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:19.615614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:19.615614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:19.615614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:19.615614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:13:19.615614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:19.615614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 298/595] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:19.615614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277a85d-9553-404d-886c-d070c979265a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:19.631369 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f21b8-cf55-423b-8faa-f1df0cf090c5 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:19.659798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:19.669429 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01ea3c-8dad-4ab7-9d27-a6ce98128217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:19.674633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01ea3c-8dad-4ab7-9d27-a6ce98128217 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:19.674633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01ea3c-8dad-4ab7-9d27-a6ce98128217 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:19.674633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01ea3c-8dad-4ab7-9d27-a6ce98128217 None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:19.674633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01ea3c-8dad-4ab7-9d27-a6ce98128217 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:19.674633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01ea3c-8dad-4ab7-9d27-a6ce98128217 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:19.674633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01ea3c-8dad-4ab7-9d27-a6ce98128217 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:19.678861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:19.685717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 298/596] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:19.686943 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ec46b-2cb5-4129-82e4-8c347960dbf0 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:19.687226 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ec46b-2cb5-4129-82e4-8c347960dbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:19.687566 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ec46b-2cb5-4129-82e4-8c347960dbf0 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:19.693335 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 299/597] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:19.693335 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ec46b-2cb5-4129-82e4-8c347960dbf0 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:19.732253 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277a85d-9553-404d-886c-d070c979265a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:19.773030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5827cf-f11d-4537-9efb-fdc3b7c4f142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:19.773816 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5827cf-f11d-4537-9efb-fdc3b7c4f142 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:19.774165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5827cf-f11d-4537-9efb-fdc3b7c4f142 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:19.774512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5827cf-f11d-4537-9efb-fdc3b7c4f142 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:19.775281 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5827cf-f11d-4537-9efb-fdc3b7c4f142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:19.775676 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5827cf-f11d-4537-9efb-fdc3b7c4f142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:19.777314 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5827cf-f11d-4537-9efb-fdc3b7c4f142 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:19.790999 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 299/598] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:19.791707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5827cf-f11d-4537-9efb-fdc3b7c4f142 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:19.807261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ec46b-2cb5-4129-82e4-8c347960dbf0 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:19.843347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f0427-773d-4214-a7ac-2a16ef382455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:19.843972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f0427-773d-4214-a7ac-2a16ef382455 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:19.844254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f0427-773d-4214-a7ac-2a16ef382455 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:19.844528 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f0427-773d-4214-a7ac-2a16ef382455 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:19.845321 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f0427-773d-4214-a7ac-2a16ef382455 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:19.845661 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f0427-773d-4214-a7ac-2a16ef382455 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:19.847080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f0427-773d-4214-a7ac-2a16ef382455 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:19.869801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 300/599] 10.222.0.33 () {56 vars in 1139 bytes} [Thu Jul 28 05:13:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:19.869801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178558e-12da-4383-96eb-cec4277513c7 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:19.869801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178558e-12da-4383-96eb-cec4277513c7 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:19.869801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178558e-12da-4383-96eb-cec4277513c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:19.887800 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-4178558e-12da-4383-96eb-cec4277513c7 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:19.888977 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4178558e-12da-4383-96eb-cec4277513c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:19.906345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5827cf-f11d-4537-9efb-fdc3b7c4f142 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:19.921957 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:19.934915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:19.943313 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac09b11-6418-4218-bff6-a6b2e13f6456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:19.944862 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac09b11-6418-4218-bff6-a6b2e13f6456 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:19.944978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac09b11-6418-4218-bff6-a6b2e13f6456 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:19.945198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac09b11-6418-4218-bff6-a6b2e13f6456 None admin] PATH_INFO: `/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/628ef75fa7194253bcf6cd6c85211738/roles/04fcac2c505f40a89923fa2f26cf548c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:19.960224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac09b11-6418-4218-bff6-a6b2e13f6456 None admin] RBAC: Authorizing `identity:create_grant(project_id=089d8f58fc104484b617ec4a1317dbeb, user_id=628ef75fa7194253bcf6cd6c85211738, role_id=04fcac2c505f40a89923fa2f26cf548c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:19.961799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac09b11-6418-4218-bff6-a6b2e13f6456 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:19.973748 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 301/600] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:19.974563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178558e-12da-4383-96eb-cec4277513c7 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:20.042000 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 300/601] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:13:19 2022] PUT /identity/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/628ef75fa7194253bcf6cd6c85211738/roles/04fcac2c505f40a89923fa2f26cf548c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:13:20.043165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac09b11-6418-4218-bff6-a6b2e13f6456 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:20.110907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178558e-12da-4383-96eb-cec4277513c7 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:20.163306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87341079-3fdd-4907-bad1-7448d955e439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:20.164794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87341079-3fdd-4907-bad1-7448d955e439 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:20.164902 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac09b11-6418-4218-bff6-a6b2e13f6456 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:20.165681 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87341079-3fdd-4907-bad1-7448d955e439 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:20.166203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87341079-3fdd-4907-bad1-7448d955e439 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:20.176047 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87341079-3fdd-4907-bad1-7448d955e439 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:20.179386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87341079-3fdd-4907-bad1-7448d955e439 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:20.198280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-87341079-3fdd-4907-bad1-7448d955e439 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:20.198280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:20.198280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:20.198280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:20.198280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:20.198280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:20.198280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:20.198280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:20.198280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:20.198280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:20.198280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:20.198280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:20.198280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:20.198280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:20.198280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:20.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:20.200125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:20.200125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:20.200125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:20.200125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:20.200125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:20.200125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:20.200125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:20.200125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:20.202877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 302/602] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:20.204460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87341079-3fdd-4907-bad1-7448d955e439 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:20.211228 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f0e9a-0d0f-484a-b64f-52ee8416f79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:20.211917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f0e9a-0d0f-484a-b64f-52ee8416f79a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:20.212202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f0e9a-0d0f-484a-b64f-52ee8416f79a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:20.212479 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f0e9a-0d0f-484a-b64f-52ee8416f79a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:20.226476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f0e9a-0d0f-484a-b64f-52ee8416f79a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:20.228548 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f0e9a-0d0f-484a-b64f-52ee8416f79a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:20.244839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:20.249322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c02f0e9a-0d0f-484a-b64f-52ee8416f79a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:20.249322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:20.249322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:20.249322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:20.249322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:20.249322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:20.249322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:20.249322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:20.249322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:20.249322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:20.249322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:20.249322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:20.249322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:20.249322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:20.249322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:20.250291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:20.251207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:20.251207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:20.251207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:20.251207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:20.251436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 301/603] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:20.252097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f0e9a-0d0f-484a-b64f-52ee8416f79a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:20.282596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:20.340833 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87341079-3fdd-4907-bad1-7448d955e439 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:20.370362 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f0e9a-0d0f-484a-b64f-52ee8416f79a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:20.382903 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d230a81-a588-4018-8d57-624e7de15468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:20.383558 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d230a81-a588-4018-8d57-624e7de15468 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:20.383844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d230a81-a588-4018-8d57-624e7de15468 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:20.384124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d230a81-a588-4018-8d57-624e7de15468 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:20.395385 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d230a81-a588-4018-8d57-624e7de15468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:20.401229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-5d230a81-a588-4018-8d57-624e7de15468 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:20.401229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:20.401229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:20.401229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:20.401229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:20.401229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:20.401229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:20.401229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:20.401229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:20.401229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:20.401229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:20.401229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:20.401229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:20.401229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:20.401229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:20.401229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:20.402181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:20.402181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:20.402181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:20.402181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:20.402181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:20.402181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:20.402181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:20.402181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:20.402181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:20.402181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:20.402181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:20.402181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:20.402181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:20.402181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:20.402181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:20.402181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:20.402990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:20.402990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:20.402990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:20.402990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:20.402990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:20.402990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:20.402990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:20.402990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:20.402990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:20.402990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:20.402990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:20.402990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:20.402990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 303/604] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:20.403658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d230a81-a588-4018-8d57-624e7de15468 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:20.419791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf94ac-904c-44ad-beb7-39b504478717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:20.420771 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf94ac-904c-44ad-beb7-39b504478717 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:20.421133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf94ac-904c-44ad-beb7-39b504478717 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:20.421967 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf94ac-904c-44ad-beb7-39b504478717 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:20.423082 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf94ac-904c-44ad-beb7-39b504478717 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:20.423469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf94ac-904c-44ad-beb7-39b504478717 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:20.425765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf94ac-904c-44ad-beb7-39b504478717 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:20.444890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 302/605] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:20.445937 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf94ac-904c-44ad-beb7-39b504478717 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:20.510324 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:20.517087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d230a81-a588-4018-8d57-624e7de15468 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:20.554942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:20.568627 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5068c-e9ad-443f-a47a-b5dc7119b973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:20.569723 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5068c-e9ad-443f-a47a-b5dc7119b973 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:20.570219 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5068c-e9ad-443f-a47a-b5dc7119b973 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:20.570696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5068c-e9ad-443f-a47a-b5dc7119b973 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:20.572268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5068c-e9ad-443f-a47a-b5dc7119b973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:20.577729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5068c-e9ad-443f-a47a-b5dc7119b973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:20.577729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5068c-e9ad-443f-a47a-b5dc7119b973 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:20.581277 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf94ac-904c-44ad-beb7-39b504478717 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:20.593293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 304/606] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:20.594522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5068c-e9ad-443f-a47a-b5dc7119b973 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:20.637483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc909ce6-303c-4e25-9032-cd566cc8258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:20.638505 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc909ce6-303c-4e25-9032-cd566cc8258d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:20.639005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc909ce6-303c-4e25-9032-cd566cc8258d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:20.639477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc909ce6-303c-4e25-9032-cd566cc8258d None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:20.640916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc909ce6-303c-4e25-9032-cd566cc8258d None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:20.641439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc909ce6-303c-4e25-9032-cd566cc8258d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:20.643896 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc909ce6-303c-4e25-9032-cd566cc8258d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:20.659644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 303/607] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:20.659644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc909ce6-303c-4e25-9032-cd566cc8258d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:20.723067 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5068c-e9ad-443f-a47a-b5dc7119b973 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:20.767151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc909ce6-303c-4e25-9032-cd566cc8258d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:20.770772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1d129-aece-48f1-bdee-9ecb2252d093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:20.772228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d129-aece-48f1-bdee-9ecb2252d093 None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:20.772655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d129-aece-48f1-bdee-9ecb2252d093 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:20.773075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d129-aece-48f1-bdee-9ecb2252d093 None admin] PATH_INFO: `/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/bae981c7273843d4ac734dd876bebe5f/roles/04fcac2c505f40a89923fa2f26cf548c` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:20.792982 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1d129-aece-48f1-bdee-9ecb2252d093 None admin] RBAC: Authorizing `identity:create_grant(project_id=089d8f58fc104484b617ec4a1317dbeb, user_id=bae981c7273843d4ac734dd876bebe5f, role_id=04fcac2c505f40a89923fa2f26cf548c)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:20.794825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1d129-aece-48f1-bdee-9ecb2252d093 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:20.805944 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3655af0-914a-41f8-b9dd-79755ec113f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:20.806598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3655af0-914a-41f8-b9dd-79755ec113f0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:20.806880 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3655af0-914a-41f8-b9dd-79755ec113f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:20.807153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3655af0-914a-41f8-b9dd-79755ec113f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:20.814561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3655af0-914a-41f8-b9dd-79755ec113f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:20.815989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3655af0-914a-41f8-b9dd-79755ec113f0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:20.817848 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:20.828506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-f3655af0-914a-41f8-b9dd-79755ec113f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:20.828506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:20.828506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:20.828506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:20.828506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:20.828506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:20.828506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:20.828506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:20.828506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:20.828506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:20.828506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:20.828506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:20.828506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:20.828506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:20.828506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:20.830124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:20.831332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:20.831332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:20.831332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:20.831332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:20.831332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:20.831332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:20.831332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:20.831332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:20.832140 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 304/608] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:20.833144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3655af0-914a-41f8-b9dd-79755ec113f0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:20.877350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 305/609] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:13:20 2022] PUT /identity/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/bae981c7273843d4ac734dd876bebe5f/roles/04fcac2c505f40a89923fa2f26cf548c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:13:20.878651 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1d129-aece-48f1-bdee-9ecb2252d093 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:20.893027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:21.009710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3655af0-914a-41f8-b9dd-79755ec113f0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:21.054524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1d129-aece-48f1-bdee-9ecb2252d093 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:21.098872 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a3206-badd-4a3b-88d6-13ab3249326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:21.099949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a3206-badd-4a3b-88d6-13ab3249326d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:21.100434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a3206-badd-4a3b-88d6-13ab3249326d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:21.100907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a3206-badd-4a3b-88d6-13ab3249326d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:21.101203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996ab8d-5871-4a0b-9a59-507f8833e675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:21.101858 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996ab8d-5871-4a0b-9a59-507f8833e675 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:21.102289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996ab8d-5871-4a0b-9a59-507f8833e675 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:21.102605 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996ab8d-5871-4a0b-9a59-507f8833e675 None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:21.103484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996ab8d-5871-4a0b-9a59-507f8833e675 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:21.103802 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996ab8d-5871-4a0b-9a59-507f8833e675 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:21.105661 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996ab8d-5871-4a0b-9a59-507f8833e675 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:21.115264 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a3206-badd-4a3b-88d6-13ab3249326d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:21.118189 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a3206-badd-4a3b-88d6-13ab3249326d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:21.124201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 306/610] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:21.130832 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996ab8d-5871-4a0b-9a59-507f8833e675 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:21.139244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-ba8a3206-badd-4a3b-88d6-13ab3249326d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:21.139244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:21.139244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:21.139244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:21.139244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:21.139244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:21.139244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:21.139244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:21.139244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:21.139244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:21.139244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:21.139244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:21.139244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:21.139244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:21.139244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:21.140153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:21.141050 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:21.141050 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:21.141050 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:21.141050 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:21.143783 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 305/611] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:21.149382 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a3206-badd-4a3b-88d6-13ab3249326d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:21.203228 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:21.209042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:21.246926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996ab8d-5871-4a0b-9a59-507f8833e675 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:21.258879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a3206-badd-4a3b-88d6-13ab3249326d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:21.285433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdd03c-94ba-4521-9f50-1ef7fc7d62f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:21.286492 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdd03c-94ba-4521-9f50-1ef7fc7d62f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:21.287052 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdd03c-94ba-4521-9f50-1ef7fc7d62f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:21.287764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdd03c-94ba-4521-9f50-1ef7fc7d62f6 None admin] PATH_INFO: `/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/6907d8a429404b1c92805b364900ba60/roles/04fcac2c505f40a89923fa2f26cf548c` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:21.303154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebad63-eb0c-415f-86c5-f54953eca271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:21.303870 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebad63-eb0c-415f-86c5-f54953eca271 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:21.304300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebad63-eb0c-415f-86c5-f54953eca271 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:21.304604 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebad63-eb0c-415f-86c5-f54953eca271 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:21.305314 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebad63-eb0c-415f-86c5-f54953eca271 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:21.305644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebad63-eb0c-415f-86c5-f54953eca271 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:21.306908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdd03c-94ba-4521-9f50-1ef7fc7d62f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=089d8f58fc104484b617ec4a1317dbeb, user_id=6907d8a429404b1c92805b364900ba60, role_id=04fcac2c505f40a89923fa2f26cf548c)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:21.307019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebad63-eb0c-415f-86c5-f54953eca271 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:21.308654 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdd03c-94ba-4521-9f50-1ef7fc7d62f6 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:21.326290 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 306/612] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:21.331268 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebad63-eb0c-415f-86c5-f54953eca271 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:21.374465 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 307/613] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:13:21 2022] PUT /identity/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/6907d8a429404b1c92805b364900ba60/roles/04fcac2c505f40a89923fa2f26cf548c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:13:21.474366 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebad63-eb0c-415f-86c5-f54953eca271 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:21.491410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:21.515945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2e0b0-91fd-4cff-be00-6060239319fd None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:21.516255 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2e0b0-91fd-4cff-be00-6060239319fd None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:21.516541 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2e0b0-91fd-4cff-be00-6060239319fd None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:21.518149 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 308/614] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:21.524091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d45fd9-ade3-4c20-ab81-34dead4e71c3 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:21.524379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d45fd9-ade3-4c20-ab81-34dead4e71c3 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:21.524667 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d45fd9-ade3-4c20-ab81-34dead4e71c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:21.525920 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9a819-c8bd-45c7-bbba-70ef52f6d8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:21.526648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9a819-c8bd-45c7-bbba-70ef52f6d8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:21.527022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9a819-c8bd-45c7-bbba-70ef52f6d8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:21.527372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9a819-c8bd-45c7-bbba-70ef52f6d8f4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:21.538055 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9a819-c8bd-45c7-bbba-70ef52f6d8f4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:21.540044 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9a819-c8bd-45c7-bbba-70ef52f6d8f4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:21.552890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-80a9a819-c8bd-45c7-bbba-70ef52f6d8f4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:13:21.552890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:21.552890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:21.552890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:21.552890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:21.552890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:21.552890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:21.552890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:21.552890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:21.552890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:21.552890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:21.552890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:21.552890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:21.552890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:21.552890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:21.552890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:21.554717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:21.555871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:21.555871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:21.555871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:21.555871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:21.555871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:21.555871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:21.555871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:21.555871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:21.555871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:13:21.555871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:21.558303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 307/615] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:13:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:21.562404 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-f9d45fd9-ade3-4c20-ab81-34dead4e71c3 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:21.564066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f9d45fd9-ade3-4c20-ab81-34dead4e71c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:21.566690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9a819-c8bd-45c7-bbba-70ef52f6d8f4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:21.706981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9a819-c8bd-45c7-bbba-70ef52f6d8f4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:21.708070 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 309/616] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:21.745003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caaef5a-5a8e-404a-a654-0b3e3d8d5693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:21.745557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caaef5a-5a8e-404a-a654-0b3e3d8d5693 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:21.745873 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caaef5a-5a8e-404a-a654-0b3e3d8d5693 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:21.746082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d45fd9-ade3-4c20-ab81-34dead4e71c3 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:21.746189 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caaef5a-5a8e-404a-a654-0b3e3d8d5693 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:21.746948 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caaef5a-5a8e-404a-a654-0b3e3d8d5693 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:21.747259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caaef5a-5a8e-404a-a654-0b3e3d8d5693 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:21.748744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caaef5a-5a8e-404a-a654-0b3e3d8d5693 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:21.768091 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 308/617] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jul 28 05:13:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:21.776328 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caaef5a-5a8e-404a-a654-0b3e3d8d5693 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:21.819306 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:21.848982 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:21.899029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caaef5a-5a8e-404a-a654-0b3e3d8d5693 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:21.944312 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ca83f-5841-4d93-8b52-5ed4ecc1e6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:21.945058 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ca83f-5841-4d93-8b52-5ed4ecc1e6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:21.945336 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ca83f-5841-4d93-8b52-5ed4ecc1e6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:21.945633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ca83f-5841-4d93-8b52-5ed4ecc1e6d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:21.964067 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ca83f-5841-4d93-8b52-5ed4ecc1e6d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:21.966743 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d45fd9-ade3-4c20-ab81-34dead4e71c3 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:21.969055 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ca83f-5841-4d93-8b52-5ed4ecc1e6d5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:21.997689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-9b4ca83f-5841-4d93-8b52-5ed4ecc1e6d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:21.997689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:21.997689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:21.997689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:21.997689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:21.997689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:21.997689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:21.997689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:21.997689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:21.997689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:21.997689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:21.997689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:21.997689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:21.997689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:21.997689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:21.998595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:21.999469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:21.999469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:21.999469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:21.999469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:22.000371 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 309/618] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:22.005412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ca83f-5841-4d93-8b52-5ed4ecc1e6d5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:22.039171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45df12-f5fa-4bf3-b0cf-e5487c081c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:22.039828 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45df12-f5fa-4bf3-b0cf-e5487c081c96 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:22.040106 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45df12-f5fa-4bf3-b0cf-e5487c081c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:22.040372 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45df12-f5fa-4bf3-b0cf-e5487c081c96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:22.061762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45df12-f5fa-4bf3-b0cf-e5487c081c96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:22.066956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-6d45df12-f5fa-4bf3-b0cf-e5487c081c96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:22.066956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:22.066956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:22.066956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:22.066956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:22.066956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:22.066956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:22.066956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:22.066956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:22.066956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:22.066956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:22.066956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:22.066956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:22.066956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:22.066956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:22.066956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:22.067933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:22.067933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:22.067933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:22.067933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:22.067933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:22.067933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:22.067933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:22.067933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:22.067933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:22.067933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:22.067933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:22.067933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:22.067933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:22.067933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:22.067933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:22.067933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:22.068911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:22.068911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:22.068911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:22.068911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:22.068911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:22.068911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:22.068911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:22.068911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:22.068911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:22.068911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:22.068911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:22.068911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:22.068911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 310/619] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:22.074031 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45df12-f5fa-4bf3-b0cf-e5487c081c96 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:22.141928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:22.169191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ca83f-5841-4d93-8b52-5ed4ecc1e6d5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:22.189453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45df12-f5fa-4bf3-b0cf-e5487c081c96 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:22.200350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:22.244790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2024035-3771-4351-aafc-a72a50a15d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:22.245505 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2024035-3771-4351-aafc-a72a50a15d5f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:22.245734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2024035-3771-4351-aafc-a72a50a15d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:22.246013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2024035-3771-4351-aafc-a72a50a15d5f None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:22.246718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2024035-3771-4351-aafc-a72a50a15d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:22.247031 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2024035-3771-4351-aafc-a72a50a15d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:22.248469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2024035-3771-4351-aafc-a72a50a15d5f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:22.252943 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40ee7a-da5c-42c7-a328-bd03906d3518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:22.253601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40ee7a-da5c-42c7-a328-bd03906d3518 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:22.253887 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40ee7a-da5c-42c7-a328-bd03906d3518 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:22.254165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40ee7a-da5c-42c7-a328-bd03906d3518 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:22.254894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40ee7a-da5c-42c7-a328-bd03906d3518 None admin] RBAC: Adding query filter params (name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:22.255205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40ee7a-da5c-42c7-a328-bd03906d3518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:22.267081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40ee7a-da5c-42c7-a328-bd03906d3518 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:22.284006 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 311/620] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:22.289953 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40ee7a-da5c-42c7-a328-bd03906d3518 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:22.293036 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 310/621] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:22.298099 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2024035-3771-4351-aafc-a72a50a15d5f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:22.457986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40ee7a-da5c-42c7-a328-bd03906d3518 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:22.480720 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2024035-3771-4351-aafc-a72a50a15d5f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:22.500334 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbf14e-89a7-4f6e-b011-7c7fe184b425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:22.501166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbf14e-89a7-4f6e-b011-7c7fe184b425 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:22.501642 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbf14e-89a7-4f6e-b011-7c7fe184b425 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:22.502056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbf14e-89a7-4f6e-b011-7c7fe184b425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:22.513723 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbf14e-89a7-4f6e-b011-7c7fe184b425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:22.515351 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbf14e-89a7-4f6e-b011-7c7fe184b425 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:22.526041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e2982-8f9a-4bc3-934e-d47d2802d039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:22.526697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e2982-8f9a-4bc3-934e-d47d2802d039 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:22.526991 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e2982-8f9a-4bc3-934e-d47d2802d039 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:22.527270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e2982-8f9a-4bc3-934e-d47d2802d039 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:22.531884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-1dbbf14e-89a7-4f6e-b011-7c7fe184b425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:22.531884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:22.531884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:22.531884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:22.531884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:22.531884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:22.531884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:22.531884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:22.531884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:22.531884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:22.531884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:22.531884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:22.531884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:22.531884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:22.531884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:22.532921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:22.534033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:22.534033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:22.534033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:22.534033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:22.534272 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e2982-8f9a-4bc3-934e-d47d2802d039 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:22.535623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e2982-8f9a-4bc3-934e-d47d2802d039 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:22.536055 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 312/622] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:22.537955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c126573-42a2-4292-85c9-bce83d2fa93d None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:22.538396 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c126573-42a2-4292-85c9-bce83d2fa93d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:22.538806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c126573-42a2-4292-85c9-bce83d2fa93d None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:22.540400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 313/623] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:22.543705 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:22.546223 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c126573-42a2-4292-85c9-bce83d2fa93d None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:22.556240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-ed6e2982-8f9a-4bc3-934e-d47d2802d039 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:22.556240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:22.556240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:22.556240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:22.556240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:22.556240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:22.556240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:22.556240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:22.556240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:22.556240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:22.556240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:22.556240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:22.556240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:22.556240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:22.556240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:22.567065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:22.568163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:22.568163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:22.568163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:22.568163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:22.568163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:22.568163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:22.568163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:22.568163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:22.568163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 311/624] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:22.568163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641055-326e-4ecb-a1cf-d6b5886ce1a2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:22.568163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641055-326e-4ecb-a1cf-d6b5886ce1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:22.568916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641055-326e-4ecb-a1cf-d6b5886ce1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:22.573835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:22.589847 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2f641055-326e-4ecb-a1cf-d6b5886ce1a2 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:22.591864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2f641055-326e-4ecb-a1cf-d6b5886ce1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:22.661599 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c126573-42a2-4292-85c9-bce83d2fa93d None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:22.672247 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 312/625] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:22.673428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641055-326e-4ecb-a1cf-d6b5886ce1a2 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:22.712831 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3418e9-69a9-47a3-a86e-2863a051885a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:22.713184 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3418e9-69a9-47a3-a86e-2863a051885a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:22.713588 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3418e9-69a9-47a3-a86e-2863a051885a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:22.713958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3418e9-69a9-47a3-a86e-2863a051885a None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:22.714747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3418e9-69a9-47a3-a86e-2863a051885a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:22.715165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3418e9-69a9-47a3-a86e-2863a051885a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:22.716612 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3418e9-69a9-47a3-a86e-2863a051885a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:22.730375 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 314/626] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:22.731368 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3418e9-69a9-47a3-a86e-2863a051885a None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:22.786444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641055-326e-4ecb-a1cf-d6b5886ce1a2 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:22.818975 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:22.825995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:22.826854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fce87-5649-45a0-965f-0cf63b3466d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:22.827771 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fce87-5649-45a0-965f-0cf63b3466d3 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:22.828201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fce87-5649-45a0-965f-0cf63b3466d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:22.828669 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fce87-5649-45a0-965f-0cf63b3466d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:22.829718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fce87-5649-45a0-965f-0cf63b3466d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:22.830234 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fce87-5649-45a0-965f-0cf63b3466d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:22.831974 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fce87-5649-45a0-965f-0cf63b3466d3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:22.846186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 313/627] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:22.847370 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fce87-5649-45a0-965f-0cf63b3466d3 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:22.850666 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3418e9-69a9-47a3-a86e-2863a051885a None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:22.890765 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e0193-25c8-4e3d-8ae3-dc408ba35ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:22.891595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e0193-25c8-4e3d-8ae3-dc408ba35ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:22.891969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e0193-25c8-4e3d-8ae3-dc408ba35ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:22.892344 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e0193-25c8-4e3d-8ae3-dc408ba35ef3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:22.904547 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e0193-25c8-4e3d-8ae3-dc408ba35ef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:22.909817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-5d9e0193-25c8-4e3d-8ae3-dc408ba35ef3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:22.909817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:22.909817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:22.909817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:22.909817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:22.909817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:22.909817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:22.909817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:22.909817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:22.909817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:22.909817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:22.909817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:22.909817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:22.909817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:22.909817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:22.909817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:22.910965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:22.910965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:22.910965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:22.910965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:22.910965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:22.910965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:22.910965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:22.910965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:22.910965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:22.910965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:22.910965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:22.910965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:22.910965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:22.910965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:22.910965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:22.910965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:22.912027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:22.912027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:22.912027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:22.912027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:22.912027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:22.912027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:22.912027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:22.912027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:22.912027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:22.912027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:22.912027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:22.912027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:22.914103 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 315/628] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:22.915240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e0193-25c8-4e3d-8ae3-dc408ba35ef3 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:22.964129 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fce87-5649-45a0-965f-0cf63b3466d3 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:23.001926 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c932f5-6a80-42c8-9350-96d8d8cf0a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:23.002981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c932f5-6a80-42c8-9350-96d8d8cf0a5a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:23.003415 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c932f5-6a80-42c8-9350-96d8d8cf0a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:23.003948 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c932f5-6a80-42c8-9350-96d8d8cf0a5a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:23.012885 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c932f5-6a80-42c8-9350-96d8d8cf0a5a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:23.014859 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c932f5-6a80-42c8-9350-96d8d8cf0a5a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:23.023910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e0193-25c8-4e3d-8ae3-dc408ba35ef3 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:23.028457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-18c932f5-6a80-42c8-9350-96d8d8cf0a5a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:13:23.028457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:23.028457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:23.028457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:23.028457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:23.028457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:23.028457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:23.028457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:23.028457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:23.028457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:23.028457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:23.028457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:23.028457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:23.028457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:23.028457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:23.028457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:23.029448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:23.030426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:23.030426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:23.030426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:23.030426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:23.030426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:23.030426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:23.030426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:23.030426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:23.030426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:13:23.030426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:23.032784 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 314/629] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jul 28 05:13:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:23.033955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c932f5-6a80-42c8-9350-96d8d8cf0a5a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:23.063917 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da08cd-b9fc-4102-a7e2-43a3499d0fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:23.064499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da08cd-b9fc-4102-a7e2-43a3499d0fc9 None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:23.064778 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da08cd-b9fc-4102-a7e2-43a3499d0fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:23.065054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da08cd-b9fc-4102-a7e2-43a3499d0fc9 None admin] PATH_INFO: `/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/eb89e2ac885f42eb95fe3b67f3808ba9/roles/04fcac2c505f40a89923fa2f26cf548c` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:23.077380 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:23.081391 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da08cd-b9fc-4102-a7e2-43a3499d0fc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=089d8f58fc104484b617ec4a1317dbeb, user_id=eb89e2ac885f42eb95fe3b67f3808ba9, role_id=04fcac2c505f40a89923fa2f26cf548c)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:23.082979 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da08cd-b9fc-4102-a7e2-43a3499d0fc9 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:23.092850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:23.146359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c932f5-6a80-42c8-9350-96d8d8cf0a5a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:23.165728 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 316/630] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:13:22 2022] PUT /identity/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/eb89e2ac885f42eb95fe3b67f3808ba9/roles/04fcac2c505f40a89923fa2f26cf548c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:13:23.165728 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da08cd-b9fc-4102-a7e2-43a3499d0fc9 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:23.210628 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee01ed-78f6-4956-b512-a8438e58056e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:23.213310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee01ed-78f6-4956-b512-a8438e58056e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:23.213629 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee01ed-78f6-4956-b512-a8438e58056e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:23.214031 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee01ed-78f6-4956-b512-a8438e58056e None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:23.214753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee01ed-78f6-4956-b512-a8438e58056e None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:23.215064 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee01ed-78f6-4956-b512-a8438e58056e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:23.216466 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee01ed-78f6-4956-b512-a8438e58056e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:23.236170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 315/631] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:23.238995 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee01ed-78f6-4956-b512-a8438e58056e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:23.352640 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da08cd-b9fc-4102-a7e2-43a3499d0fc9 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:23.393937 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f382bd-6520-4407-901e-b6673095c91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:23.394585 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f382bd-6520-4407-901e-b6673095c91b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:23.394868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f382bd-6520-4407-901e-b6673095c91b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:23.395143 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f382bd-6520-4407-901e-b6673095c91b None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:23.395953 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f382bd-6520-4407-901e-b6673095c91b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:23.396265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f382bd-6520-4407-901e-b6673095c91b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:23.398011 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee01ed-78f6-4956-b512-a8438e58056e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:23.398451 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f382bd-6520-4407-901e-b6673095c91b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:23.419371 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:23.425668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 317/632] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jul 28 05:13:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:23.427043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd4a3c-bfc7-4f76-b8ad-4d6bc842bc5b None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:23.433827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd4a3c-bfc7-4f76-b8ad-4d6bc842bc5b None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:23.433827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd4a3c-bfc7-4f76-b8ad-4d6bc842bc5b None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:23.433827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 318/633] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:23.433827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd4a3c-bfc7-4f76-b8ad-4d6bc842bc5b None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:23.449840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c735e-7fd5-4f92-a94b-0ab059fc6044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:23.450972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c735e-7fd5-4f92-a94b-0ab059fc6044 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:23.451258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c735e-7fd5-4f92-a94b-0ab059fc6044 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:23.451537 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c735e-7fd5-4f92-a94b-0ab059fc6044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:23.467166 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c735e-7fd5-4f92-a94b-0ab059fc6044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:23.469378 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c735e-7fd5-4f92-a94b-0ab059fc6044 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:23.489330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-7d1c735e-7fd5-4f92-a94b-0ab059fc6044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:23.489330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:23.489330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:23.489330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:23.489330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:23.489330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:23.489330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:23.489330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:23.489330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:23.489330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:23.489330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:23.489330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:23.489330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:23.489330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:23.489330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:23.490372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:23.491306 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:23.491306 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:23.491306 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:23.491306 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:23.493615 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 316/634] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:23.494925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b8ecf-2c59-40c8-922c-c0898e80799b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:23.495215 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b8ecf-2c59-40c8-922c-c0898e80799b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:23.495494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b8ecf-2c59-40c8-922c-c0898e80799b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:23.499424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:23.515093 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-384b8ecf-2c59-40c8-922c-c0898e80799b None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:23.516178 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-384b8ecf-2c59-40c8-922c-c0898e80799b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:23.560500 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd4a3c-bfc7-4f76-b8ad-4d6bc842bc5b None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:23.601492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 317/635] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:23.601492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b8ecf-2c59-40c8-922c-c0898e80799b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:23.611182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16372f53-e37a-42aa-9e44-501d15b96626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:23.612091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16372f53-e37a-42aa-9e44-501d15b96626 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:23.612573 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16372f53-e37a-42aa-9e44-501d15b96626 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:23.613063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16372f53-e37a-42aa-9e44-501d15b96626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:23.697063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16372f53-e37a-42aa-9e44-501d15b96626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:23.698960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16372f53-e37a-42aa-9e44-501d15b96626 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:23.719553 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b8ecf-2c59-40c8-922c-c0898e80799b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:23.749974 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:23.755175 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:23.764909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77b300-1f68-4d08-afec-cf22b07c3e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:23.765561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77b300-1f68-4d08-afec-cf22b07c3e9f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:23.765848 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77b300-1f68-4d08-afec-cf22b07c3e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:23.766133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77b300-1f68-4d08-afec-cf22b07c3e9f None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:23.784555 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77b300-1f68-4d08-afec-cf22b07c3e9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:23.784555 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77b300-1f68-4d08-afec-cf22b07c3e9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:23.784555 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77b300-1f68-4d08-afec-cf22b07c3e9f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:23.784555 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 318/636] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:23.784555 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77b300-1f68-4d08-afec-cf22b07c3e9f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:23.813323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 319/637] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:23.815109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4372889-9b84-4ac5-a67e-9891e6c15a28 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:23.815502 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4372889-9b84-4ac5-a67e-9891e6c15a28 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:23.815874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4372889-9b84-4ac5-a67e-9891e6c15a28 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:23.817283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 320/638] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:23.818106 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4372889-9b84-4ac5-a67e-9891e6c15a28 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:23.899060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77b300-1f68-4d08-afec-cf22b07c3e9f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:23.930741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4372889-9b84-4ac5-a67e-9891e6c15a28 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:23.935802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acbb04-c605-497e-9657-76d7ee428c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:23.936528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acbb04-c605-497e-9657-76d7ee428c8b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:23.936881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acbb04-c605-497e-9657-76d7ee428c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:23.937227 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acbb04-c605-497e-9657-76d7ee428c8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:23.948467 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acbb04-c605-497e-9657-76d7ee428c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:23.954012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-40acbb04-c605-497e-9657-76d7ee428c8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:23.954012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:23.954012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:23.954012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:23.954012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:23.954012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:23.954012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:23.954012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:23.954012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:23.954012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:23.954012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:23.954012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:23.954012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:23.954012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:23.954012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:23.954012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:23.955151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:23.955151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:23.955151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:23.955151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:23.955151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:23.955151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:23.955151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:23.955151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:23.955151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:23.955151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:23.955151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:23.955151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:23.955151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:23.955151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:23.955151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:23.955151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:23.956092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:23.956092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:23.956092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:23.956092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:23.956092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:23.956092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:23.956092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:23.956092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:23.956092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:23.956092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:23.956092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:23.956092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:23.956092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 319/639] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:23.956865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ff8ac-d37e-4091-984a-102f58c6cc66 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:23.957165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ff8ac-d37e-4091-984a-102f58c6cc66 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:23.957420 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ff8ac-d37e-4091-984a-102f58c6cc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:23.973809 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0646138-eb10-46be-bb36-a4ad137c4654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:23.974459 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0646138-eb10-46be-bb36-a4ad137c4654 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:23.975371 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0646138-eb10-46be-bb36-a4ad137c4654 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:23.975647 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0646138-eb10-46be-bb36-a4ad137c4654 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:23.976726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-450ff8ac-d37e-4091-984a-102f58c6cc66 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:23.977959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-450ff8ac-d37e-4091-984a-102f58c6cc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:23.983395 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0646138-eb10-46be-bb36-a4ad137c4654 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:23.984844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0646138-eb10-46be-bb36-a4ad137c4654 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:23.988456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:23.998435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-b0646138-eb10-46be-bb36-a4ad137c4654 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:13:23.998435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:23.998435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:23.998435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:23.998435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:23.998435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:23.998435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:23.998435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:23.998435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:23.998435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:23.998435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:23.998435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:23.998435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:23.998435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:23.998435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:23.998435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:24.001136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:24.002107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:24.002107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:24.002107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:24.002107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:24.002107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:24.002107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:24.002107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:24.002107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:24.002107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:13:24.002107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:24.004196 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 321/640] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:13:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:24.005061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0646138-eb10-46be-bb36-a4ad137c4654 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:24.016374 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:24.052246 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 320/641] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:24.053213 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ff8ac-d37e-4091-984a-102f58c6cc66 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:24.121968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0646138-eb10-46be-bb36-a4ad137c4654 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:24.157988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5add45-f2a5-475f-afeb-35e639009e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:24.158570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5add45-f2a5-475f-afeb-35e639009e92 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:24.158855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5add45-f2a5-475f-afeb-35e639009e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:24.159151 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5add45-f2a5-475f-afeb-35e639009e92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:24.161245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ff8ac-d37e-4091-984a-102f58c6cc66 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:24.170508 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5add45-f2a5-475f-afeb-35e639009e92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:24.171949 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5add45-f2a5-475f-afeb-35e639009e92 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:24.188241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-8c5add45-f2a5-475f-afeb-35e639009e92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:24.188241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:24.188241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:24.188241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:24.188241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:24.188241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:24.188241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:24.188241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:24.188241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:24.188241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:24.188241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:24.188241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:24.188241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:24.188241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:24.188241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:24.189644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:24.190619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:24.190619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:24.190619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:24.190619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:24.190619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 322/642] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:24.190619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5add45-f2a5-475f-afeb-35e639009e92 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:24.203208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1c5ab-1e9c-45c4-af1f-f4210f814c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:24.203832 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1c5ab-1e9c-45c4-af1f-f4210f814c61 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:24.204111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1c5ab-1e9c-45c4-af1f-f4210f814c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:24.204383 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1c5ab-1e9c-45c4-af1f-f4210f814c61 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:24.205088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1c5ab-1e9c-45c4-af1f-f4210f814c61 None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:24.205387 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1c5ab-1e9c-45c4-af1f-f4210f814c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:24.206759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1c5ab-1e9c-45c4-af1f-f4210f814c61 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:24.215699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 321/643] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:24.216477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1c5ab-1e9c-45c4-af1f-f4210f814c61 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:24.227349 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:24.269189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:24.313298 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5add45-f2a5-475f-afeb-35e639009e92 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:24.330637 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1c5ab-1e9c-45c4-af1f-f4210f814c61 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:24.351368 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c28b9-3256-4c8a-84ca-ed64075896ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:24.352052 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c28b9-3256-4c8a-84ca-ed64075896ad None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:24.352333 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c28b9-3256-4c8a-84ca-ed64075896ad None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:24.352858 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c28b9-3256-4c8a-84ca-ed64075896ad None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:24.353450 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c28b9-3256-4c8a-84ca-ed64075896ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:24.353771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c28b9-3256-4c8a-84ca-ed64075896ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:24.355218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c28b9-3256-4c8a-84ca-ed64075896ad None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:24.367469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac3c29-5738-4523-b2e1-13eb6b54be1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:24.368162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac3c29-5738-4523-b2e1-13eb6b54be1c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:24.368443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac3c29-5738-4523-b2e1-13eb6b54be1c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:24.368718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac3c29-5738-4523-b2e1-13eb6b54be1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:24.379484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 323/644] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jul 28 05:13:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:24.379484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c28b9-3256-4c8a-84ca-ed64075896ad None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:24.388985 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac3c29-5738-4523-b2e1-13eb6b54be1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:24.394494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-94ac3c29-5738-4523-b2e1-13eb6b54be1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:24.394494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:24.394494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:24.394494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:24.394494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:24.394494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:24.394494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:24.394494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:24.394494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:24.394494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:24.394494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:24.394494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:24.394494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:24.394494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:24.394494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:24.394494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:24.395417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:24.395417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:24.395417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:24.395417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:24.395417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:24.395417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:24.395417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:24.395417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:24.395417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:24.395417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:24.395417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:24.395417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:24.395417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:24.395417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:24.395417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:24.395417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:24.396391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:24.396391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:24.396391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:24.396391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:24.396391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:24.396391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:24.396391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:24.396391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:24.396391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:24.396391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:24.396391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:24.396391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:24.396391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 322/645] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:24.399244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac3c29-5738-4523-b2e1-13eb6b54be1c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:24.466790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:24.497635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c28b9-3256-4c8a-84ca-ed64075896ad None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:24.501742 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac3c29-5738-4523-b2e1-13eb6b54be1c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:24.519217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:24.535888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafc14a-2ebf-4996-95fd-165eacab35fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:24.536751 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafc14a-2ebf-4996-95fd-165eacab35fd None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:24.537105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafc14a-2ebf-4996-95fd-165eacab35fd None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:24.537619 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafc14a-2ebf-4996-95fd-165eacab35fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:24.538870 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b30c4-48d4-4e8a-9077-b0287296679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:24.539660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b30c4-48d4-4e8a-9077-b0287296679c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:24.539947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b30c4-48d4-4e8a-9077-b0287296679c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:24.540535 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b30c4-48d4-4e8a-9077-b0287296679c None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:24.541236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b30c4-48d4-4e8a-9077-b0287296679c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:24.541582 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b30c4-48d4-4e8a-9077-b0287296679c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:24.542941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b30c4-48d4-4e8a-9077-b0287296679c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:24.548352 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafc14a-2ebf-4996-95fd-165eacab35fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:24.549804 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafc14a-2ebf-4996-95fd-165eacab35fd None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:24.555706 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 324/646] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:24.556424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b30c4-48d4-4e8a-9077-b0287296679c None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:24.570477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-faafc14a-2ebf-4996-95fd-165eacab35fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:24.570477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:24.570477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:24.570477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:24.570477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:24.570477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:24.570477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:24.570477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:24.570477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:24.570477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:24.570477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:24.570477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:24.570477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:24.570477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:24.570477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:24.571358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:24.572236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:24.572236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:24.572236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:24.572236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:24.572236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 323/647] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:24.573116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafc14a-2ebf-4996-95fd-165eacab35fd None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:24.666019 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b30c4-48d4-4e8a-9077-b0287296679c None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:24.680552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafc14a-2ebf-4996-95fd-165eacab35fd None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:24.698930 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:24.701916 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f78aa-e55b-4675-8664-83ecbc0c6ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:24.702552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f78aa-e55b-4675-8664-83ecbc0c6ebb None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:24.702829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f78aa-e55b-4675-8664-83ecbc0c6ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:24.703107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f78aa-e55b-4675-8664-83ecbc0c6ebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:24.719183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a1ca4-36f2-4d3e-9231-a19753c3d98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:24.719741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a1ca4-36f2-4d3e-9231-a19753c3d98f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:24.720022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a1ca4-36f2-4d3e-9231-a19753c3d98f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:24.720295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a1ca4-36f2-4d3e-9231-a19753c3d98f None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:24.721011 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a1ca4-36f2-4d3e-9231-a19753c3d98f None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:24.721315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a1ca4-36f2-4d3e-9231-a19753c3d98f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:24.722702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a1ca4-36f2-4d3e-9231-a19753c3d98f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:24.731877 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 324/648] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:24.736534 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a1ca4-36f2-4d3e-9231-a19753c3d98f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:24.759060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:24.781221 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f78aa-e55b-4675-8664-83ecbc0c6ebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:24.782748 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f78aa-e55b-4675-8664-83ecbc0c6ebb None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:24.844263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a1ca4-36f2-4d3e-9231-a19753c3d98f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:24.885426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0900e-79b2-4e2d-8999-036c589d7bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:24.886094 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0900e-79b2-4e2d-8999-036c589d7bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:24.886378 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0900e-79b2-4e2d-8999-036c589d7bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:24.886654 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0900e-79b2-4e2d-8999-036c589d7bb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:24.888756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 325/649] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:24.889650 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f78aa-e55b-4675-8664-83ecbc0c6ebb None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:24.899516 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0900e-79b2-4e2d-8999-036c589d7bb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:24.901350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0900e-79b2-4e2d-8999-036c589d7bb7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:24.915056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-fdd0900e-79b2-4e2d-8999-036c589d7bb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:24.915056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:24.915056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:24.915056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:24.915056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:24.915056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:24.915056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:24.915056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:24.915056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:24.915056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:24.915056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:24.915056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:24.915056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:24.915056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:24.915056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:24.915956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:24.916815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:24.916815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:24.916815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:24.916815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:24.916815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:24.916815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:24.916815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:24.916815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:24.916815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 325/650] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:24.917306 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0900e-79b2-4e2d-8999-036c589d7bb7 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:24.963922 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:24.977733 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:25.001666 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f78aa-e55b-4675-8664-83ecbc0c6ebb None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:25.029324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0900e-79b2-4e2d-8999-036c589d7bb7 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:25.036074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27b847-e3fb-4fd8-9764-a283d9abfbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:25.036996 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27b847-e3fb-4fd8-9764-a283d9abfbb7 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:25.038210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27b847-e3fb-4fd8-9764-a283d9abfbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:25.039140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27b847-e3fb-4fd8-9764-a283d9abfbb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:25.039839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27b847-e3fb-4fd8-9764-a283d9abfbb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:25.040147 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27b847-e3fb-4fd8-9764-a283d9abfbb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:25.041545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27b847-e3fb-4fd8-9764-a283d9abfbb7 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:25.055095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 326/651] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:25.055774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27b847-e3fb-4fd8-9764-a283d9abfbb7 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:25.069879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fc067-bd22-4a6b-90c3-b95b86a1565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:25.070533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fc067-bd22-4a6b-90c3-b95b86a1565d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:25.070815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fc067-bd22-4a6b-90c3-b95b86a1565d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:25.071090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fc067-bd22-4a6b-90c3-b95b86a1565d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:25.081823 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fc067-bd22-4a6b-90c3-b95b86a1565d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:25.083270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fc067-bd22-4a6b-90c3-b95b86a1565d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:25.098100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-941fc067-bd22-4a6b-90c3-b95b86a1565d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:25.098100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:25.098100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:25.098100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:25.098100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:25.098100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:25.098100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:25.098100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:25.098100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:25.098100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:25.098100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:25.098100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:25.098100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:25.098100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:25.098100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:25.099010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:25.100716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:25.100716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:25.100716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:25.100716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:25.100716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 326/652] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:25.100716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fc067-bd22-4a6b-90c3-b95b86a1565d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:25.166270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27b847-e3fb-4fd8-9764-a283d9abfbb7 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:25.203383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf04e9-44c4-4472-ba29-0472293b5ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:25.204347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf04e9-44c4-4472-ba29-0472293b5ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:25.204814 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf04e9-44c4-4472-ba29-0472293b5ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:25.205276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf04e9-44c4-4472-ba29-0472293b5ec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:25.212499 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:25.212966 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:25.217161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf04e9-44c4-4472-ba29-0472293b5ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:25.222696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf04e9-44c4-4472-ba29-0472293b5ec1 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:25.222805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fc067-bd22-4a6b-90c3-b95b86a1565d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:25.233499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-2ddf04e9-44c4-4472-ba29-0472293b5ec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:25.233499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:25.233499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:25.233499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:25.233499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:25.233499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:25.233499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:25.233499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:25.233499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:25.233499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:25.233499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:25.233499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:25.233499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:25.233499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:25.233499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:25.234678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:25.235774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:25.235774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:25.235774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:25.235774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:25.235774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 327/653] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:25.237553 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf04e9-44c4-4472-ba29-0472293b5ec1 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:25.266588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fbb02-01af-49cd-9a17-3d9592dc4ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:25.267248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fbb02-01af-49cd-9a17-3d9592dc4ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:25.267548 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fbb02-01af-49cd-9a17-3d9592dc4ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:25.267778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fbb02-01af-49cd-9a17-3d9592dc4ec7 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:25.268596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fbb02-01af-49cd-9a17-3d9592dc4ec7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:25.268840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fbb02-01af-49cd-9a17-3d9592dc4ec7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:25.270289 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fbb02-01af-49cd-9a17-3d9592dc4ec7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:25.283361 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 327/654] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:25.286465 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fbb02-01af-49cd-9a17-3d9592dc4ec7 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:25.344306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf04e9-44c4-4472-ba29-0472293b5ec1 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:25.377677 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335cd36d-b19a-439f-a444-9c20bcb27769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:25.378316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cd36d-b19a-439f-a444-9c20bcb27769 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:25.378589 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cd36d-b19a-439f-a444-9c20bcb27769 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:25.378868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cd36d-b19a-439f-a444-9c20bcb27769 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:25.385955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fbb02-01af-49cd-9a17-3d9592dc4ec7 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:25.386838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335cd36d-b19a-439f-a444-9c20bcb27769 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:25.388267 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335cd36d-b19a-439f-a444-9c20bcb27769 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:25.399790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-335cd36d-b19a-439f-a444-9c20bcb27769 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:13:25.399790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:25.399790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:25.399790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:25.399790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:25.399790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:25.399790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:25.399790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:25.399790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:25.399790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:25.399790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:25.399790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:25.399790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:25.399790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:25.399790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:25.399790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:25.400726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:25.401679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:25.401679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:25.401679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:25.401679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:25.401679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:25.401679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:25.401679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:25.401679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:25.401679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:13:25.401679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:25.401679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 328/655] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:13:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:25.401679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335cd36d-b19a-439f-a444-9c20bcb27769 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:25.425928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c52ad0-7fee-4987-a359-3503f8a8d8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:25.426545 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c52ad0-7fee-4987-a359-3503f8a8d8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:25.426821 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c52ad0-7fee-4987-a359-3503f8a8d8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:25.427096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c52ad0-7fee-4987-a359-3503f8a8d8e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:25.427802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c52ad0-7fee-4987-a359-3503f8a8d8e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:25.428144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c52ad0-7fee-4987-a359-3503f8a8d8e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:25.429621 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c52ad0-7fee-4987-a359-3503f8a8d8e6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:25.440776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 328/656] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:25.441995 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0262e01-ef61-441e-8126-851c2c0d9d52 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:25.442286 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0262e01-ef61-441e-8126-851c2c0d9d52 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:25.442564 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0262e01-ef61-441e-8126-851c2c0d9d52 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:25.447807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 329/657] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:25.448575 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0262e01-ef61-441e-8126-851c2c0d9d52 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:25.451446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:25.463764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:25.501608 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335cd36d-b19a-439f-a444-9c20bcb27769 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:25.534884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb303fa-ff3c-4cc9-8fb5-9e948a0b6b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:25.535501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb303fa-ff3c-4cc9-8fb5-9e948a0b6b37 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:25.535778 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb303fa-ff3c-4cc9-8fb5-9e948a0b6b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:25.536060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb303fa-ff3c-4cc9-8fb5-9e948a0b6b37 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:25.536741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb303fa-ff3c-4cc9-8fb5-9e948a0b6b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:25.537156 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb303fa-ff3c-4cc9-8fb5-9e948a0b6b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:25.539115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb303fa-ff3c-4cc9-8fb5-9e948a0b6b37 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:25.550692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 329/658] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:25.551387 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb303fa-ff3c-4cc9-8fb5-9e948a0b6b37 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:25.556177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0262e01-ef61-441e-8126-851c2c0d9d52 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:25.590408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72bfc6-14fd-4ea1-b7d5-884de92bfb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:25.591028 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72bfc6-14fd-4ea1-b7d5-884de92bfb81 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:25.591311 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72bfc6-14fd-4ea1-b7d5-884de92bfb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:25.591584 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72bfc6-14fd-4ea1-b7d5-884de92bfb81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:25.592375 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72bfc6-14fd-4ea1-b7d5-884de92bfb81 None admin] RBAC: Adding query filter params (role.id=04fcac2c505f40a89923fa2f26cf548c, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=99d8c709e6f4462c98c055cb03eebf42) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:25.592684 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72bfc6-14fd-4ea1-b7d5-884de92bfb81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:25.594171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72bfc6-14fd-4ea1-b7d5-884de92bfb81 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:25.600892 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 330/659] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:25 2022] GET /identity/v3/role_assignments?user.id=99d8c709e6f4462c98c055cb03eebf42&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=04fcac2c505f40a89923fa2f26cf548c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:25.601723 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72bfc6-14fd-4ea1-b7d5-884de92bfb81 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:25.659053 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb303fa-ff3c-4cc9-8fb5-9e948a0b6b37 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:25.672398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:25.700306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb60fb-351e-4e2d-af01-3efa52ee043b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:25.701243 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb60fb-351e-4e2d-af01-3efa52ee043b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:25.701353 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:25.701796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb60fb-351e-4e2d-af01-3efa52ee043b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:25.702232 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb60fb-351e-4e2d-af01-3efa52ee043b None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:25.703194 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb60fb-351e-4e2d-af01-3efa52ee043b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:25.704008 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb60fb-351e-4e2d-af01-3efa52ee043b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:25.705888 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb60fb-351e-4e2d-af01-3efa52ee043b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:25.727602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72bfc6-14fd-4ea1-b7d5-884de92bfb81 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:25.732728 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 330/660] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jul 28 05:13:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:25.732728 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eecfdd-9955-46c1-9d94-7dae2432f439 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:25.732728 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eecfdd-9955-46c1-9d94-7dae2432f439 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:25.732728 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eecfdd-9955-46c1-9d94-7dae2432f439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:25.749436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-74eecfdd-9955-46c1-9d94-7dae2432f439 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:25.750741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-74eecfdd-9955-46c1-9d94-7dae2432f439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:25.774098 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592ec76-be83-42f3-a8b2-d0909f746126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:25.775430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592ec76-be83-42f3-a8b2-d0909f746126 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:25.775430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592ec76-be83-42f3-a8b2-d0909f746126 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:25.775430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592ec76-be83-42f3-a8b2-d0909f746126 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:25.783630 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592ec76-be83-42f3-a8b2-d0909f746126 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:25.785076 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592ec76-be83-42f3-a8b2-d0909f746126 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:25.798175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-d592ec76-be83-42f3-a8b2-d0909f746126 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:13:25.798175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:25.798175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:25.798175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:25.798175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:25.798175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:25.798175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:25.798175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:25.798175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:25.798175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:25.798175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:25.798175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:25.798175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:25.798175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:25.798175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:25.798175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:25.799118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:25.800300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:25.800300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:25.800300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:25.800300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:25.800300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:25.800300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:25.800300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:25.800300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:25.800300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:13:25.800300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:25.800300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 331/661] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:25.800300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592ec76-be83-42f3-a8b2-d0909f746126 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:25.838599 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 331/662] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:25.839733 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eecfdd-9955-46c1-9d94-7dae2432f439 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:25.910144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592ec76-be83-42f3-a8b2-d0909f746126 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:25.955094 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53b5a1-6270-4e32-abee-094f0cc337e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:25.955673 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:25.957251 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53b5a1-6270-4e32-abee-094f0cc337e6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:25.957833 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53b5a1-6270-4e32-abee-094f0cc337e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:25.958123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53b5a1-6270-4e32-abee-094f0cc337e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:25.960272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eecfdd-9955-46c1-9d94-7dae2432f439 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:25.961850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:25.966483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53b5a1-6270-4e32-abee-094f0cc337e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:25.975334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53b5a1-6270-4e32-abee-094f0cc337e6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:25.979439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-9a53b5a1-6270-4e32-abee-094f0cc337e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:25.979439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:25.979439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:25.979439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:25.979439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:25.979439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:25.979439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:25.979439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:25.979439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:25.979439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:25.979439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:25.979439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:25.979439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:25.979439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:25.979439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:25.980412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:25.981345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:25.981345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:25.981345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:25.981345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:25.981345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:25.981345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:25.981345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:25.981345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:25.981345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 332/663] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:25.982269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53b5a1-6270-4e32-abee-094f0cc337e6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:26.003139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f298153-996e-4d38-8189-3bbe434cb673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:26.003766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f298153-996e-4d38-8189-3bbe434cb673 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:26.004051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f298153-996e-4d38-8189-3bbe434cb673 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:26.004325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f298153-996e-4d38-8189-3bbe434cb673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:26.078514 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f298153-996e-4d38-8189-3bbe434cb673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:26.079901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f298153-996e-4d38-8189-3bbe434cb673 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:26.110168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53b5a1-6270-4e32-abee-094f0cc337e6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:26.151302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30672ed9-f9f8-4fbf-84ac-922f022a0d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:26.151930 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30672ed9-f9f8-4fbf-84ac-922f022a0d4b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:26.152274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30672ed9-f9f8-4fbf-84ac-922f022a0d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:26.152554 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30672ed9-f9f8-4fbf-84ac-922f022a0d4b None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:26.153558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30672ed9-f9f8-4fbf-84ac-922f022a0d4b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:26.153988 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30672ed9-f9f8-4fbf-84ac-922f022a0d4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:26.155525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30672ed9-f9f8-4fbf-84ac-922f022a0d4b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:26.178712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 333/664] 10.222.0.33 () {56 vars in 1139 bytes} [Thu Jul 28 05:13:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:26.179471 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30672ed9-f9f8-4fbf-84ac-922f022a0d4b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:26.181349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:26.191101 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 332/665] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:26.191101 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f298153-996e-4d38-8189-3bbe434cb673 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:26.242870 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:26.288133 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f298153-996e-4d38-8189-3bbe434cb673 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:26.295930 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30672ed9-f9f8-4fbf-84ac-922f022a0d4b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:26.322825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df90f9-5253-4460-b6f4-7b4ca558ba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:26.323448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df90f9-5253-4460-b6f4-7b4ca558ba41 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:26.327840 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df90f9-5253-4460-b6f4-7b4ca558ba41 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:26.327840 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df90f9-5253-4460-b6f4-7b4ca558ba41 None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:26.327840 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df90f9-5253-4460-b6f4-7b4ca558ba41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:26.327840 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df90f9-5253-4460-b6f4-7b4ca558ba41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:26.327840 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df90f9-5253-4460-b6f4-7b4ca558ba41 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:26.335283 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5e67f-26d5-42d6-8f67-4707c1ba6801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:26.335934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5e67f-26d5-42d6-8f67-4707c1ba6801 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:26.336220 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5e67f-26d5-42d6-8f67-4707c1ba6801 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:26.336515 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5e67f-26d5-42d6-8f67-4707c1ba6801 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:26.339499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 333/666] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:26.339912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df90f9-5253-4460-b6f4-7b4ca558ba41 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:26.351851 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5e67f-26d5-42d6-8f67-4707c1ba6801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:26.356961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-cfa5e67f-26d5-42d6-8f67-4707c1ba6801 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:26.356961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:26.356961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:26.356961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:26.356961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:26.356961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:26.356961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:26.356961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:26.356961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:26.356961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:26.356961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:26.356961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:26.356961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:26.356961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:26.356961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:26.356961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:26.359674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:26.359674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:26.359674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:26.359674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:26.359674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:26.359674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:26.359674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:26.359674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:26.359674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:26.359674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:26.359674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:26.359674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:26.359674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:26.359674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:26.359674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:26.359674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:26.362152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:26.362152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:26.362152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:26.362152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:26.362152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:26.362152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:26.362152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:26.362152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:26.362152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:26.362152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:26.362152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:26.362152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:26.364089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 334/667] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:26.364089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5e67f-26d5-42d6-8f67-4707c1ba6801 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:26.403528 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:26.445034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df90f9-5253-4460-b6f4-7b4ca558ba41 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:26.468411 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5e67f-26d5-42d6-8f67-4707c1ba6801 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:26.483579 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:26.485748 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9479775-3237-4e9f-b9d0-190932441f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:26.486533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9479775-3237-4e9f-b9d0-190932441f4e None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:26.486817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9479775-3237-4e9f-b9d0-190932441f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:26.487379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9479775-3237-4e9f-b9d0-190932441f4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:26.506211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068a5db-129a-42a5-a52d-e12739778a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:26.506864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068a5db-129a-42a5-a52d-e12739778a7f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:26.507150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068a5db-129a-42a5-a52d-e12739778a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:26.507537 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068a5db-129a-42a5-a52d-e12739778a7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:26.518476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068a5db-129a-42a5-a52d-e12739778a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:26.519929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068a5db-129a-42a5-a52d-e12739778a7f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:26.534520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-8068a5db-129a-42a5-a52d-e12739778a7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:26.534520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:26.534520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:26.534520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:26.534520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:26.534520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:26.534520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:26.534520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:26.534520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:26.534520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:26.534520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:26.534520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:26.534520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:26.534520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:26.534520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:26.535422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:26.536875 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:26.536875 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:26.536875 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:26.536875 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:26.536875 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 335/668] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:26.536875 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068a5db-129a-42a5-a52d-e12739778a7f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:26.566477 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9479775-3237-4e9f-b9d0-190932441f4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:26.567916 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9479775-3237-4e9f-b9d0-190932441f4e None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:26.627862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:26.641434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068a5db-129a-42a5-a52d-e12739778a7f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:26.673449 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 334/669] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:26.674600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9479775-3237-4e9f-b9d0-190932441f4e None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:26.680372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a3df5-d80f-4b58-9fc9-02758747b37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:26.681222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a3df5-d80f-4b58-9fc9-02758747b37e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:26.681533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a3df5-d80f-4b58-9fc9-02758747b37e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:26.681815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a3df5-d80f-4b58-9fc9-02758747b37e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:26.682607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a3df5-d80f-4b58-9fc9-02758747b37e None admin] RBAC: Adding query filter params (role.id=04fcac2c505f40a89923fa2f26cf548c, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=628ef75fa7194253bcf6cd6c85211738) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:26.682923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a3df5-d80f-4b58-9fc9-02758747b37e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:26.684350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a3df5-d80f-4b58-9fc9-02758747b37e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:26.701506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 336/670] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:26 2022] GET /identity/v3/role_assignments?user.id=628ef75fa7194253bcf6cd6c85211738&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=04fcac2c505f40a89923fa2f26cf548c => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:26.701506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a3df5-d80f-4b58-9fc9-02758747b37e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:26.731998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:26.819148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9479775-3237-4e9f-b9d0-190932441f4e None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:26.830743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a3df5-d80f-4b58-9fc9-02758747b37e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:26.864491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1a20d-ff2d-49e7-ab8e-e8840a412380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:26.866098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1a20d-ff2d-49e7-ab8e-e8840a412380 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:26.866517 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1a20d-ff2d-49e7-ab8e-e8840a412380 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:26.866797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1a20d-ff2d-49e7-ab8e-e8840a412380 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:26.868349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1a20d-ff2d-49e7-ab8e-e8840a412380 None admin] RBAC: Adding query filter params (name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:26.868349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1a20d-ff2d-49e7-ab8e-e8840a412380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:26.869846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1a20d-ff2d-49e7-ab8e-e8840a412380 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:26.878014 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4be01-d649-417e-a276-504a0933b801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:26.878587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4be01-d649-417e-a276-504a0933b801 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:26.878866 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4be01-d649-417e-a276-504a0933b801 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:26.879135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4be01-d649-417e-a276-504a0933b801 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:26.881608 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 335/671] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:26.881742 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4be01-d649-417e-a276-504a0933b801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:26.881742 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4be01-d649-417e-a276-504a0933b801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:26.881899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1a20d-ff2d-49e7-ab8e-e8840a412380 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:26.882361 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4be01-d649-417e-a276-504a0933b801 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:26.899673 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 337/672] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:26.900851 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4be01-d649-417e-a276-504a0933b801 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:26.906268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:27.006638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1a20d-ff2d-49e7-ab8e-e8840a412380 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:27.014211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:27.025443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4be01-d649-417e-a276-504a0933b801 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:27.052408 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee72eb4-e2f0-4ac0-bb4a-6df686fc6225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:27.053533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee72eb4-e2f0-4ac0-bb4a-6df686fc6225 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:27.053823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee72eb4-e2f0-4ac0-bb4a-6df686fc6225 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:27.054100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee72eb4-e2f0-4ac0-bb4a-6df686fc6225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:27.063637 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21944e1-44c9-4832-b879-84759a806b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:27.064371 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21944e1-44c9-4832-b879-84759a806b2d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:27.064753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21944e1-44c9-4832-b879-84759a806b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:27.065199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21944e1-44c9-4832-b879-84759a806b2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:27.067697 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee72eb4-e2f0-4ac0-bb4a-6df686fc6225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:27.069655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee72eb4-e2f0-4ac0-bb4a-6df686fc6225 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:27.076397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21944e1-44c9-4832-b879-84759a806b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:27.078107 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21944e1-44c9-4832-b879-84759a806b2d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:27.087164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-7ee72eb4-e2f0-4ac0-bb4a-6df686fc6225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:27.087164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:27.087164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:27.087164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:27.087164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:27.087164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:27.087164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:27.087164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:27.087164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:27.087164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:27.087164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:27.087164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:27.087164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:27.087164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:27.087164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:27.088114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:27.088998 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:27.088998 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:27.088998 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:27.088998 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:27.089505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 336/673] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:27.090163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee72eb4-e2f0-4ac0-bb4a-6df686fc6225 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:27.099395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-d21944e1-44c9-4832-b879-84759a806b2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:27.099395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:27.099395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:27.099395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:27.099395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:27.099395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:27.099395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:27.099395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:27.099395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:27.099395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:27.099395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:27.099395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:27.099395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:27.099395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:27.099395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:27.100894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:27.102986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:27.102986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:27.102986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:27.102986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:27.102986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 338/674] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:27.102986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21944e1-44c9-4832-b879-84759a806b2d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:27.183610 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:27.222289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee72eb4-e2f0-4ac0-bb4a-6df686fc6225 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:27.228012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21944e1-44c9-4832-b879-84759a806b2d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:27.270140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a2bca-bdec-41a6-865a-032911b64a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:27.271201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2bca-bdec-41a6-865a-032911b64a06 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:27.272687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2bca-bdec-41a6-865a-032911b64a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:27.273272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2bca-bdec-41a6-865a-032911b64a06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:27.281724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02afe5c-0754-41aa-a35a-9b6360f590b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:27.282321 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a2bca-bdec-41a6-865a-032911b64a06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:27.282450 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02afe5c-0754-41aa-a35a-9b6360f590b2 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:27.282828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02afe5c-0754-41aa-a35a-9b6360f590b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:27.283177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02afe5c-0754-41aa-a35a-9b6360f590b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:27.283949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02afe5c-0754-41aa-a35a-9b6360f590b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:27.284325 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02afe5c-0754-41aa-a35a-9b6360f590b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:27.284715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a2bca-bdec-41a6-865a-032911b64a06 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:27.286060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02afe5c-0754-41aa-a35a-9b6360f590b2 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:27.298530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-3d0a2bca-bdec-41a6-865a-032911b64a06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:27.298530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:27.298530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:27.298530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:27.298530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:27.298530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:27.298530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:27.298530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:27.298530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:27.298530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:27.298530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:27.298530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:27.298530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:27.298530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:27.298530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:27.299496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:27.300373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:27.300373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:27.300373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:27.300373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:27.300373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:27.300373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:27.300373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:27.300373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:27.301408 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 337/675] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:27.302013 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a2bca-bdec-41a6-865a-032911b64a06 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:27.305801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 339/676] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:27.306898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02afe5c-0754-41aa-a35a-9b6360f590b2 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:27.310920 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:27.413792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02afe5c-0754-41aa-a35a-9b6360f590b2 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:27.422385 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a2bca-bdec-41a6-865a-032911b64a06 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:27.450447 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4b837-8c8b-4b33-8984-ed16af262b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:27.451386 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4b837-8c8b-4b33-8984-ed16af262b7c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:27.451903 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4b837-8c8b-4b33-8984-ed16af262b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:27.452402 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4b837-8c8b-4b33-8984-ed16af262b7c None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:27.453346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4b837-8c8b-4b33-8984-ed16af262b7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:27.453878 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4b837-8c8b-4b33-8984-ed16af262b7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:27.454986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:27.455730 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4b837-8c8b-4b33-8984-ed16af262b7c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:27.461373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4afde-1005-4cdd-9a54-0b8f5c037466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:27.462031 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4afde-1005-4cdd-9a54-0b8f5c037466 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:27.462316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4afde-1005-4cdd-9a54-0b8f5c037466 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:27.462655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4afde-1005-4cdd-9a54-0b8f5c037466 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:27.463351 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4afde-1005-4cdd-9a54-0b8f5c037466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:27.463664 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4afde-1005-4cdd-9a54-0b8f5c037466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:27.465272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4afde-1005-4cdd-9a54-0b8f5c037466 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:27.470818 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 340/677] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:27.472885 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4b837-8c8b-4b33-8984-ed16af262b7c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:27.483148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 338/678] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:27.483148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4afde-1005-4cdd-9a54-0b8f5c037466 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:27.542871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:27.585334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4b837-8c8b-4b33-8984-ed16af262b7c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:27.598650 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4afde-1005-4cdd-9a54-0b8f5c037466 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:27.621677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f86197-9f75-4754-938d-d54305ee4265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:27.622678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f86197-9f75-4754-938d-d54305ee4265 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:27.623193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f86197-9f75-4754-938d-d54305ee4265 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:27.623680 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f86197-9f75-4754-938d-d54305ee4265 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:27.631099 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f86197-9f75-4754-938d-d54305ee4265 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:27.632793 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f86197-9f75-4754-938d-d54305ee4265 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:27.638025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb1459-f6af-465f-8378-3d1e9aebc81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:27.638648 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb1459-f6af-465f-8378-3d1e9aebc81a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:27.638938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb1459-f6af-465f-8378-3d1e9aebc81a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:27.639212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb1459-f6af-465f-8378-3d1e9aebc81a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:27.640005 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb1459-f6af-465f-8378-3d1e9aebc81a None admin] RBAC: Adding query filter params (role.id=04fcac2c505f40a89923fa2f26cf548c, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=bae981c7273843d4ac734dd876bebe5f) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:27.640316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb1459-f6af-465f-8378-3d1e9aebc81a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:27.641787 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb1459-f6af-465f-8378-3d1e9aebc81a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:27.647278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-41f86197-9f75-4754-938d-d54305ee4265 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:27.647278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:27.647278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:27.647278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:27.647278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:27.647278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:27.647278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:27.647278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:27.647278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:27.647278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:27.647278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:27.647278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:27.647278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:27.647278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:27.647278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:27.648160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:27.649049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:27.649049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:27.649049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:27.649049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:27.649049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:27.649049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:27.649049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:27.649049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:27.649505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 339/679] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:27 2022] GET /identity/v3/role_assignments?user.id=bae981c7273843d4ac734dd876bebe5f&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=04fcac2c505f40a89923fa2f26cf548c => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:27.650030 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb1459-f6af-465f-8378-3d1e9aebc81a None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:27.651760 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 341/680] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:27.659067 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f86197-9f75-4754-938d-d54305ee4265 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:27.732543 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:27.781152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb1459-f6af-465f-8378-3d1e9aebc81a None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:27.823439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f86197-9f75-4754-938d-d54305ee4265 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:27.831139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc9652-7b63-4d1a-a2d6-61cbbe10e992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:27.832808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc9652-7b63-4d1a-a2d6-61cbbe10e992 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:27.833317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc9652-7b63-4d1a-a2d6-61cbbe10e992 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:27.833833 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc9652-7b63-4d1a-a2d6-61cbbe10e992 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:27.845790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc9652-7b63-4d1a-a2d6-61cbbe10e992 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:27.848260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc9652-7b63-4d1a-a2d6-61cbbe10e992 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:27.851135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:27.863920 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcebb34-ffc4-43c5-b225-345a44ef0dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:27.864554 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcebb34-ffc4-43c5-b225-345a44ef0dfb None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:27.864838 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcebb34-ffc4-43c5-b225-345a44ef0dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:27.865144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcebb34-ffc4-43c5-b225-345a44ef0dfb None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:27.865670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-9cdc9652-7b63-4d1a-a2d6-61cbbe10e992 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:13:27.865670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:27.865670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:27.865670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:27.865670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:27.865670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:27.865670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:27.865670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:27.865670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:27.865670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:27.865670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:27.865670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:27.865670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:27.865670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:27.865670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:27.865670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:27.866696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:27.868043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:27.868043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:27.868043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:27.868043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:27.868043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:27.868043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:27.868043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:27.868043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:27.868043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:13:27.868043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:27.868610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcebb34-ffc4-43c5-b225-345a44ef0dfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:27.868610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcebb34-ffc4-43c5-b225-345a44ef0dfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:27.868759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 340/681] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:13:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:27.868759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2ea2f-2d05-408a-a256-a15e440f3ef3 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:27.868903 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcebb34-ffc4-43c5-b225-345a44ef0dfb None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:27.868983 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2ea2f-2d05-408a-a256-a15e440f3ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:27.868983 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2ea2f-2d05-408a-a256-a15e440f3ef3 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:27.875153 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 341/682] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:27.876793 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2ea2f-2d05-408a-a256-a15e440f3ef3 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:27.889597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 342/683] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:27.890650 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da2a4b-513a-40c8-b0ab-66a033035d63 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:27.890944 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da2a4b-513a-40c8-b0ab-66a033035d63 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:27.891335 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da2a4b-513a-40c8-b0ab-66a033035d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:27.911098 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-26da2a4b-513a-40c8-b0ab-66a033035d63 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:27.912826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-26da2a4b-513a-40c8-b0ab-66a033035d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:28.003191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 343/684] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:28.004099 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da2a4b-513a-40c8-b0ab-66a033035d63 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:28.008068 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2ea2f-2d05-408a-a256-a15e440f3ef3 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:28.026262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:28.044643 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf7e37-4489-4c92-8ff5-54f6cb113a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:28.045269 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf7e37-4489-4c92-8ff5-54f6cb113a26 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:28.045573 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf7e37-4489-4c92-8ff5-54f6cb113a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:28.045851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf7e37-4489-4c92-8ff5-54f6cb113a26 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:28.046646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf7e37-4489-4c92-8ff5-54f6cb113a26 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:28.046950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf7e37-4489-4c92-8ff5-54f6cb113a26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:28.048405 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf7e37-4489-4c92-8ff5-54f6cb113a26 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:28.067002 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 342/685] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jul 28 05:13:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:28.067854 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf7e37-4489-4c92-8ff5-54f6cb113a26 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:28.123589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da2a4b-513a-40c8-b0ab-66a033035d63 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:28.141898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:28.163116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b299b-928f-4730-8a47-69996db2fafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:28.163844 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b299b-928f-4730-8a47-69996db2fafd None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:28.164128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b299b-928f-4730-8a47-69996db2fafd None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:28.164497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b299b-928f-4730-8a47-69996db2fafd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:28.165295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b299b-928f-4730-8a47-69996db2fafd None admin] RBAC: Adding query filter params (role.id=04fcac2c505f40a89923fa2f26cf548c, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=6907d8a429404b1c92805b364900ba60) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:28.165639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b299b-928f-4730-8a47-69996db2fafd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:28.167223 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b299b-928f-4730-8a47-69996db2fafd None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:28.173197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf7e37-4489-4c92-8ff5-54f6cb113a26 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:28.173742 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 344/686] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:28 2022] GET /identity/v3/role_assignments?user.id=6907d8a429404b1c92805b364900ba60&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=04fcac2c505f40a89923fa2f26cf548c => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:28.174712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b299b-928f-4730-8a47-69996db2fafd None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:28.213036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e12cb-6136-4bf5-af81-66acf6b53b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:28.213770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e12cb-6136-4bf5-af81-66acf6b53b2e None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:28.214049 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e12cb-6136-4bf5-af81-66acf6b53b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:28.214323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e12cb-6136-4bf5-af81-66acf6b53b2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:28.227517 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e12cb-6136-4bf5-af81-66acf6b53b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:28.232548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-f86e12cb-6136-4bf5-af81-66acf6b53b2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:13:28.232548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:28.232548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:28.232548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:28.232548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:28.232548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:28.232548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:28.232548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:28.232548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:28.232548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:28.232548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:28.232548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:28.232548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:28.232548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:28.232548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:28.232548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:28.233461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:28.233461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:28.233461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:28.233461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:28.233461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:28.233461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:28.233461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:28.233461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:28.233461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:28.233461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:28.233461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:28.233461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:28.233461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:28.233461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:28.233461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:28.233461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:28.235811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:28.235811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:28.235811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:28.235811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:28.235811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:28.235811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:28.235811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:28.235811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:28.235811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:28.235811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:28.235811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:13:28.235811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:28.235811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 343/687] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:13:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:28.249124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e12cb-6136-4bf5-af81-66acf6b53b2e None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:28.286804 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b299b-928f-4730-8a47-69996db2fafd None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:28.317631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:28.325887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b78c71-c8e6-4bbe-9b90-8640ce10f7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:28.328971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b78c71-c8e6-4bbe-9b90-8640ce10f7fd None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:28.328971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b78c71-c8e6-4bbe-9b90-8640ce10f7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:28.328971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b78c71-c8e6-4bbe-9b90-8640ce10f7fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:28.389854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:28.406143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b78c71-c8e6-4bbe-9b90-8640ce10f7fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:28.407897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b78c71-c8e6-4bbe-9b90-8640ce10f7fd None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:28.441131 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e12cb-6136-4bf5-af81-66acf6b53b2e None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:28.512824 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e83c01-f46d-477b-b6e2-63c77959540c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:28.513377 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e83c01-f46d-477b-b6e2-63c77959540c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:28.513686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e83c01-f46d-477b-b6e2-63c77959540c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:28.513958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e83c01-f46d-477b-b6e2-63c77959540c None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:28.514683 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e83c01-f46d-477b-b6e2-63c77959540c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:28.514990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e83c01-f46d-477b-b6e2-63c77959540c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:28.516349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e83c01-f46d-477b-b6e2-63c77959540c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:28.526165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 344/688] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:13:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:28.530934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e83c01-f46d-477b-b6e2-63c77959540c None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:28.532499 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 345/689] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:28.540637 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b78c71-c8e6-4bbe-9b90-8640ce10f7fd None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:28.642170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:28.660690 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:28.668358 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e83c01-f46d-477b-b6e2-63c77959540c None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:28.674614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b78c71-c8e6-4bbe-9b90-8640ce10f7fd None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:28.715609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa913d77-fa85-4fb8-8ef9-a96b48678b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:28.715609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa913d77-fa85-4fb8-8ef9-a96b48678b45 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:28.715609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa913d77-fa85-4fb8-8ef9-a96b48678b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:28.715609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa913d77-fa85-4fb8-8ef9-a96b48678b45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:28.718825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea6303-0095-4321-ab33-08de121ecde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:28.719472 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea6303-0095-4321-ab33-08de121ecde9 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:28.719752 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea6303-0095-4321-ab33-08de121ecde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:28.720023 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea6303-0095-4321-ab33-08de121ecde9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:28.730246 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa913d77-fa85-4fb8-8ef9-a96b48678b45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:28.731978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa913d77-fa85-4fb8-8ef9-a96b48678b45 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:28.734095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea6303-0095-4321-ab33-08de121ecde9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:28.735856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea6303-0095-4321-ab33-08de121ecde9 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:28.749882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-aa913d77-fa85-4fb8-8ef9-a96b48678b45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:28.749882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:28.749882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:28.749882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:28.749882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:28.749882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:28.749882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:28.749882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:28.749882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:28.749882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:28.749882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:28.749882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:28.749882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:28.749882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:28.749882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:28.750801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:28.751663 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:28.751663 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:28.751663 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:28.751663 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:28.752296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-e6ea6303-0095-4321-ab33-08de121ecde9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:28.752296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:28.752296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:28.752296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:28.752296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:28.752296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:28.752296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:28.752296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:28.752296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:28.752296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:28.752296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:28.752296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:28.752296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:28.752296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:28.752296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:28.753140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:28.754074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:28.754074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:28.754074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:28.754074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:28.754074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 345/690] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:28.756837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 346/691] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:28.759492 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea6303-0095-4321-ab33-08de121ecde9 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:28.762653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa913d77-fa85-4fb8-8ef9-a96b48678b45 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:28.880617 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa913d77-fa85-4fb8-8ef9-a96b48678b45 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:28.928901 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:28.935952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea6303-0095-4321-ab33-08de121ecde9 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:28.942703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc1eb8-57aa-4a16-a835-623a6924fdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:28.944886 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc1eb8-57aa-4a16-a835-623a6924fdfc None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:28.945351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc1eb8-57aa-4a16-a835-623a6924fdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:28.945834 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc1eb8-57aa-4a16-a835-623a6924fdfc None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:28.956155 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc1eb8-57aa-4a16-a835-623a6924fdfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:28.956155 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc1eb8-57aa-4a16-a835-623a6924fdfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:28.956155 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc1eb8-57aa-4a16-a835-623a6924fdfc None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:28.976271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 347/692] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:28.979446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc1eb8-57aa-4a16-a835-623a6924fdfc None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:29.008217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a06798-9470-408a-8821-5ebec610b916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:29.008857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a06798-9470-408a-8821-5ebec610b916 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:29.009136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a06798-9470-408a-8821-5ebec610b916 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:29.009410 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a06798-9470-408a-8821-5ebec610b916 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:29.010134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a06798-9470-408a-8821-5ebec610b916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:29.010441 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a06798-9470-408a-8821-5ebec610b916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:29.011818 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a06798-9470-408a-8821-5ebec610b916 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:29.035160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 346/693] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:29.037775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d052c15-53f1-4b3c-b44a-760f9ffc269c None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:29.038060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d052c15-53f1-4b3c-b44a-760f9ffc269c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:29.038336 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d052c15-53f1-4b3c-b44a-760f9ffc269c None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:29.040225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 347/694] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:29.042363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d052c15-53f1-4b3c-b44a-760f9ffc269c None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:29.057427 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:29.118923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc1eb8-57aa-4a16-a835-623a6924fdfc None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:29.155302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1ecd5-8327-4cbe-b7d9-bef08598e813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:29.156310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1ecd5-8327-4cbe-b7d9-bef08598e813 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:29.156812 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1ecd5-8327-4cbe-b7d9-bef08598e813 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:29.157293 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1ecd5-8327-4cbe-b7d9-bef08598e813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:29.161501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d052c15-53f1-4b3c-b44a-760f9ffc269c None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:29.170259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1ecd5-8327-4cbe-b7d9-bef08598e813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:29.172061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1ecd5-8327-4cbe-b7d9-bef08598e813 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:29.185079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-8ac1ecd5-8327-4cbe-b7d9-bef08598e813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:29.185079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:29.185079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:29.185079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:29.185079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:29.185079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:29.185079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:29.185079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:29.185079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:29.185079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:29.185079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:29.185079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:29.185079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:29.185079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:29.185079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:29.186005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:29.186912 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:29.186912 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:29.186912 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:29.186912 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:29.186912 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:29.186912 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:29.186912 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:29.186912 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:29.189666 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 348/695] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:29.191202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856de95-26e0-49e8-b6c5-3f556c67eb59 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:29.191704 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856de95-26e0-49e8-b6c5-3f556c67eb59 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:29.192240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856de95-26e0-49e8-b6c5-3f556c67eb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:29.203030 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a3424-3001-49b6-8181-df42185a60a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:29.203684 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a3424-3001-49b6-8181-df42185a60a7 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:29.203963 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a3424-3001-49b6-8181-df42185a60a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:29.204239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a3424-3001-49b6-8181-df42185a60a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:29.212549 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a3424-3001-49b6-8181-df42185a60a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:29.213373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-f856de95-26e0-49e8-b6c5-3f556c67eb59 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:29.214020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a3424-3001-49b6-8181-df42185a60a7 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:29.215096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f856de95-26e0-49e8-b6c5-3f556c67eb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:29.227092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-2f2a3424-3001-49b6-8181-df42185a60a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:13:29.227092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:29.227092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:29.227092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:29.227092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:29.227092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:29.227092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:29.227092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:29.227092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:29.227092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:29.227092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:29.227092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:29.227092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:29.227092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:29.227092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:29.227092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:29.228085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:29.229742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:29.229742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:29.229742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:29.229742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:29.229742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:29.229742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:29.229742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:29.229742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:29.229742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:13:29.229742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:29.229742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 348/696] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jul 28 05:13:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:29.229742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a3424-3001-49b6-8181-df42185a60a7 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:29.277592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:29.301890 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:29.308968 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 349/697] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:29.310187 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856de95-26e0-49e8-b6c5-3f556c67eb59 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:29.348062 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a3424-3001-49b6-8181-df42185a60a7 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:29.398376 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021037da-0d26-4a3c-8763-0a9f6ea441c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:29.400461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021037da-0d26-4a3c-8763-0a9f6ea441c1 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:29.400979 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021037da-0d26-4a3c-8763-0a9f6ea441c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:29.401505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021037da-0d26-4a3c-8763-0a9f6ea441c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:29.402481 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021037da-0d26-4a3c-8763-0a9f6ea441c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:29.402998 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021037da-0d26-4a3c-8763-0a9f6ea441c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:29.405108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021037da-0d26-4a3c-8763-0a9f6ea441c1 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:29.422831 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 349/698] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:29.424304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021037da-0d26-4a3c-8763-0a9f6ea441c1 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:29.433229 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856de95-26e0-49e8-b6c5-3f556c67eb59 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:29.469764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add1cdd-1a16-4c67-a575-d27218f9363d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:29.470398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add1cdd-1a16-4c67-a575-d27218f9363d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:29.470734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add1cdd-1a16-4c67-a575-d27218f9363d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:29.471016 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add1cdd-1a16-4c67-a575-d27218f9363d None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:29.471929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add1cdd-1a16-4c67-a575-d27218f9363d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:29.472243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add1cdd-1a16-4c67-a575-d27218f9363d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:29.473701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add1cdd-1a16-4c67-a575-d27218f9363d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:29.498021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 350/699] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jul 28 05:13:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:29.498769 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add1cdd-1a16-4c67-a575-d27218f9363d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:29.542907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:29.558580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021037da-0d26-4a3c-8763-0a9f6ea441c1 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:29.618089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add1cdd-1a16-4c67-a575-d27218f9363d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:29.656878 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41522f6f-2113-4198-b4a4-72eb98bdb0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:29.657951 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41522f6f-2113-4198-b4a4-72eb98bdb0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:29.658477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41522f6f-2113-4198-b4a4-72eb98bdb0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:29.658958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41522f6f-2113-4198-b4a4-72eb98bdb0c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:29.659981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41522f6f-2113-4198-b4a4-72eb98bdb0c6 None admin] RBAC: Adding query filter params (role.id=04fcac2c505f40a89923fa2f26cf548c, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=eb89e2ac885f42eb95fe3b67f3808ba9) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:29.660517 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41522f6f-2113-4198-b4a4-72eb98bdb0c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:29.663695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41522f6f-2113-4198-b4a4-72eb98bdb0c6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:29.671171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 351/700] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:29 2022] GET /identity/v3/role_assignments?user.id=eb89e2ac885f42eb95fe3b67f3808ba9&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=04fcac2c505f40a89923fa2f26cf548c => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:29.672481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41522f6f-2113-4198-b4a4-72eb98bdb0c6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:29.754806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:29.765251 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fbcc3-6c93-4574-9bb2-70bc178a91e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:29.766360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fbcc3-6c93-4574-9bb2-70bc178a91e5 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:29.768186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fbcc3-6c93-4574-9bb2-70bc178a91e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:29.768186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fbcc3-6c93-4574-9bb2-70bc178a91e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:29.780131 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fbcc3-6c93-4574-9bb2-70bc178a91e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:29.782141 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fbcc3-6c93-4574-9bb2-70bc178a91e5 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:29.799904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-ef1fbcc3-6c93-4574-9bb2-70bc178a91e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:29.799904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:29.799904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:29.799904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:29.799904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:29.799904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:29.799904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:29.799904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:29.799904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:29.799904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:29.799904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:29.799904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:29.799904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:29.799904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:29.799904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:29.800910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:29.801837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:29.801837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:29.801837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:29.801837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:29.809108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 350/701] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:29.811394 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fbcc3-6c93-4574-9bb2-70bc178a91e5 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:29.862383 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:29.867163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41522f6f-2113-4198-b4a4-72eb98bdb0c6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:29.907841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16307ee4-47b2-4be1-adde-52d9f43daef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:29.908576 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307ee4-47b2-4be1-adde-52d9f43daef4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:29.908904 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307ee4-47b2-4be1-adde-52d9f43daef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:29.909187 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307ee4-47b2-4be1-adde-52d9f43daef4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:29.926901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fbcc3-6c93-4574-9bb2-70bc178a91e5 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:29.968649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a9dce-2acb-42c5-8f60-1c55f133a7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:29.969540 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a9dce-2acb-42c5-8f60-1c55f133a7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:29.969999 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a9dce-2acb-42c5-8f60-1c55f133a7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:29.970423 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a9dce-2acb-42c5-8f60-1c55f133a7a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:29.971304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a9dce-2acb-42c5-8f60-1c55f133a7a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:29.971808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a9dce-2acb-42c5-8f60-1c55f133a7a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:29.973322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a9dce-2acb-42c5-8f60-1c55f133a7a1 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:29.991727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 351/702] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:29.993161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a9dce-2acb-42c5-8f60-1c55f133a7a1 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:29.999285 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16307ee4-47b2-4be1-adde-52d9f43daef4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:30.000841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16307ee4-47b2-4be1-adde-52d9f43daef4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:30.046347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:30.112307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a9dce-2acb-42c5-8f60-1c55f133a7a1 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:30.139209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:30.145702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 352/703] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:30.147647 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89eedf-0a85-4b93-9af5-0b6cd8cb17b3 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:30.148002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89eedf-0a85-4b93-9af5-0b6cd8cb17b3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:30.148514 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89eedf-0a85-4b93-9af5-0b6cd8cb17b3 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:30.150082 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 353/704] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:30.150782 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89eedf-0a85-4b93-9af5-0b6cd8cb17b3 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:30.154159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267733d9-ab72-4861-943e-7e5883a20c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:30.154719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267733d9-ab72-4861-943e-7e5883a20c32 None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:30.155170 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267733d9-ab72-4861-943e-7e5883a20c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:30.155613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267733d9-ab72-4861-943e-7e5883a20c32 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:30.156465 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267733d9-ab72-4861-943e-7e5883a20c32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:30.158120 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267733d9-ab72-4861-943e-7e5883a20c32 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:30.276325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 352/705] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:13:29 2022] POST /identity/v3/users => generated 254 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:13:30.278897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89eedf-0a85-4b93-9af5-0b6cd8cb17b3 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:30.282939 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa8862-473a-4b73-9b8e-d78916436fcb None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:30.283224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa8862-473a-4b73-9b8e-d78916436fcb None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:30.283518 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa8862-473a-4b73-9b8e-d78916436fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:30.324468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f7a41-47ee-472e-bac7-618d89f95dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:30.325493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f7a41-47ee-472e-bac7-618d89f95dbf None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:30.325978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f7a41-47ee-472e-bac7-618d89f95dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:30.326152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-15aa8862-473a-4b73-9b8e-d78916436fcb None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:30.326613 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f7a41-47ee-472e-bac7-618d89f95dbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:30.327613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-15aa8862-473a-4b73-9b8e-d78916436fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:30.341652 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f7a41-47ee-472e-bac7-618d89f95dbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:30.343489 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f7a41-47ee-472e-bac7-618d89f95dbf None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:30.363073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-758f7a41-47ee-472e-bac7-618d89f95dbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:30.363073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:30.363073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:30.363073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:30.363073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:30.363073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:30.363073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:30.363073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:30.363073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:30.363073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:30.363073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:30.363073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:30.363073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:30.363073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:30.363073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:30.364020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:30.364941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:30.364941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:30.364941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:30.364941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:30.368360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 354/706] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:30.376686 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f7a41-47ee-472e-bac7-618d89f95dbf None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:30.463074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 353/707] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:30.485776 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa8862-473a-4b73-9b8e-d78916436fcb None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:30.504955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:30.516749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:30.570690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f7a41-47ee-472e-bac7-618d89f95dbf None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:30.619764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653310a-40f4-464b-a750-01350af32e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:30.620318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653310a-40f4-464b-a750-01350af32e97 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:30.620597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653310a-40f4-464b-a750-01350af32e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:30.620877 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653310a-40f4-464b-a750-01350af32e97 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:30.621100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa8862-473a-4b73-9b8e-d78916436fcb None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:30.621601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653310a-40f4-464b-a750-01350af32e97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:30.621914 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653310a-40f4-464b-a750-01350af32e97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:30.623553 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653310a-40f4-464b-a750-01350af32e97 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:30.643120 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 355/708] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:30.648638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653310a-40f4-464b-a750-01350af32e97 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:30.671287 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5eaaed-6c55-4bbf-9315-cd4a019983ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:30.672674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eaaed-6c55-4bbf-9315-cd4a019983ba None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:30.673118 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eaaed-6c55-4bbf-9315-cd4a019983ba None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:30.673585 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eaaed-6c55-4bbf-9315-cd4a019983ba None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:30.674368 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5eaaed-6c55-4bbf-9315-cd4a019983ba None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:30.676275 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5eaaed-6c55-4bbf-9315-cd4a019983ba None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:30.691930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-6c5eaaed-6c55-4bbf-9315-cd4a019983ba None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:13:30.691930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:30.691930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:13:30.691930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:13:30.691930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:13:30.691930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:13:30.691930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:13:30.691930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:30.691930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:13:30.691930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:30.691930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:30.691930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:30.691930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:30.691930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:30.691930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:30.691930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:30.693164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:30.693164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:30.693164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:30.693164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:30.693164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:30.693164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:30.693164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:30.693164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:13:30.693164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:13:30.693164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:13:30.693164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:13:30.693164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:30.693164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:30.693164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:30.693164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:30.693164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:30.694692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:30.694692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:30.694692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:30.694692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:30.694692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:30.694692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:30.694692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:30.694692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:30.694692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:30.694692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:30.694692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:30.694692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:13:30.694692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:30.694692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:13:30.694692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:30.697736 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 354/709] 10.222.0.33 () {56 vars in 1129 bytes} [Thu Jul 28 05:13:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:30.701023 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5eaaed-6c55-4bbf-9315-cd4a019983ba None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:30.812332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653310a-40f4-464b-a750-01350af32e97 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:30.816429 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:30.828472 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5eaaed-6c55-4bbf-9315-cd4a019983ba None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:30.837718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:30.859795 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e1a0b-a896-40dc-b30f-df6550ac77a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:30.860577 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e1a0b-a896-40dc-b30f-df6550ac77a5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:30.860915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e1a0b-a896-40dc-b30f-df6550ac77a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:30.861251 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e1a0b-a896-40dc-b30f-df6550ac77a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:30.868392 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e1a0b-a896-40dc-b30f-df6550ac77a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:30.870096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e1a0b-a896-40dc-b30f-df6550ac77a5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:30.875115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5853e-30cf-43ee-bb79-59d21b504d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:30.875807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5853e-30cf-43ee-bb79-59d21b504d83 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:30.876357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5853e-30cf-43ee-bb79-59d21b504d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:30.876839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5853e-30cf-43ee-bb79-59d21b504d83 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:30.878011 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5853e-30cf-43ee-bb79-59d21b504d83 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:30.878374 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5853e-30cf-43ee-bb79-59d21b504d83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:30.879725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5853e-30cf-43ee-bb79-59d21b504d83 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:30.884042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-077e1a0b-a896-40dc-b30f-df6550ac77a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:30.884042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:30.884042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:30.884042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:30.884042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:30.884042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:30.884042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:30.884042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:30.884042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:30.884042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:30.884042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:30.884042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:30.884042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:30.884042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:30.884042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:30.887602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:30.888526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:30.888526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:30.888526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:30.888526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:30.888526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:30.888526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:30.888526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:30.888526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:30.888948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 355/710] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jul 28 05:13:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:30.888948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65859cde-b4fd-48b3-9316-629245f8ec11 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:30.888948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65859cde-b4fd-48b3-9316-629245f8ec11 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:30.888948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65859cde-b4fd-48b3-9316-629245f8ec11 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:30.888948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 356/711] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:30.893241 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 356/712] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:30.895355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e1a0b-a896-40dc-b30f-df6550ac77a5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:30.895944 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117336-9226-493d-8ba1-30b00ec5deb9 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:30.896786 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117336-9226-493d-8ba1-30b00ec5deb9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:30.897072 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117336-9226-493d-8ba1-30b00ec5deb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:30.922816 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-24117336-9226-493d-8ba1-30b00ec5deb9 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:30.924453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-24117336-9226-493d-8ba1-30b00ec5deb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:31.014625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 357/713] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:31.015943 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117336-9226-493d-8ba1-30b00ec5deb9 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:31.025558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e1a0b-a896-40dc-b30f-df6550ac77a5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:31.073888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0fcde-c4f2-4bef-a05b-6a38c5a967c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:31.074524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0fcde-c4f2-4bef-a05b-6a38c5a967c1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:31.074806 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0fcde-c4f2-4bef-a05b-6a38c5a967c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:31.075082 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0fcde-c4f2-4bef-a05b-6a38c5a967c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:31.075839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0fcde-c4f2-4bef-a05b-6a38c5a967c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:31.076329 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0fcde-c4f2-4bef-a05b-6a38c5a967c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:31.078641 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0fcde-c4f2-4bef-a05b-6a38c5a967c1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:31.102116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 357/714] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:31.102116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0fcde-c4f2-4bef-a05b-6a38c5a967c1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:31.131620 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:31.136582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:31.142373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117336-9226-493d-8ba1-30b00ec5deb9 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:31.183313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087d2d5-f8f7-4ba0-9a8a-036bec6be4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:31.183893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087d2d5-f8f7-4ba0-9a8a-036bec6be4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:31.184173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087d2d5-f8f7-4ba0-9a8a-036bec6be4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:31.184444 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087d2d5-f8f7-4ba0-9a8a-036bec6be4d3 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:31.185232 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087d2d5-f8f7-4ba0-9a8a-036bec6be4d3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:31.185578 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087d2d5-f8f7-4ba0-9a8a-036bec6be4d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:31.186937 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087d2d5-f8f7-4ba0-9a8a-036bec6be4d3 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:31.194644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 358/715] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jul 28 05:13:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:31.196317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087d2d5-f8f7-4ba0-9a8a-036bec6be4d3 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:31.282276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0fcde-c4f2-4bef-a05b-6a38c5a967c1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:31.387130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec237c-a89e-4b7b-9f55-76ff13a448d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:31.388397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec237c-a89e-4b7b-9f55-76ff13a448d5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:31.388874 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec237c-a89e-4b7b-9f55-76ff13a448d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:31.390218 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec237c-a89e-4b7b-9f55-76ff13a448d5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:31.391039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec237c-a89e-4b7b-9f55-76ff13a448d5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:31.392582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec237c-a89e-4b7b-9f55-76ff13a448d5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-b1ec237c-a89e-4b7b-9f55-76ff13a448d5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:31.405208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:31.406259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:31.406259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:31.406259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:31.406259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:31.406259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:31.406259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:31.406259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:13:31.406259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:13:31.406259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:13:31.406259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:13:31.406259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:31.406259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:31.406259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:31.406259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:31.406259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:31.406259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:31.407089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:31.407089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:31.407089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:31.407089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:31.407089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:31.407089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:31.407089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:31.407089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:31.407089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:31.407089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:31.407089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:13:31.407089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:31.407089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:13:31.407089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:31.408923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 358/716] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:31 2022] GET /identity/v3/services/network => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:31.414985 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec237c-a89e-4b7b-9f55-76ff13a448d5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:31.450149 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087d2d5-f8f7-4ba0-9a8a-036bec6be4d3 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:31.489829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7577a0b-ffed-4074-8617-6008479c2912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:31.491604 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7577a0b-ffed-4074-8617-6008479c2912 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:31.492103 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7577a0b-ffed-4074-8617-6008479c2912 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:31.492585 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7577a0b-ffed-4074-8617-6008479c2912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:31.493632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7577a0b-ffed-4074-8617-6008479c2912 None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=99d8c709e6f4462c98c055cb03eebf42) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:31.494176 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7577a0b-ffed-4074-8617-6008479c2912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:31.495802 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7577a0b-ffed-4074-8617-6008479c2912 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:31.502448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 359/717] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:31 2022] GET /identity/v3/role_assignments?user.id=99d8c709e6f4462c98c055cb03eebf42&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 259 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:31.530219 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:31.536125 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec237c-a89e-4b7b-9f55-76ff13a448d5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:31.573541 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d5df3-7594-4b73-b0a7-95bc820279f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:31.574168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d5df3-7594-4b73-b0a7-95bc820279f8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:31.574451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d5df3-7594-4b73-b0a7-95bc820279f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:31.574730 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d5df3-7594-4b73-b0a7-95bc820279f8 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:31.575422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d5df3-7594-4b73-b0a7-95bc820279f8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:31.575729 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d5df3-7594-4b73-b0a7-95bc820279f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:31.577106 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d5df3-7594-4b73-b0a7-95bc820279f8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:31.582117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 359/718] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jul 28 05:13:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:31.588241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7577a0b-ffed-4074-8617-6008479c2912 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:31.622708 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:31.762769 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7577a0b-ffed-4074-8617-6008479c2912 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:31.807211 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5941b-ba87-4416-b418-34b0ec4c758b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:31.807851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5941b-ba87-4416-b418-34b0ec4c758b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:31.808134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5941b-ba87-4416-b418-34b0ec4c758b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:31.808521 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5941b-ba87-4416-b418-34b0ec4c758b None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:31.809301 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5941b-ba87-4416-b418-34b0ec4c758b None admin] RBAC: Adding query filter params (type=network) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:31.809634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5941b-ba87-4416-b418-34b0ec4c758b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:31.811058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5941b-ba87-4416-b418-34b0ec4c758b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:31.822308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 360/719] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jul 28 05:13:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:32.275130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370a770-3cc0-43fa-a70f-d5a2171bf614 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:32.275763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370a770-3cc0-43fa-a70f-d5a2171bf614 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:32.276248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370a770-3cc0-43fa-a70f-d5a2171bf614 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:32.277839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 360/720] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:32.283478 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b9282-0682-4c41-b22a-107fb2160dbb None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:32.283767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b9282-0682-4c41-b22a-107fb2160dbb None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:32.284042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b9282-0682-4c41-b22a-107fb2160dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:32.315072 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-6a0b9282-0682-4c41-b22a-107fb2160dbb None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:32.316270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6a0b9282-0682-4c41-b22a-107fb2160dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:32.419019 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 361/721] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:32.455427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370a770-3cc0-43fa-a70f-d5a2171bf614 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:32.596396 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370a770-3cc0-43fa-a70f-d5a2171bf614 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:32.642240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3418f-3a93-4ff5-86a7-aa8ca5567046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:32.642900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3418f-3a93-4ff5-86a7-aa8ca5567046 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:32.643181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3418f-3a93-4ff5-86a7-aa8ca5567046 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:32.643456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3418f-3a93-4ff5-86a7-aa8ca5567046 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:32.658315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3418f-3a93-4ff5-86a7-aa8ca5567046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:32.664196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-51c3418f-3a93-4ff5-86a7-aa8ca5567046 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:13:32.664196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:32.664196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:32.664196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:32.664196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:32.664196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:32.664196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:32.664196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:32.664196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:32.664196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:32.664196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:32.664196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:32.664196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:32.664196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:32.664196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:32.664196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:32.665139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:32.665139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:32.665139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:32.665139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:32.665139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:32.665139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:32.665139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:32.665139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:32.665139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:32.665139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:32.665139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:32.665139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:32.665139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:32.665139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:32.665139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:32.665139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:32.666675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:32.666675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:32.666675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:32.666675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:32.666675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:32.666675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:32.666675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:32.666675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:32.666675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:32.666675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:32.666675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:13:32.666675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:32.666675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 361/722] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:13:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:32.673529 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b9282-0682-4c41-b22a-107fb2160dbb None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:32.689311 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:32.815240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e0ecd-4f76-4709-833a-ad6c5b358540 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:32.815612 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e0ecd-4f76-4709-833a-ad6c5b358540 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:32.815950 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e0ecd-4f76-4709-833a-ad6c5b358540 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:32.817622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 362/723] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:32.824519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71f201-4912-4863-8265-fde25a8fb0e8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:32.824862 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71f201-4912-4863-8265-fde25a8fb0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:32.825061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71f201-4912-4863-8265-fde25a8fb0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:32.848057 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-fe71f201-4912-4863-8265-fde25a8fb0e8 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:32.849185 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fe71f201-4912-4863-8265-fde25a8fb0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:32.849773 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b9282-0682-4c41-b22a-107fb2160dbb None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:32.867240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:32.924158 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23949ab2-0a0c-444d-9420-089b3d1d9cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:32.924787 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23949ab2-0a0c-444d-9420-089b3d1d9cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:32.925059 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23949ab2-0a0c-444d-9420-089b3d1d9cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:32.925325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23949ab2-0a0c-444d-9420-089b3d1d9cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:32.926070 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23949ab2-0a0c-444d-9420-089b3d1d9cb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:32.926377 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23949ab2-0a0c-444d-9420-089b3d1d9cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:32.928264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23949ab2-0a0c-444d-9420-089b3d1d9cb2 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:32.947137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 362/724] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:13:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:32.953020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23949ab2-0a0c-444d-9420-089b3d1d9cb2 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:32.966884 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 363/725] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:33.020796 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71f201-4912-4863-8265-fde25a8fb0e8 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:33.043473 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:33.104655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23949ab2-0a0c-444d-9420-089b3d1d9cb2 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:33.169732 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d100115-195c-4d4b-bcb2-51ca79de4f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:33.170930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d100115-195c-4d4b-bcb2-51ca79de4f51 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:33.171416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d100115-195c-4d4b-bcb2-51ca79de4f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:33.171904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d100115-195c-4d4b-bcb2-51ca79de4f51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:33.177966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71f201-4912-4863-8265-fde25a8fb0e8 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:33.196192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d100115-195c-4d4b-bcb2-51ca79de4f51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:33.198170 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d100115-195c-4d4b-bcb2-51ca79de4f51 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:33.224228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-2d100115-195c-4d4b-bcb2-51ca79de4f51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:33.224228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:33.224228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:33.224228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:33.224228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:33.224228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:33.224228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:33.224228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:33.224228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:33.224228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:33.224228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:33.224228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:33.224228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:33.224228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:33.224228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:33.225810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:33.226795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:33.226795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:33.226795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:33.226795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:33.234071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 363/726] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:33.240237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d100115-195c-4d4b-bcb2-51ca79de4f51 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:33.406936 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650bd74-42e2-48af-a76a-0d854b92bc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:33.407526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650bd74-42e2-48af-a76a-0d854b92bc61 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:33.407808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650bd74-42e2-48af-a76a-0d854b92bc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:33.408331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650bd74-42e2-48af-a76a-0d854b92bc61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:33.420194 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650bd74-42e2-48af-a76a-0d854b92bc61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:33.425547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-4650bd74-42e2-48af-a76a-0d854b92bc61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:33.425547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:33.425547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:33.425547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:33.425547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:33.425547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:33.425547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:33.425547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:33.425547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:33.425547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:33.425547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:33.425547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:33.425547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:33.425547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:33.425547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:33.425547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:33.426484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:33.426484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:33.426484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:33.426484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:33.426484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:33.426484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:33.426484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:33.426484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:33.426484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:33.426484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:33.426484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:33.426484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:33.426484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:33.426484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:33.426484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:33.426484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:33.427572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:33.427572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:33.427572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:33.427572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:33.427572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:33.427572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:33.427572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:33.427572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:33.427572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:33.427572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:33.427572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:33.427572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:33.427572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 364/727] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:33.432897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650bd74-42e2-48af-a76a-0d854b92bc61 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:33.455496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d100115-195c-4d4b-bcb2-51ca79de4f51 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:33.461424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:33.506656 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:33.558187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84419d01-3c29-4a4d-86d7-85935a394f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:33.558838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84419d01-3c29-4a4d-86d7-85935a394f51 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:33.559122 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84419d01-3c29-4a4d-86d7-85935a394f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:33.559401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84419d01-3c29-4a4d-86d7-85935a394f51 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:33.560113 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84419d01-3c29-4a4d-86d7-85935a394f51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:33.560424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84419d01-3c29-4a4d-86d7-85935a394f51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:33.561832 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84419d01-3c29-4a4d-86d7-85935a394f51 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:33.587216 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650bd74-42e2-48af-a76a-0d854b92bc61 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:33.592111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 364/728] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:33.600658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84419d01-3c29-4a4d-86d7-85935a394f51 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:33.689717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b8df6-d6fb-472f-a331-46abfb75a57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:33.690383 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b8df6-d6fb-472f-a331-46abfb75a57e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:33.690571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b8df6-d6fb-472f-a331-46abfb75a57e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:33.690814 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b8df6-d6fb-472f-a331-46abfb75a57e None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:33.691543 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b8df6-d6fb-472f-a331-46abfb75a57e None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:33.691851 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b8df6-d6fb-472f-a331-46abfb75a57e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:33.693583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b8df6-d6fb-472f-a331-46abfb75a57e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:33.712866 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 365/729] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:33.713845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84419d01-3c29-4a4d-86d7-85935a394f51 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:33.718267 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b8df6-d6fb-472f-a331-46abfb75a57e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:33.756971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfacd22-5b2c-4a98-96ae-dddb834fee28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:33.757901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfacd22-5b2c-4a98-96ae-dddb834fee28 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:33.758189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfacd22-5b2c-4a98-96ae-dddb834fee28 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:33.758464 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfacd22-5b2c-4a98-96ae-dddb834fee28 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:33.771124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfacd22-5b2c-4a98-96ae-dddb834fee28 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:33.774069 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfacd22-5b2c-4a98-96ae-dddb834fee28 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:33.802306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-0bfacd22-5b2c-4a98-96ae-dddb834fee28 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:13:33.802306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:33.802306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:33.802306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:33.802306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:33.802306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:33.802306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:33.802306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:33.802306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:33.802306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:33.802306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:33.802306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:33.802306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:33.802306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:33.802306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:33.802306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:33.803357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:33.804617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:33.804617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:33.804617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:33.804617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:33.804617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:33.804617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:33.804617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:33.804617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:33.804617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:13:33.804617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:33.804617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 365/730] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:13:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:33.809954 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfacd22-5b2c-4a98-96ae-dddb834fee28 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:33.850692 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:33.865516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:33.881888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b8df6-d6fb-472f-a331-46abfb75a57e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:33.918281 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe4105-90dc-4f6f-a79a-fa696d81322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:33.919042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe4105-90dc-4f6f-a79a-fa696d81322c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:33.919391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe4105-90dc-4f6f-a79a-fa696d81322c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:33.919740 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe4105-90dc-4f6f-a79a-fa696d81322c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:33.930410 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfacd22-5b2c-4a98-96ae-dddb834fee28 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:33.932117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe4105-90dc-4f6f-a79a-fa696d81322c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:33.933868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe4105-90dc-4f6f-a79a-fa696d81322c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:33.949825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-7ebe4105-90dc-4f6f-a79a-fa696d81322c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:33.949825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:33.949825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:33.949825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:33.949825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:33.949825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:33.949825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:33.949825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:33.949825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:33.949825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:33.949825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:33.949825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:33.949825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:33.949825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:33.949825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:33.950703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:33.951595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:33.951595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:33.951595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:33.951595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:33.951595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 366/731] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:33.952616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ae640-c60a-4407-9f71-0ca7a75c8daf None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:33.952904 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ae640-c60a-4407-9f71-0ca7a75c8daf None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:33.954160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ae640-c60a-4407-9f71-0ca7a75c8daf None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:33.956560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 367/732] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:33.957759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909370-0fd3-4860-8ff1-44145566ec42 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:33.958044 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909370-0fd3-4860-8ff1-44145566ec42 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:33.958571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909370-0fd3-4860-8ff1-44145566ec42 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:33.960491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 368/733] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:33.961036 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39909370-0fd3-4860-8ff1-44145566ec42 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:33.973436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274f129-514f-4db4-8a61-f8e80d2b5179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:33.975505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274f129-514f-4db4-8a61-f8e80d2b5179 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:33.975995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274f129-514f-4db4-8a61-f8e80d2b5179 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:33.976582 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274f129-514f-4db4-8a61-f8e80d2b5179 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:33.977653 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274f129-514f-4db4-8a61-f8e80d2b5179 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:33.978179 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274f129-514f-4db4-8a61-f8e80d2b5179 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:33.979757 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274f129-514f-4db4-8a61-f8e80d2b5179 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:33.998425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 366/734] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jul 28 05:13:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:33.999649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5c1d3-749e-4ed9-8acf-172bc6c23488 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:33.999934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5c1d3-749e-4ed9-8acf-172bc6c23488 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:34.000209 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5c1d3-749e-4ed9-8acf-172bc6c23488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:34.018475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-47b5c1d3-749e-4ed9-8acf-172bc6c23488 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:34.019661 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-47b5c1d3-749e-4ed9-8acf-172bc6c23488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:34.070879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39909370-0fd3-4860-8ff1-44145566ec42 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:34.090346 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 367/735] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:34.091689 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1d63a-58f1-448d-b7c3-1dd10a227215 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:34.091982 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1d63a-58f1-448d-b7c3-1dd10a227215 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:34.092261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1d63a-58f1-448d-b7c3-1dd10a227215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:34.102709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:34.112557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-1fd1d63a-58f1-448d-b7c3-1dd10a227215 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:34.123021 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-1fd1d63a-58f1-448d-b7c3-1dd10a227215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:34.123147 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43724f54-ed06-4c48-8484-2cde5ab041e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:34.123147 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43724f54-ed06-4c48-8484-2cde5ab041e4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:34.123147 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43724f54-ed06-4c48-8484-2cde5ab041e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:34.123147 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43724f54-ed06-4c48-8484-2cde5ab041e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:34.123519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43724f54-ed06-4c48-8484-2cde5ab041e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:34.123519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43724f54-ed06-4c48-8484-2cde5ab041e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:34.123519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43724f54-ed06-4c48-8484-2cde5ab041e4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:34.130143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 369/736] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:34.131533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43724f54-ed06-4c48-8484-2cde5ab041e4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:34.146904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:34.195139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 368/737] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:34.195783 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1d63a-58f1-448d-b7c3-1dd10a227215 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:34.250986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43724f54-ed06-4c48-8484-2cde5ab041e4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:34.291777 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de86e9-dfd4-47c7-96d8-b7e414cb621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:34.292401 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de86e9-dfd4-47c7-96d8-b7e414cb621c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:34.292686 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de86e9-dfd4-47c7-96d8-b7e414cb621c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:34.292962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de86e9-dfd4-47c7-96d8-b7e414cb621c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:34.309320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1d63a-58f1-448d-b7c3-1dd10a227215 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:34.345211 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b60c3b-f726-4577-a35e-ab56e1ba2ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:34.345914 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b60c3b-f726-4577-a35e-ab56e1ba2ce2 None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:34.346192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b60c3b-f726-4577-a35e-ab56e1ba2ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:34.346467 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b60c3b-f726-4577-a35e-ab56e1ba2ce2 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:34.347158 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b60c3b-f726-4577-a35e-ab56e1ba2ce2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:34.348522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b60c3b-f726-4577-a35e-ab56e1ba2ce2 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:34.352962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:34.369223 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de86e9-dfd4-47c7-96d8-b7e414cb621c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:34.370690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de86e9-dfd4-47c7-96d8-b7e414cb621c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:34.432836 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 369/738] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jul 28 05:13:34 2022] POST /identity/v3/services => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:13:34.433779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b60c3b-f726-4577-a35e-ab56e1ba2ce2 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:34.456118 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:34.485759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 370/739] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:34.487417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de86e9-dfd4-47c7-96d8-b7e414cb621c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:34.560008 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b60c3b-f726-4577-a35e-ab56e1ba2ce2 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:34.591055 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:34.601554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13527b3d-5ea5-46ff-8210-14a82f243e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:34.602302 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13527b3d-5ea5-46ff-8210-14a82f243e4c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:34.602594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13527b3d-5ea5-46ff-8210-14a82f243e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:34.602876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13527b3d-5ea5-46ff-8210-14a82f243e4c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:34.609975 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de86e9-dfd4-47c7-96d8-b7e414cb621c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:34.612376 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13527b3d-5ea5-46ff-8210-14a82f243e4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:34.613847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13527b3d-5ea5-46ff-8210-14a82f243e4c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:34.626575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-13527b3d-5ea5-46ff-8210-14a82f243e4c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:13:34.626575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:34.626575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:34.626575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:34.626575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:34.626575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:34.626575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:34.626575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:34.626575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:34.626575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:34.626575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:34.626575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:34.626575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:34.626575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:34.626575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:34.626575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:34.627532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:34.628626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:34.628626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:34.628626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:34.628626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:34.628626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:34.628626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:34.628626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:34.628626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:34.628626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:13:34.628626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:34.628626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 370/740] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jul 28 05:13:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:34.629418 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99ed39-011b-4dac-8761-87cc17535883 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:34.629418 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99ed39-011b-4dac-8761-87cc17535883 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:34.629418 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99ed39-011b-4dac-8761-87cc17535883 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:34.631957 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 371/741] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:34.631957 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99ed39-011b-4dac-8761-87cc17535883 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:34.655684 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb9cf4-9778-4939-8864-124eac75bf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:34.656339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb9cf4-9778-4939-8864-124eac75bf84 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:34.656617 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb9cf4-9778-4939-8864-124eac75bf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:34.656891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb9cf4-9778-4939-8864-124eac75bf84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:34.668380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb9cf4-9778-4939-8864-124eac75bf84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:34.673344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-9feb9cf4-9778-4939-8864-124eac75bf84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:13:34.673344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:34.673344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:34.673344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:34.673344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:34.673344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:34.673344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:34.673344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:34.673344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:34.673344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:34.673344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:34.673344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:34.673344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:34.673344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:34.673344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:34.673344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:34.674332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:34.674332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:34.674332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:34.674332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:34.674332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:34.674332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:34.674332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:34.674332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:34.674332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:34.674332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:34.674332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:34.674332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:34.674332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:34.674332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:34.674332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:34.674332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:34.675162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:34.675162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:34.675162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:34.675162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:34.675162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:34.675162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:34.675162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:34.675162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:34.675162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:34.675162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:34.675162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:13:34.675162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:34.675162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 371/742] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:13:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:34.675856 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb9cf4-9778-4939-8864-124eac75bf84 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:34.721176 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:34.748236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99ed39-011b-4dac-8761-87cc17535883 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:34.785797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a23f3-5a5d-49ad-9b7c-6421424bc4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:34.786456 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a23f3-5a5d-49ad-9b7c-6421424bc4bf None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:34.786720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a23f3-5a5d-49ad-9b7c-6421424bc4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:34.787095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a23f3-5a5d-49ad-9b7c-6421424bc4bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:34.788320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb9cf4-9778-4939-8864-124eac75bf84 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:34.799478 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a23f3-5a5d-49ad-9b7c-6421424bc4bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:34.800972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a23f3-5a5d-49ad-9b7c-6421424bc4bf None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:34.816252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-533a23f3-5a5d-49ad-9b7c-6421424bc4bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:34.816252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:34.816252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:34.816252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:34.816252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:34.816252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:34.816252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:34.816252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:34.816252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:34.816252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:34.816252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:34.816252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:34.816252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:34.816252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:34.816252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:34.817126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:34.819613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:34.819613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:34.819613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:34.819613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:34.819613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 372/743] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:34.819613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba44615-e97e-4ee6-a4d1-bf9d81c26966 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:34.819613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba44615-e97e-4ee6-a4d1-bf9d81c26966 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:34.820025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba44615-e97e-4ee6-a4d1-bf9d81c26966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:34.830413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f097c-c42e-4a7a-8f0b-837db1c353b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:34.831043 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f097c-c42e-4a7a-8f0b-837db1c353b9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:34.832129 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f097c-c42e-4a7a-8f0b-837db1c353b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:34.832129 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f097c-c42e-4a7a-8f0b-837db1c353b9 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:34.832439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f097c-c42e-4a7a-8f0b-837db1c353b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:34.832747 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f097c-c42e-4a7a-8f0b-837db1c353b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:34.835073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f097c-c42e-4a7a-8f0b-837db1c353b9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:34.838680 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-fba44615-e97e-4ee6-a4d1-bf9d81c26966 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:34.839879 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-fba44615-e97e-4ee6-a4d1-bf9d81c26966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:34.853510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 372/744] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jul 28 05:13:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:34.858509 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f097c-c42e-4a7a-8f0b-837db1c353b9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:34.861145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:34.911393 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 373/745] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:34.912710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba44615-e97e-4ee6-a4d1-bf9d81c26966 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:34.977278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f097c-c42e-4a7a-8f0b-837db1c353b9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:34.986377 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:35.013620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56307cd-59ae-4a33-bbe2-8e5754a4de2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:35.014346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56307cd-59ae-4a33-bbe2-8e5754a4de2f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:35.014625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56307cd-59ae-4a33-bbe2-8e5754a4de2f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:35.014900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56307cd-59ae-4a33-bbe2-8e5754a4de2f None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:35.015611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56307cd-59ae-4a33-bbe2-8e5754a4de2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:35.015918 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56307cd-59ae-4a33-bbe2-8e5754a4de2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:35.017285 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56307cd-59ae-4a33-bbe2-8e5754a4de2f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:35.026773 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 373/746] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:13:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:35.027582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56307cd-59ae-4a33-bbe2-8e5754a4de2f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:35.038191 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba44615-e97e-4ee6-a4d1-bf9d81c26966 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:35.076345 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f0de3-a2bd-4b11-bcea-5a47e00374e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:35.077023 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f0de3-a2bd-4b11-bcea-5a47e00374e3 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:35.077304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f0de3-a2bd-4b11-bcea-5a47e00374e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:35.077638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f0de3-a2bd-4b11-bcea-5a47e00374e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:35.078402 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f0de3-a2bd-4b11-bcea-5a47e00374e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:35.078837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f0de3-a2bd-4b11-bcea-5a47e00374e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:35.080182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f0de3-a2bd-4b11-bcea-5a47e00374e3 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:35.091887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:35.099007 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 374/747] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:35.099007 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f0de3-a2bd-4b11-bcea-5a47e00374e3 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:35.143506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56307cd-59ae-4a33-bbe2-8e5754a4de2f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:35.180953 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e45201-0ab4-4d10-8003-1b5751f5f271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:35.181600 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e45201-0ab4-4d10-8003-1b5751f5f271 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:35.181883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e45201-0ab4-4d10-8003-1b5751f5f271 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:35.182155 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e45201-0ab4-4d10-8003-1b5751f5f271 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:35.205375 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f0de3-a2bd-4b11-bcea-5a47e00374e3 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:35.223549 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:35.245537 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c58d46-f4f0-4775-8f2a-846d4e46e5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:35.246309 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58d46-f4f0-4775-8f2a-846d4e46e5c1 None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:35.246596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58d46-f4f0-4775-8f2a-846d4e46e5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:35.246874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58d46-f4f0-4775-8f2a-846d4e46e5c1 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:35.247677 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c58d46-f4f0-4775-8f2a-846d4e46e5c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:35.249274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c58d46-f4f0-4775-8f2a-846d4e46e5c1 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:35.254909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e45201-0ab4-4d10-8003-1b5751f5f271 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:35.256633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e45201-0ab4-4d10-8003-1b5751f5f271 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:35.318569 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:35.333003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 375/748] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jul 28 05:13:35 2022] POST /identity/v3/services => generated 240 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:13:35.334481 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c58d46-f4f0-4775-8f2a-846d4e46e5c1 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:35.375652 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 374/749] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:35 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:35.377088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e45201-0ab4-4d10-8003-1b5751f5f271 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:35.461772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c58d46-f4f0-4775-8f2a-846d4e46e5c1 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:35.504257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e427221-8640-4f26-851c-e21fbaa5f05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:35.506095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e427221-8640-4f26-851c-e21fbaa5f05a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:35.506596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e427221-8640-4f26-851c-e21fbaa5f05a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:35.507088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e427221-8640-4f26-851c-e21fbaa5f05a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:35.519012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e45201-0ab4-4d10-8003-1b5751f5f271 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:35.522457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e427221-8640-4f26-851c-e21fbaa5f05a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:35.524228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e427221-8640-4f26-851c-e21fbaa5f05a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:35.541971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-6e427221-8640-4f26-851c-e21fbaa5f05a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:35.541971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:35.541971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:35.541971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:35.541971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:35.541971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:35.541971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:35.541971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:35.541971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:35.541971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:35.541971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:35.541971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:35.541971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:35.541971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:35.541971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:35.542920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:35.544216 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:35.544216 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:35.544216 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:35.544216 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:35.544216 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 376/750] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:35.544486 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e427221-8640-4f26-851c-e21fbaa5f05a None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:35.562722 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da813d-ac55-4185-9909-1d50ab836a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:35.563626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da813d-ac55-4185-9909-1d50ab836a5e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:35.563905 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da813d-ac55-4185-9909-1d50ab836a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:35.564178 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da813d-ac55-4185-9909-1d50ab836a5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:35.571678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da813d-ac55-4185-9909-1d50ab836a5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:35.573119 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da813d-ac55-4185-9909-1d50ab836a5e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:35.586025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-98da813d-ac55-4185-9909-1d50ab836a5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:35.586025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:35.586025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:35.586025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:35.586025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:35.586025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:35.586025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:35.586025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:35.586025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:35.586025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:35.586025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:35.586025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:35.586025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:35.586025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:35.586025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:35.586921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:35.588235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:35.588235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:35.588235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:35.588235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:35.588235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:35.588235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:35.588235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:35.588235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:35.588235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 375/751] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:35.588717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da813d-ac55-4185-9909-1d50ab836a5e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:35.589932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:35.620720 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:35.686246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e427221-8640-4f26-851c-e21fbaa5f05a None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:35.714176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da813d-ac55-4185-9909-1d50ab836a5e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:35.723315 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a22e6f-b7db-43fd-b33f-a399cd35fc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:35.724135 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a22e6f-b7db-43fd-b33f-a399cd35fc2d None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:35.725038 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a22e6f-b7db-43fd-b33f-a399cd35fc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:35.725415 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a22e6f-b7db-43fd-b33f-a399cd35fc2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:35.738006 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a22e6f-b7db-43fd-b33f-a399cd35fc2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:35.739571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a22e6f-b7db-43fd-b33f-a399cd35fc2d None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:35.755248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-98a22e6f-b7db-43fd-b33f-a399cd35fc2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:35.755248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:35.755248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:35.755248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:35.755248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:35.755248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:35.755248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:35.755248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:35.755248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:35.755248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:35.755248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:35.755248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:35.755248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:35.755248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:35.755248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:35.757299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:35.759460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:35.759460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:35.759460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:35.759460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:35.759460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 377/752] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:35.760081 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2d24-9d04-47d0-8f37-6ef490ef8c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:35.760243 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a22e6f-b7db-43fd-b33f-a399cd35fc2d None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:35.760391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2d24-9d04-47d0-8f37-6ef490ef8c8d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:35.760391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2d24-9d04-47d0-8f37-6ef490ef8c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:35.760391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2d24-9d04-47d0-8f37-6ef490ef8c8d None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:35.760391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2d24-9d04-47d0-8f37-6ef490ef8c8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:35.760391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2d24-9d04-47d0-8f37-6ef490ef8c8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:35.769491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2d24-9d04-47d0-8f37-6ef490ef8c8d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:35.778575 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 376/753] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:35.779828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2d24-9d04-47d0-8f37-6ef490ef8c8d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:35.857408 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:35.881865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a22e6f-b7db-43fd-b33f-a399cd35fc2d None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:35.882676 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:35.903971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2d24-9d04-47d0-8f37-6ef490ef8c8d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:35.920638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3992816-5798-49ea-a59a-c9adc2872582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:35.921376 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3992816-5798-49ea-a59a-c9adc2872582 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:35.921760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3992816-5798-49ea-a59a-c9adc2872582 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:35.922099 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3992816-5798-49ea-a59a-c9adc2872582 None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:35.922982 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3992816-5798-49ea-a59a-c9adc2872582 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:35.923359 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3992816-5798-49ea-a59a-c9adc2872582 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:35.924984 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3992816-5798-49ea-a59a-c9adc2872582 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:35.943227 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 378/754] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:35.944232 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3992816-5798-49ea-a59a-c9adc2872582 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:35.947395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47127cf9-c0e8-4014-bcef-3329a766bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:35.948939 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47127cf9-c0e8-4014-bcef-3329a766bf2a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:35.949227 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47127cf9-c0e8-4014-bcef-3329a766bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:35.949536 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47127cf9-c0e8-4014-bcef-3329a766bf2a None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:35.950245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47127cf9-c0e8-4014-bcef-3329a766bf2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:35.950553 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47127cf9-c0e8-4014-bcef-3329a766bf2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:35.951912 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47127cf9-c0e8-4014-bcef-3329a766bf2a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:35.967172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 377/755] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:35.968450 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47127cf9-c0e8-4014-bcef-3329a766bf2a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:36.076370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3992816-5798-49ea-a59a-c9adc2872582 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:36.106650 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47127cf9-c0e8-4014-bcef-3329a766bf2a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:36.120412 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd30c7-7a45-4796-a802-b668a45a58ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:36.121169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd30c7-7a45-4796-a802-b668a45a58ae None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:36.121640 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd30c7-7a45-4796-a802-b668a45a58ae None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:36.121995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd30c7-7a45-4796-a802-b668a45a58ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:36.125294 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:36.131931 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd30c7-7a45-4796-a802-b668a45a58ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:36.136640 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd30c7-7a45-4796-a802-b668a45a58ae None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:36.144523 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011260e-e6f6-4995-844e-5a9f212ff9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:36.145154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011260e-e6f6-4995-844e-5a9f212ff9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:36.145441 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011260e-e6f6-4995-844e-5a9f212ff9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:36.145794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011260e-e6f6-4995-844e-5a9f212ff9c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:36.146614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011260e-e6f6-4995-844e-5a9f212ff9c1 None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=eb89e2ac885f42eb95fe3b67f3808ba9) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:36.146927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011260e-e6f6-4995-844e-5a9f212ff9c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:36.148163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-e6dd30c7-7a45-4796-a802-b668a45a58ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:13:36.148163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:36.148163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:36.148163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:36.148163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:36.148163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:36.148163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:36.148163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:36.148163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:36.148163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:36.148163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:36.148163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:36.148163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:36.148163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:36.148163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:36.148163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:36.150446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:36.152725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:36.152725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:36.152725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:36.152725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:36.152725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:36.152725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:36.152725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:36.152725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:36.152725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:13:36.152725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:36.153991 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011260e-e6f6-4995-844e-5a9f212ff9c1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:36.154100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 379/756] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jul 28 05:13:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:36.154100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd30c7-7a45-4796-a802-b668a45a58ae None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:36.161509 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 378/757] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:35 2022] GET /identity/v3/role_assignments?user.id=eb89e2ac885f42eb95fe3b67f3808ba9&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:36.162406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011260e-e6f6-4995-844e-5a9f212ff9c1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:36.178695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:36.284589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011260e-e6f6-4995-844e-5a9f212ff9c1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:36.324726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e2d5e-8dba-42ad-a58c-c380ed8570b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:36.325366 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e2d5e-8dba-42ad-a58c-c380ed8570b9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:36.325686 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e2d5e-8dba-42ad-a58c-c380ed8570b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:36.325993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e2d5e-8dba-42ad-a58c-c380ed8570b9 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:36.327237 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e2d5e-8dba-42ad-a58c-c380ed8570b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:36.327559 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e2d5e-8dba-42ad-a58c-c380ed8570b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:36.329015 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e2d5e-8dba-42ad-a58c-c380ed8570b9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:36.351978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 379/758] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jul 28 05:13:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:36.357423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e2d5e-8dba-42ad-a58c-c380ed8570b9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:36.435445 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd30c7-7a45-4796-a802-b668a45a58ae None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:36.455443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:36.499043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78a282-2e22-4de1-81d2-2fc192581cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:36.499708 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78a282-2e22-4de1-81d2-2fc192581cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:36.500000 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78a282-2e22-4de1-81d2-2fc192581cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:36.500280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78a282-2e22-4de1-81d2-2fc192581cc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:36.514495 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78a282-2e22-4de1-81d2-2fc192581cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:36.515949 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78a282-2e22-4de1-81d2-2fc192581cc5 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:36.523892 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e2d5e-8dba-42ad-a58c-c380ed8570b9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:36.535628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-ae78a282-2e22-4de1-81d2-2fc192581cc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:36.535628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:36.535628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:36.535628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:36.535628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:36.535628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:36.535628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:36.535628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:36.535628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:36.535628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:36.535628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:36.535628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:36.535628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:36.535628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:36.535628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:36.536576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:36.538060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:36.538060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:36.538060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:36.538060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:36.538060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:36.538060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:36.538060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:36.538060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:36.539021 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 380/759] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:36.543866 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78a282-2e22-4de1-81d2-2fc192581cc5 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:36.587215 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ae1bc-330e-4ff4-acd5-9b18bee088f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:36.588142 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ae1bc-330e-4ff4-acd5-9b18bee088f2 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:36.588431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ae1bc-330e-4ff4-acd5-9b18bee088f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:36.588710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ae1bc-330e-4ff4-acd5-9b18bee088f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:36.602491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ae1bc-330e-4ff4-acd5-9b18bee088f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:36.604793 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ae1bc-330e-4ff4-acd5-9b18bee088f2 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:36.614492 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:36.627391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-282ae1bc-330e-4ff4-acd5-9b18bee088f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:36.627391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:36.627391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:36.627391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:36.627391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:36.627391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:36.627391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:36.627391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:36.627391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:36.627391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:36.627391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:36.627391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:36.627391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:36.627391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:36.627391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:36.628339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:36.629388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:36.629388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:36.629388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:36.629388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:36.629388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 380/760] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:36.634086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8b5bf-a1b2-4c1a-b1b2-fcd47e023829 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:36.634369 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8b5bf-a1b2-4c1a-b1b2-fcd47e023829 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:36.634646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8b5bf-a1b2-4c1a-b1b2-fcd47e023829 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:36.638022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 381/761] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:36.638791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8b5bf-a1b2-4c1a-b1b2-fcd47e023829 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:36.671972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78a282-2e22-4de1-81d2-2fc192581cc5 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:36.718414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a3940-1864-4da8-a1c4-fb37424ee8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:36.718970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a3940-1864-4da8-a1c4-fb37424ee8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:36.719253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a3940-1864-4da8-a1c4-fb37424ee8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:36.719528 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a3940-1864-4da8-a1c4-fb37424ee8c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:36.720290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a3940-1864-4da8-a1c4-fb37424ee8c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:36.720601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a3940-1864-4da8-a1c4-fb37424ee8c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:36.722072 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a3940-1864-4da8-a1c4-fb37424ee8c9 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:36.737247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 381/762] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:36.738562 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1946a-a091-488b-9e9d-7d092f34e247 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:36.738827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1946a-a091-488b-9e9d-7d092f34e247 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:36.739105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1946a-a091-488b-9e9d-7d092f34e247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:36.759037 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-26f1946a-a091-488b-9e9d-7d092f34e247 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:36.760364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-26f1946a-a091-488b-9e9d-7d092f34e247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:36.787074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8b5bf-a1b2-4c1a-b1b2-fcd47e023829 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:36.823750 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:36.841489 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348f234-dd95-46cb-a14d-f7ca6b78a288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:36.841671 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 382/763] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:13:36.841671 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1946a-a091-488b-9e9d-7d092f34e247 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:36.841837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348f234-dd95-46cb-a14d-f7ca6b78a288 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:36.841837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348f234-dd95-46cb-a14d-f7ca6b78a288 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:36.841837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348f234-dd95-46cb-a14d-f7ca6b78a288 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:36.841837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348f234-dd95-46cb-a14d-f7ca6b78a288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:36.841837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348f234-dd95-46cb-a14d-f7ca6b78a288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:36.841837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348f234-dd95-46cb-a14d-f7ca6b78a288 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:36.865756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 382/764] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:36.866690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348f234-dd95-46cb-a14d-f7ca6b78a288 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:36.905301 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:36.976164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1946a-a091-488b-9e9d-7d092f34e247 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:36.976343 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348f234-dd95-46cb-a14d-f7ca6b78a288 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:37.014061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe17be9-a5e1-499f-8a26-de61c1e0f941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:37.014980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe17be9-a5e1-499f-8a26-de61c1e0f941 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:37.015165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe17be9-a5e1-499f-8a26-de61c1e0f941 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:37.015415 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe17be9-a5e1-499f-8a26-de61c1e0f941 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:37.016055 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe17be9-a5e1-499f-8a26-de61c1e0f941 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:37.017430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe17be9-a5e1-499f-8a26-de61c1e0f941 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:37.022153 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f435cfe-e306-43ac-a740-51ebe6ec4b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:37.023024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f435cfe-e306-43ac-a740-51ebe6ec4b29 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:37.023518 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f435cfe-e306-43ac-a740-51ebe6ec4b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:37.024017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f435cfe-e306-43ac-a740-51ebe6ec4b29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:37.025007 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f435cfe-e306-43ac-a740-51ebe6ec4b29 None admin] RBAC: Adding query filter params (role.id=04fcac2c505f40a89923fa2f26cf548c, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=2d45700d35664abaae5eb8b42e2e05fb) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:37.025625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f435cfe-e306-43ac-a740-51ebe6ec4b29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:37.027263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-dfe17be9-a5e1-499f-8a26-de61c1e0f941 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:13:37.027263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:37.027263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:13:37.027263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:13:37.027263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:13:37.027263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:13:37.027263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:13:37.027263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:37.027263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:13:37.027263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:37.027263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:37.027263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:37.027263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:37.027263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:37.027263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:37.027263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:37.028163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:37.028163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:37.028163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:37.028163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:37.028163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:37.028163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:37.028163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:37.028163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:13:37.028163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:13:37.028163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:13:37.028163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:13:37.028163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:37.028163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:37.028163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:37.028163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:37.028163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:37.028990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:37.028990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:37.028990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:37.028990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:37.028990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:37.028990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:37.028990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:37.028990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:37.028990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:37.028990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:37.028990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:37.028990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:13:37.028990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:37.028990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:13:37.028990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:37.029817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f435cfe-e306-43ac-a740-51ebe6ec4b29 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:37.029887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 383/765] 10.222.0.33 () {56 vars in 1129 bytes} [Thu Jul 28 05:13:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:37.029887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe17be9-a5e1-499f-8a26-de61c1e0f941 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:37.045658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 383/766] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:36 2022] GET /identity/v3/role_assignments?user.id=2d45700d35664abaae5eb8b42e2e05fb&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=04fcac2c505f40a89923fa2f26cf548c => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:37.047697 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f435cfe-e306-43ac-a740-51ebe6ec4b29 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:37.085485 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:37.173495 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe17be9-a5e1-499f-8a26-de61c1e0f941 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:37.231271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f435cfe-e306-43ac-a740-51ebe6ec4b29 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:37.235630 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc093a-09eb-4254-baeb-16780e924b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:37.236348 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc093a-09eb-4254-baeb-16780e924b03 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:37.236633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc093a-09eb-4254-baeb-16780e924b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:37.236962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc093a-09eb-4254-baeb-16780e924b03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:37.244707 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:37.245864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc093a-09eb-4254-baeb-16780e924b03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:37.247480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc093a-09eb-4254-baeb-16780e924b03 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:37.261883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-a5dc093a-09eb-4254-baeb-16780e924b03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:37.261883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:37.261883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:37.261883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:37.261883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:37.261883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:37.261883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:37.261883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:37.261883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:37.261883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:37.261883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:37.261883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:37.261883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:37.261883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:37.261883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:37.262707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:37.263614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:37.263614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:37.263614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:37.263614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:37.263614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:37.263614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:37.263614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:37.263614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:37.263614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 384/767] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:37.269549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc093a-09eb-4254-baeb-16780e924b03 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:37.285251 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43e7d-6a6a-426f-9f59-e965c81aef61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:37.286125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43e7d-6a6a-426f-9f59-e965c81aef61 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:37.286511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43e7d-6a6a-426f-9f59-e965c81aef61 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:37.286923 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43e7d-6a6a-426f-9f59-e965c81aef61 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:37.287798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec43e7d-6a6a-426f-9f59-e965c81aef61 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:37.288210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec43e7d-6a6a-426f-9f59-e965c81aef61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:37.289704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec43e7d-6a6a-426f-9f59-e965c81aef61 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:37.295308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 384/768] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jul 28 05:13:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:37.301928 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43e7d-6a6a-426f-9f59-e965c81aef61 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:37.389498 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc093a-09eb-4254-baeb-16780e924b03 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:37.389498 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:37.428406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc6746-30c5-4f67-90b1-b07e363237b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:37.429047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc6746-30c5-4f67-90b1-b07e363237b2 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:37.429350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc6746-30c5-4f67-90b1-b07e363237b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:37.429649 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc6746-30c5-4f67-90b1-b07e363237b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:37.430409 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc6746-30c5-4f67-90b1-b07e363237b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:37.430718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc6746-30c5-4f67-90b1-b07e363237b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:37.433294 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc6746-30c5-4f67-90b1-b07e363237b2 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:37.468104 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 385/769] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:37.475642 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e38484-e591-4c60-b524-d7a532b83c5e None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:37.475932 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e38484-e591-4c60-b524-d7a532b83c5e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:37.476214 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e38484-e591-4c60-b524-d7a532b83c5e None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:37.481385 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 386/770] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:37.481385 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e38484-e591-4c60-b524-d7a532b83c5e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:37.505089 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43e7d-6a6a-426f-9f59-e965c81aef61 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:37.554460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e238f1e-b06d-4d81-b7a7-cf1aa82cd1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:37.555093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e238f1e-b06d-4d81-b7a7-cf1aa82cd1ff None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:37.555373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e238f1e-b06d-4d81-b7a7-cf1aa82cd1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:37.555647 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e238f1e-b06d-4d81-b7a7-cf1aa82cd1ff None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:37.556329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e238f1e-b06d-4d81-b7a7-cf1aa82cd1ff None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:37.556636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e238f1e-b06d-4d81-b7a7-cf1aa82cd1ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:37.558057 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e238f1e-b06d-4d81-b7a7-cf1aa82cd1ff None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:37.564134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 385/771] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jul 28 05:13:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:37.565524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969ecf9-f37a-46bd-81eb-39afe4e7a28e None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:37.566674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969ecf9-f37a-46bd-81eb-39afe4e7a28e None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:37.566674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969ecf9-f37a-46bd-81eb-39afe4e7a28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:37.586330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-0969ecf9-f37a-46bd-81eb-39afe4e7a28e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:37.587567 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-0969ecf9-f37a-46bd-81eb-39afe4e7a28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:37.602795 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e38484-e591-4c60-b524-d7a532b83c5e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:37.624000 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:37.645555 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c3acb-b46f-48fd-9f94-e3c6cfdef999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:37.646911 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3acb-b46f-48fd-9f94-e3c6cfdef999 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:37.647704 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3acb-b46f-48fd-9f94-e3c6cfdef999 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:37.648212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3acb-b46f-48fd-9f94-e3c6cfdef999 None admin] PATH_INFO: `/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/99d8c709e6f4462c98c055cb03eebf42/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:37.651058 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c3acb-b46f-48fd-9f94-e3c6cfdef999 None admin] RBAC: Authorizing `identity:create_grant(project_id=089d8f58fc104484b617ec4a1317dbeb, user_id=99d8c709e6f4462c98c055cb03eebf42, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:37.652953 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c3acb-b46f-48fd-9f94-e3c6cfdef999 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:37.669538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 386/772] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:13:37.669538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969ecf9-f37a-46bd-81eb-39afe4e7a28e None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:37.737439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 387/773] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:13:37 2022] PUT /identity/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/99d8c709e6f4462c98c055cb03eebf42/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:13:37.738800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c3acb-b46f-48fd-9f94-e3c6cfdef999 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:37.773126 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:37.783368 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969ecf9-f37a-46bd-81eb-39afe4e7a28e None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:37.864306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af10cfb-e065-40d0-88a7-78f735b3e169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:37.865635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af10cfb-e065-40d0-88a7-78f735b3e169 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:37.866173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af10cfb-e065-40d0-88a7-78f735b3e169 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:37.866627 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af10cfb-e065-40d0-88a7-78f735b3e169 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:37.866780 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c3acb-b46f-48fd-9f94-e3c6cfdef999 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:37.867801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af10cfb-e065-40d0-88a7-78f735b3e169 None admin] RBAC: Adding query filter params (interface=public, service_id=efb7f0e70cf345d787581691c144cd56, region_id=RegionOne) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:37.868290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af10cfb-e065-40d0-88a7-78f735b3e169 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:37.869857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af10cfb-e065-40d0-88a7-78f735b3e169 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:37.891538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 387/774] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jul 28 05:13:37 2022] GET /identity/v3/endpoints?service_id=efb7f0e70cf345d787581691c144cd56&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:37.897984 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af10cfb-e065-40d0-88a7-78f735b3e169 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:37.908235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b20dc-5641-495d-a9d1-b2bcc1c78953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:37.908890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b20dc-5641-495d-a9d1-b2bcc1c78953 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:37.909170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b20dc-5641-495d-a9d1-b2bcc1c78953 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:37.909438 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b20dc-5641-495d-a9d1-b2bcc1c78953 None admin] PATH_INFO: `/v3/services/network` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:37.910096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b20dc-5641-495d-a9d1-b2bcc1c78953 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:37.911460 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b20dc-5641-495d-a9d1-b2bcc1c78953 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-990b20dc-5641-495d-a9d1-b2bcc1c78953 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:37.921934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:37.922954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:37.922954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:37.922954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:37.922954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:37.922954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:37.922954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:37.922954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:13:37.922954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:13:37.922954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:13:37.922954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:13:37.922954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:37.922954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:37.922954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:37.922954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:37.922954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:37.922954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:37.923807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:37.923807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:37.923807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:37.923807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:37.923807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:37.923807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:37.923807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:37.923807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:37.923807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:37.923807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:37.923807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:13:37.923807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:37.923807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:13:37.923807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:37.928701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 388/775] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:37 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:37.930390 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b20dc-5641-495d-a9d1-b2bcc1c78953 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:37.970801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:38.055220 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b20dc-5641-495d-a9d1-b2bcc1c78953 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:38.069864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:38.091851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af10cfb-e065-40d0-88a7-78f735b3e169 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:38.101162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e38e9-03ac-4007-8d8a-d4650913dd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:38.102066 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e38e9-03ac-4007-8d8a-d4650913dd8e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:38.102488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e38e9-03ac-4007-8d8a-d4650913dd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:38.102930 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e38e9-03ac-4007-8d8a-d4650913dd8e None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:38.104180 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e38e9-03ac-4007-8d8a-d4650913dd8e None admin] RBAC: Adding query filter params (name=network) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:38.105066 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e38e9-03ac-4007-8d8a-d4650913dd8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:38.106907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e38e9-03ac-4007-8d8a-d4650913dd8e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:38.116726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 389/776] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jul 28 05:13:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:38.121436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e38e9-03ac-4007-8d8a-d4650913dd8e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:38.134927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bef849-c811-428d-8445-33311eb6e755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:38.135688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bef849-c811-428d-8445-33311eb6e755 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:38.136069 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bef849-c811-428d-8445-33311eb6e755 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:38.136461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bef849-c811-428d-8445-33311eb6e755 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:38.137296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bef849-c811-428d-8445-33311eb6e755 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:38.138812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bef849-c811-428d-8445-33311eb6e755 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:38.144613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 388/777] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jul 28 05:13:37 2022] GET /identity/v3/services => generated 772 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:38.238585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e38e9-03ac-4007-8d8a-d4650913dd8e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:38.277870 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37545b-0e94-4088-b6cb-1a4fe57cdc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:38.278513 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37545b-0e94-4088-b6cb-1a4fe57cdc90 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:38.278792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37545b-0e94-4088-b6cb-1a4fe57cdc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:38.279064 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37545b-0e94-4088-b6cb-1a4fe57cdc90 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:38.279752 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37545b-0e94-4088-b6cb-1a4fe57cdc90 None admin] RBAC: Adding query filter params (type=network) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:38.280062 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37545b-0e94-4088-b6cb-1a4fe57cdc90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:38.281443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37545b-0e94-4088-b6cb-1a4fe57cdc90 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:38.293519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 390/778] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jul 28 05:13:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:38.295148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bef849-c811-428d-8445-33311eb6e755 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:38.438712 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:38.445080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bef849-c811-428d-8445-33311eb6e755 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:38.480333 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10f12e-4238-439f-aa88-639158f0b6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:38.481013 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10f12e-4238-439f-aa88-639158f0b6ef None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:38.481295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10f12e-4238-439f-aa88-639158f0b6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:38.481624 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10f12e-4238-439f-aa88-639158f0b6ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:38.482393 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10f12e-4238-439f-aa88-639158f0b6ef None admin] RBAC: Adding query filter params (interface=public, service_id=7f6bdfb2934345fea6ac61bb3529f792, region_id=RegionOne) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:38.482712 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10f12e-4238-439f-aa88-639158f0b6ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:38.484083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10f12e-4238-439f-aa88-639158f0b6ef None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:38.490899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 389/779] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jul 28 05:13:38 2022] GET /identity/v3/endpoints?service_id=7f6bdfb2934345fea6ac61bb3529f792&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:38.496364 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37545b-0e94-4088-b6cb-1a4fe57cdc90 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:38.514615 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:38.617979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37545b-0e94-4088-b6cb-1a4fe57cdc90 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:38.640935 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a508669-219d-427e-8a7c-5dcf44c41aab None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:38.641239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a508669-219d-427e-8a7c-5dcf44c41aab None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:38.641518 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a508669-219d-427e-8a7c-5dcf44c41aab None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:38.643124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 390/780] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:38.648662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87464c-8fa6-498e-9713-7b78e9b905a7 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:38.648948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87464c-8fa6-498e-9713-7b78e9b905a7 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:38.649228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87464c-8fa6-498e-9713-7b78e9b905a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:38.670075 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b34bc-e8ba-404f-b3da-7873fba561cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:38.670710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b34bc-e8ba-404f-b3da-7873fba561cf None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:38.670993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b34bc-e8ba-404f-b3da-7873fba561cf None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:38.671268 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b34bc-e8ba-404f-b3da-7873fba561cf None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:38.671930 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b34bc-e8ba-404f-b3da-7873fba561cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:38.673291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b34bc-e8ba-404f-b3da-7873fba561cf None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:38.678946 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-2e87464c-8fa6-498e-9713-7b78e9b905a7 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:38.680150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2e87464c-8fa6-498e-9713-7b78e9b905a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:38.686899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 391/781] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jul 28 05:13:38 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:38.761635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 391/782] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:13:38.797016 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b34bc-e8ba-404f-b3da-7873fba561cf None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:38.903191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:38.930670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b34bc-e8ba-404f-b3da-7873fba561cf None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:38.985125 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a7b56-112c-4867-b1d2-b11e164b7400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:38.985852 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a7b56-112c-4867-b1d2-b11e164b7400 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:38.986132 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a7b56-112c-4867-b1d2-b11e164b7400 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:38.986406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a7b56-112c-4867-b1d2-b11e164b7400 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:38.998872 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a7b56-112c-4867-b1d2-b11e164b7400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:39.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-527a7b56-112c-4867-b1d2-b11e164b7400 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:13:39.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:39.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:39.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:39.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:39.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:39.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:39.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:39.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:39.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:39.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:39.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:39.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:39.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:39.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:39.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:39.005170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:39.005170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:39.005170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:39.005170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:39.005170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:39.005170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:39.005170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:39.005170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:39.005170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:39.005170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:39.005170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:39.005170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:39.005170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:39.005170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:39.005170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:39.005170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:39.006659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:39.006659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:39.006659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:39.006659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:39.006659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:39.006659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:39.006659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:39.006659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:39.006659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:39.006659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:39.006659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:13:39.006659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:39.006659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 392/783] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:13:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:39.013820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87464c-8fa6-498e-9713-7b78e9b905a7 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:39.117868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:39.124284 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87464c-8fa6-498e-9713-7b78e9b905a7 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:39.161674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d24a0-a2bc-4fe7-aa44-767ba49c2a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:39.162309 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d24a0-a2bc-4fe7-aa44-767ba49c2a6a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:39.162685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d24a0-a2bc-4fe7-aa44-767ba49c2a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:39.162864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d24a0-a2bc-4fe7-aa44-767ba49c2a6a None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:39.163563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d24a0-a2bc-4fe7-aa44-767ba49c2a6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:39.163982 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d24a0-a2bc-4fe7-aa44-767ba49c2a6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:39.165409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d24a0-a2bc-4fe7-aa44-767ba49c2a6a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:39.174866 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 392/784] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:13:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:39.186562 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a7b56-112c-4867-b1d2-b11e164b7400 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:39.359420 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a7b56-112c-4867-b1d2-b11e164b7400 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:39.394448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82badf-998e-4c85-bee5-5038757b021a None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:39.394775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82badf-998e-4c85-bee5-5038757b021a None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:39.395021 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82badf-998e-4c85-bee5-5038757b021a None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:39.397291 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 393/785] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:39.402111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ebac8-e153-4bac-a39e-c28060c58052 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:39.402393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c0245-d740-4d93-933f-1cf2e674012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:39.402536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ebac8-e153-4bac-a39e-c28060c58052 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:39.402721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ebac8-e153-4bac-a39e-c28060c58052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:39.403035 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c0245-d740-4d93-933f-1cf2e674012c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:39.403312 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c0245-d740-4d93-933f-1cf2e674012c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:39.403583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c0245-d740-4d93-933f-1cf2e674012c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:39.416444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:39.426809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c0245-d740-4d93-933f-1cf2e674012c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:39.428640 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c0245-d740-4d93-933f-1cf2e674012c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:39.438782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-0b8ebac8-e153-4bac-a39e-c28060c58052 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:39.445421 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-0b8ebac8-e153-4bac-a39e-c28060c58052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:39.453850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-1f8c0245-d740-4d93-933f-1cf2e674012c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:39.453850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:39.453850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:39.453850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:39.453850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:39.453850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:39.453850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:39.453850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:39.453850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:39.453850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:39.453850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:39.453850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:39.453850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:39.453850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:39.453850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:39.454749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:39.455638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:39.455638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:39.455638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:39.455638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:39.461814 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 393/786] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:39.466367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c0245-d740-4d93-933f-1cf2e674012c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:39.548289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 394/787] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:13:39.570861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ebac8-e153-4bac-a39e-c28060c58052 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:39.666176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c0245-d740-4d93-933f-1cf2e674012c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:39.698099 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:39.734369 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d86a03-a2db-4ec6-bf15-155bed8f012a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:39.734997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d86a03-a2db-4ec6-bf15-155bed8f012a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:39.737091 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d86a03-a2db-4ec6-bf15-155bed8f012a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:39.737370 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d86a03-a2db-4ec6-bf15-155bed8f012a None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:39.738099 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d86a03-a2db-4ec6-bf15-155bed8f012a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:39.738408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d86a03-a2db-4ec6-bf15-155bed8f012a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:39.739458 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ebac8-e153-4bac-a39e-c28060c58052 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:39.742871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d86a03-a2db-4ec6-bf15-155bed8f012a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:39.768566 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 394/788] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:39.774868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d86a03-a2db-4ec6-bf15-155bed8f012a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:39.805922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe8010-0e16-4091-9cb5-34ebc9507dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:39.806661 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe8010-0e16-4091-9cb5-34ebc9507dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:39.806943 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe8010-0e16-4091-9cb5-34ebc9507dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:39.807216 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe8010-0e16-4091-9cb5-34ebc9507dc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:39.826831 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe8010-0e16-4091-9cb5-34ebc9507dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:39.834088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-ecfe8010-0e16-4091-9cb5-34ebc9507dc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:39.834088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:39.834088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:39.834088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:39.834088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:39.834088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:39.834088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:39.834088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:39.834088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:39.834088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:39.834088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:39.834088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:39.834088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:39.834088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:39.834088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:39.834088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:39.835091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:39.835091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:39.835091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:39.835091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:39.835091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:39.835091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:39.835091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:39.835091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:39.835091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:39.835091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:39.835091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:39.835091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:39.835091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:39.835091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:39.835091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:39.835091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:39.835911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:39.835911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:39.835911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:39.835911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:39.835911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:39.835911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:39.835911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:39.835911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:39.835911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:39.835911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:39.835911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:39.835911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:39.839360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 395/789] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:39.850839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe8010-0e16-4091-9cb5-34ebc9507dc6 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:39.880023 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:39.950568 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d86a03-a2db-4ec6-bf15-155bed8f012a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:39.987691 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abd025-f86f-4123-8db9-9c508f183ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:39.988336 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abd025-f86f-4123-8db9-9c508f183ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:39.988613 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abd025-f86f-4123-8db9-9c508f183ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:39.988888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abd025-f86f-4123-8db9-9c508f183ff4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:39.996799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abd025-f86f-4123-8db9-9c508f183ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:39.999158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abd025-f86f-4123-8db9-9c508f183ff4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:40.025683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c0abd025-f86f-4123-8db9-9c508f183ff4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:13:40.025683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:40.025683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:40.025683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:40.025683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:40.025683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:40.025683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:40.025683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:40.025683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:40.025683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:40.025683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:40.025683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:40.025683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:40.025683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:40.025683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:40.025683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:40.026776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:40.027754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:40.027754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:40.027754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:40.027754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:40.027754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:40.027754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:40.027754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:40.027754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:40.027754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:13:40.027754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:40.033524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 395/790] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:13:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:40.041992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abd025-f86f-4123-8db9-9c508f183ff4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:40.062015 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe8010-0e16-4091-9cb5-34ebc9507dc6 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:40.119083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeef6ef-750b-4c32-8d83-2ffa885017c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:40.120115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeef6ef-750b-4c32-8d83-2ffa885017c9 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:40.120599 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeef6ef-750b-4c32-8d83-2ffa885017c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:40.121074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeef6ef-750b-4c32-8d83-2ffa885017c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:40.122021 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeef6ef-750b-4c32-8d83-2ffa885017c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:40.122572 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeef6ef-750b-4c32-8d83-2ffa885017c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:40.124195 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeef6ef-750b-4c32-8d83-2ffa885017c9 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:40.134212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 396/791] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:40.139767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeef6ef-750b-4c32-8d83-2ffa885017c9 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:40.150761 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:40.231608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abd025-f86f-4123-8db9-9c508f183ff4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:40.250636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:40.298839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6123c1-84cf-4b77-bc6a-4a75851683c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:40.299474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6123c1-84cf-4b77-bc6a-4a75851683c0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:40.299762 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6123c1-84cf-4b77-bc6a-4a75851683c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:40.300041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6123c1-84cf-4b77-bc6a-4a75851683c0 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:40.301097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6123c1-84cf-4b77-bc6a-4a75851683c0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:40.301420 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6123c1-84cf-4b77-bc6a-4a75851683c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:40.304186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6123c1-84cf-4b77-bc6a-4a75851683c0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:40.339316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 396/792] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jul 28 05:13:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:40.344111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6123c1-84cf-4b77-bc6a-4a75851683c0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:40.349435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeef6ef-750b-4c32-8d83-2ffa885017c9 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:40.406850 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd76697-c329-4a74-9007-f7f89605f998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:40.407595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd76697-c329-4a74-9007-f7f89605f998 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:40.407881 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd76697-c329-4a74-9007-f7f89605f998 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:40.408157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd76697-c329-4a74-9007-f7f89605f998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:40.419370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd76697-c329-4a74-9007-f7f89605f998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:40.420824 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd76697-c329-4a74-9007-f7f89605f998 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:40.439511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-7fd76697-c329-4a74-9007-f7f89605f998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:40.439511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:40.439511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:40.439511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:40.439511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:40.439511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:40.439511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:40.439511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:40.439511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:40.439511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:40.439511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:40.439511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:40.439511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:40.439511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:40.439511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:40.440430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:40.441305 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:40.441305 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:40.441305 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:40.441305 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:40.442000 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 397/793] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:40.443857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb49610-9253-4962-a6f3-d3145d3a9dd8 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:40.444293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb49610-9253-4962-a6f3-d3145d3a9dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:40.444633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb49610-9253-4962-a6f3-d3145d3a9dd8 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:40.446213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 398/794] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:40.448667 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb49610-9253-4962-a6f3-d3145d3a9dd8 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:40.476812 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6123c1-84cf-4b77-bc6a-4a75851683c0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:40.514495 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f07fd-b9c6-49fb-b332-f51142e8fe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:40.515146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f07fd-b9c6-49fb-b332-f51142e8fe04 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:40.515429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f07fd-b9c6-49fb-b332-f51142e8fe04 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:40.515706 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f07fd-b9c6-49fb-b332-f51142e8fe04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:40.524915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:40.530167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f07fd-b9c6-49fb-b332-f51142e8fe04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:40.531650 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f07fd-b9c6-49fb-b332-f51142e8fe04 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:40.548764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-b71f07fd-b9c6-49fb-b332-f51142e8fe04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:40.548764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:40.548764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:40.548764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:40.548764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:40.548764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:40.548764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:40.548764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:40.548764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:40.548764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:40.548764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:40.548764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:40.548764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:40.548764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:40.548764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:40.550198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:40.551103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:40.551103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:40.551103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:40.551103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:40.551103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 397/795] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:40.551541 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04693f6-7394-4b6f-8d3f-e0dac4479981 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:40.551714 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04693f6-7394-4b6f-8d3f-e0dac4479981 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:40.555367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04693f6-7394-4b6f-8d3f-e0dac4479981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:40.570900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b04693f6-7394-4b6f-8d3f-e0dac4479981 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:40.572103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b04693f6-7394-4b6f-8d3f-e0dac4479981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:40.583153 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb49610-9253-4962-a6f3-d3145d3a9dd8 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:40.588561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:40.631421 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911097a-9b2f-4808-8bc5-6e795c7452d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:40.632060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911097a-9b2f-4808-8bc5-6e795c7452d7 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:40.632342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911097a-9b2f-4808-8bc5-6e795c7452d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:40.632854 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911097a-9b2f-4808-8bc5-6e795c7452d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:40.633993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911097a-9b2f-4808-8bc5-6e795c7452d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:40.634300 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911097a-9b2f-4808-8bc5-6e795c7452d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:40.636174 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911097a-9b2f-4808-8bc5-6e795c7452d7 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:40.647000 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 398/796] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:13:40.648013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04693f6-7394-4b6f-8d3f-e0dac4479981 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:40.655115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 399/797] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:40.656197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911097a-9b2f-4808-8bc5-6e795c7452d7 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:40.775184 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911097a-9b2f-4808-8bc5-6e795c7452d7 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:40.778621 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04693f6-7394-4b6f-8d3f-e0dac4479981 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:40.793835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:40.812997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114932e-a364-49d3-81ac-788cf53da02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:40.814308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114932e-a364-49d3-81ac-788cf53da02a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:40.814810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114932e-a364-49d3-81ac-788cf53da02a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:40.815323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114932e-a364-49d3-81ac-788cf53da02a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:40.821997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9541f61-31d6-4674-9fc5-553ebed00cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:40.822630 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9541f61-31d6-4674-9fc5-553ebed00cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:40.822908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9541f61-31d6-4674-9fc5-553ebed00cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:40.823180 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9541f61-31d6-4674-9fc5-553ebed00cf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:40.823880 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9541f61-31d6-4674-9fc5-553ebed00cf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:40.824245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9541f61-31d6-4674-9fc5-553ebed00cf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:40.825710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9541f61-31d6-4674-9fc5-553ebed00cf8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:40.826001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114932e-a364-49d3-81ac-788cf53da02a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:40.827678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114932e-a364-49d3-81ac-788cf53da02a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:40.838949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 399/798] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:40.839996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9541f61-31d6-4674-9fc5-553ebed00cf8 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:40.841920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-f114932e-a364-49d3-81ac-788cf53da02a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:13:40.841920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:40.841920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:40.841920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:40.841920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:40.841920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:40.841920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:40.841920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:40.841920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:40.841920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:40.841920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:40.841920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:40.841920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:40.841920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:40.841920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:40.841920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:40.842823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:40.843750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:40.843750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:40.843750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:40.843750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:40.843750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:40.843750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:40.843750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:40.843750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:40.843750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:13:40.843750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:40.846258 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 400/799] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jul 28 05:13:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:40.847250 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114932e-a364-49d3-81ac-788cf53da02a None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:40.869944 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:40.954612 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9541f61-31d6-4674-9fc5-553ebed00cf8 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:40.973363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114932e-a364-49d3-81ac-788cf53da02a None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:40.988315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48700b1-25f2-449c-941d-043a212dd34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:40.988962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48700b1-25f2-449c-941d-043a212dd34e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:40.989245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48700b1-25f2-449c-941d-043a212dd34e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:40.989552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48700b1-25f2-449c-941d-043a212dd34e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:40.999627 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48700b1-25f2-449c-941d-043a212dd34e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:41.005005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-a48700b1-25f2-449c-941d-043a212dd34e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:13:41.005005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:41.005005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:41.005005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:41.005005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:41.005005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:41.005005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:41.005005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:41.005005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:41.005005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:41.005005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:41.005005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:41.005005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:41.005005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:41.005005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:41.005005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:41.006785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:41.006785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:41.006785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:41.006785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:41.006785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:41.006785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:41.006785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:41.006785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:41.006785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:41.006785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:41.006785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:41.006785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:41.006785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:41.006785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:41.006785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:41.006785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:41.007625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:41.007625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:41.007625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:41.007625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:41.007625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:41.007625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:41.007625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:41.007625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:41.007625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:41.007625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:41.007625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:13:41.007625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:41.007625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 400/800] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:13:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:41.008306 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48700b1-25f2-449c-941d-043a212dd34e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:41.014827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cb621-7ebc-4608-9e04-1e827bd9a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:41.015482 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cb621-7ebc-4608-9e04-1e827bd9a3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:41.015767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cb621-7ebc-4608-9e04-1e827bd9a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:41.016044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cb621-7ebc-4608-9e04-1e827bd9a3c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:41.023718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cb621-7ebc-4608-9e04-1e827bd9a3c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:41.025153 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cb621-7ebc-4608-9e04-1e827bd9a3c2 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:41.037081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-0b3cb621-7ebc-4608-9e04-1e827bd9a3c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:41.037081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:41.037081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:41.037081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:41.037081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:41.037081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:41.037081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:41.037081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:41.037081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:41.037081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:41.037081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:41.037081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:41.037081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:41.037081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:41.037081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:41.038029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:41.038956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:41.038956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:41.038956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:41.038956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:41.038956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:41.038956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:41.038956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:41.038956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:41.038956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 401/801] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:41.039908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c16c7-8ad9-4df5-958d-2af295c86f72 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:41.039908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c16c7-8ad9-4df5-958d-2af295c86f72 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:41.040062 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c16c7-8ad9-4df5-958d-2af295c86f72 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:41.041451 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 402/802] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:41.042027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c16c7-8ad9-4df5-958d-2af295c86f72 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:41.082334 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:41.093743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:41.129594 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48700b1-25f2-449c-941d-043a212dd34e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:41.158663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c16c7-8ad9-4df5-958d-2af295c86f72 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:41.166476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e46ad-e2a0-41a0-8247-cf2184a83ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:41.167102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e46ad-e2a0-41a0-8247-cf2184a83ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:41.167384 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e46ad-e2a0-41a0-8247-cf2184a83ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:41.167662 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e46ad-e2a0-41a0-8247-cf2184a83ec2 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:41.168457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e46ad-e2a0-41a0-8247-cf2184a83ec2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:41.168766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e46ad-e2a0-41a0-8247-cf2184a83ec2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:41.170223 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e46ad-e2a0-41a0-8247-cf2184a83ec2 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:41.189819 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 401/803] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jul 28 05:13:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:41.190660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e46ad-e2a0-41a0-8247-cf2184a83ec2 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:41.198453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c110a-0531-40f5-bd6c-76d1effb500a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:41.199083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c110a-0531-40f5-bd6c-76d1effb500a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:41.199367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c110a-0531-40f5-bd6c-76d1effb500a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:41.199641 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c110a-0531-40f5-bd6c-76d1effb500a None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:41.200363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c110a-0531-40f5-bd6c-76d1effb500a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:41.200671 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c110a-0531-40f5-bd6c-76d1effb500a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:41.204166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c110a-0531-40f5-bd6c-76d1effb500a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:41.214988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 403/804] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:13:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:41.216221 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d8794-8071-4228-9d5f-237a1b2970be None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:41.216512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d8794-8071-4228-9d5f-237a1b2970be None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:41.216793 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d8794-8071-4228-9d5f-237a1b2970be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:41.237095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e84d8794-8071-4228-9d5f-237a1b2970be None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:41.238336 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e84d8794-8071-4228-9d5f-237a1b2970be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:41.305968 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e46ad-e2a0-41a0-8247-cf2184a83ec2 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:41.311651 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 404/805] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:13:41.312992 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe882af-31b7-4344-949f-08289e02d39d None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:41.313562 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe882af-31b7-4344-949f-08289e02d39d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:41.313838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe882af-31b7-4344-949f-08289e02d39d None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:41.315206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 405/806] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:41.317008 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe882af-31b7-4344-949f-08289e02d39d None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:41.347666 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:41.350089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:41.357553 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25e597-6021-446e-8f40-6c5a3de6485d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:41.358179 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25e597-6021-446e-8f40-6c5a3de6485d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:41.358457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25e597-6021-446e-8f40-6c5a3de6485d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:41.358726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25e597-6021-446e-8f40-6c5a3de6485d None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:41.359474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25e597-6021-446e-8f40-6c5a3de6485d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:41.359780 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25e597-6021-446e-8f40-6c5a3de6485d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:41.361197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25e597-6021-446e-8f40-6c5a3de6485d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:41.378184 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 402/807] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:41.379053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25e597-6021-446e-8f40-6c5a3de6485d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:41.431262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe882af-31b7-4344-949f-08289e02d39d None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:41.471403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb7a78-caac-464d-85f0-cebc0513bc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:41.472060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb7a78-caac-464d-85f0-cebc0513bc92 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:41.472692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb7a78-caac-464d-85f0-cebc0513bc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:41.472977 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb7a78-caac-464d-85f0-cebc0513bc92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:41.484638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb7a78-caac-464d-85f0-cebc0513bc92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:41.486233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb7a78-caac-464d-85f0-cebc0513bc92 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:41.492200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25e597-6021-446e-8f40-6c5a3de6485d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:41.501379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-bccb7a78-caac-464d-85f0-cebc0513bc92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:41.501379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:41.501379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:41.501379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:41.501379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:41.501379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:41.501379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:41.501379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:41.501379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:41.501379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:41.501379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:41.501379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:41.501379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:41.501379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:41.501379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:41.502453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:41.503527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:41.503527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:41.503527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:41.503527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:41.503527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 406/808] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:41.503993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12808881-176f-4ce2-bbf4-f3005a71ec88 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:41.504061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12808881-176f-4ce2-bbf4-f3005a71ec88 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:41.504383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12808881-176f-4ce2-bbf4-f3005a71ec88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:41.529076 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-12808881-176f-4ce2-bbf4-f3005a71ec88 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:41.530334 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-12808881-176f-4ce2-bbf4-f3005a71ec88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:41.537198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f9437-09e7-4d22-b933-c0fee9b3b6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:41.537894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9437-09e7-4d22-b933-c0fee9b3b6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:41.538175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9437-09e7-4d22-b933-c0fee9b3b6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:41.538448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9437-09e7-4d22-b933-c0fee9b3b6d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:41.555277 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f9437-09e7-4d22-b933-c0fee9b3b6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:41.555562 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f9437-09e7-4d22-b933-c0fee9b3b6d2 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:41.570512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-0a0f9437-09e7-4d22-b933-c0fee9b3b6d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:41.570512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:41.570512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:41.570512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:41.570512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:41.570512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:41.570512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:41.570512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:41.570512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:41.570512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:41.570512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:41.570512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:41.570512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:41.570512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:41.570512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:41.571522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:41.572398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:41.572398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:41.572398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:41.572398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:41.572398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 403/809] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:41.573152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f9437-09e7-4d22-b933-c0fee9b3b6d2 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:41.603301 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 407/810] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:13:41.604138 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12808881-176f-4ce2-bbf4-f3005a71ec88 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:41.616108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:41.618174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:41.693098 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f9437-09e7-4d22-b933-c0fee9b3b6d2 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:41.716679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12808881-176f-4ce2-bbf4-f3005a71ec88 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:41.735809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc216ade-d9f6-4b34-9eee-6a9c33734be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:41.736444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216ade-d9f6-4b34-9eee-6a9c33734be9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:41.736725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216ade-d9f6-4b34-9eee-6a9c33734be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:41.737002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216ade-d9f6-4b34-9eee-6a9c33734be9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:41.737667 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc216ade-d9f6-4b34-9eee-6a9c33734be9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:41.739148 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc216ade-d9f6-4b34-9eee-6a9c33734be9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:41.752054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-dc216ade-d9f6-4b34-9eee-6a9c33734be9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:13:41.752054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:41.752054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:13:41.752054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:13:41.752054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:13:41.752054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:13:41.752054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:13:41.752054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:41.752054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:13:41.752054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:41.752054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:41.752054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:41.752054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:41.752054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:41.752054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:41.752054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:41.753032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:41.753032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:41.753032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:41.753032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:41.753032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:41.753032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:41.753032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:41.753032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:13:41.753032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:13:41.753032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:13:41.753032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:13:41.753032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:41.753032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:41.753032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:41.753032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:41.753032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:41.753881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:41.753881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:41.753881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:41.753881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:41.753881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:41.753881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:41.753881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:41.753881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:41.753881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:41.753881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:41.753881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:41.753881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:13:41.753881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:41.753881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:13:41.753881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:41.754659 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90130107-38d2-4f0f-a574-815db5dd7380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:41.754659 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90130107-38d2-4f0f-a574-815db5dd7380 None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:41.754659 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90130107-38d2-4f0f-a574-815db5dd7380 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:41.754659 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90130107-38d2-4f0f-a574-815db5dd7380 None admin] PATH_INFO: `/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/eb89e2ac885f42eb95fe3b67f3808ba9/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:41.754926 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 404/811] 10.222.0.33 () {56 vars in 1129 bytes} [Thu Jul 28 05:13:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:41.755637 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc216ade-d9f6-4b34-9eee-6a9c33734be9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:41.760059 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90130107-38d2-4f0f-a574-815db5dd7380 None admin] RBAC: Authorizing `identity:create_grant(project_id=089d8f58fc104484b617ec4a1317dbeb, user_id=eb89e2ac885f42eb95fe3b67f3808ba9, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:41.761699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90130107-38d2-4f0f-a574-815db5dd7380 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:41.822950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 408/812] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:13:41 2022] PUT /identity/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/eb89e2ac885f42eb95fe3b67f3808ba9/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:13:41.823683 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90130107-38d2-4f0f-a574-815db5dd7380 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:41.894620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc216ade-d9f6-4b34-9eee-6a9c33734be9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:41.898235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:41.929172 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:41.947270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724df52-76da-4a60-bff0-548aba3f8ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:41.947917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724df52-76da-4a60-bff0-548aba3f8ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:41.948196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724df52-76da-4a60-bff0-548aba3f8ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:41.948468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724df52-76da-4a60-bff0-548aba3f8ee9 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:41.949190 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724df52-76da-4a60-bff0-548aba3f8ee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:41.949522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724df52-76da-4a60-bff0-548aba3f8ee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:41.951053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724df52-76da-4a60-bff0-548aba3f8ee9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:41.969051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 405/813] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:41.970105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724df52-76da-4a60-bff0-548aba3f8ee9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:41.978886 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90130107-38d2-4f0f-a574-815db5dd7380 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:42.026711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819807c-f9a6-4df8-bd75-98137386de27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:42.027760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819807c-f9a6-4df8-bd75-98137386de27 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:42.028051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819807c-f9a6-4df8-bd75-98137386de27 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:42.028625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819807c-f9a6-4df8-bd75-98137386de27 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:42.029338 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819807c-f9a6-4df8-bd75-98137386de27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:42.029688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819807c-f9a6-4df8-bd75-98137386de27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:42.031832 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819807c-f9a6-4df8-bd75-98137386de27 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:42.044378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 409/814] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:42.045215 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819807c-f9a6-4df8-bd75-98137386de27 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:42.095819 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724df52-76da-4a60-bff0-548aba3f8ee9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:42.133268 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b90c9-3628-4558-b1d8-d0e0157b408e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:42.134223 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b90c9-3628-4558-b1d8-d0e0157b408e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:42.134652 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b90c9-3628-4558-b1d8-d0e0157b408e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:42.135181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b90c9-3628-4558-b1d8-d0e0157b408e None admin] PATH_INFO: `/v3/services/network` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:42.136067 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b90c9-3628-4558-b1d8-d0e0157b408e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:42.137607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b90c9-3628-4558-b1d8-d0e0157b408e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-ce2b90c9-3628-4558-b1d8-d0e0157b408e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:42.148193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:42.149183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:42.149183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:42.149183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:42.149183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:42.149183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:42.149183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:42.149183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:13:42.149183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:13:42.149183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:13:42.149183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:13:42.149183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:42.149183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:42.149183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:42.149183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:42.149183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:42.149183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:42.150345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:42.150345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:42.150345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:42.150345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:42.150345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:42.150345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:42.150345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:42.150345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:42.150345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:42.150345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:42.150345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:13:42.150345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:42.150345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:13:42.150345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:42.150345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 406/815] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:41 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:42.151188 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b90c9-3628-4558-b1d8-d0e0157b408e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:42.154205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819807c-f9a6-4df8-bd75-98137386de27 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:42.184011 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:42.186679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:42.193067 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f1427-9e0f-402d-a17c-6698a49ba702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:42.193844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f1427-9e0f-402d-a17c-6698a49ba702 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:42.194258 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f1427-9e0f-402d-a17c-6698a49ba702 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:42.194543 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f1427-9e0f-402d-a17c-6698a49ba702 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:42.195289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f1427-9e0f-402d-a17c-6698a49ba702 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:42.195660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f1427-9e0f-402d-a17c-6698a49ba702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:42.196985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f1427-9e0f-402d-a17c-6698a49ba702 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:42.201840 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 410/816] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jul 28 05:13:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:42.202653 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f1427-9e0f-402d-a17c-6698a49ba702 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:42.275551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b90c9-3628-4558-b1d8-d0e0157b408e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:42.307688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f1427-9e0f-402d-a17c-6698a49ba702 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:42.313337 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92622c30-1960-41fe-ab39-9b9423d76ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:42.314102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92622c30-1960-41fe-ab39-9b9423d76ccc None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:42.314448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92622c30-1960-41fe-ab39-9b9423d76ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:42.314788 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92622c30-1960-41fe-ab39-9b9423d76ccc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:42.322930 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92622c30-1960-41fe-ab39-9b9423d76ccc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:42.324444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92622c30-1960-41fe-ab39-9b9423d76ccc None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:42.337512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-92622c30-1960-41fe-ab39-9b9423d76ccc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:42.337512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:42.337512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:42.337512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:42.337512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:42.337512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:42.337512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:42.337512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:42.337512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:42.337512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:42.337512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:42.337512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:42.337512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:42.337512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:42.337512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:42.338592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:42.339707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:42.339707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:42.339707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:42.339707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:42.339707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:42.339707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:42.339707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:42.339707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:42.345130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 407/817] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:42.345130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92622c30-1960-41fe-ab39-9b9423d76ccc None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:42.351122 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a45ff-3902-4e9d-83fb-fe655bdb4f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:42.351801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a45ff-3902-4e9d-83fb-fe655bdb4f35 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:42.352162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a45ff-3902-4e9d-83fb-fe655bdb4f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:42.352512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a45ff-3902-4e9d-83fb-fe655bdb4f35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:42.360723 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a45ff-3902-4e9d-83fb-fe655bdb4f35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:42.362197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a45ff-3902-4e9d-83fb-fe655bdb4f35 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:42.373988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-155a45ff-3902-4e9d-83fb-fe655bdb4f35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:13:42.373988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:42.373988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:42.373988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:42.373988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:42.373988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:42.373988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:42.373988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:42.373988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:42.373988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:42.373988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:42.373988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:42.373988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:42.373988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:42.373988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:42.373988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:42.375084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:42.376139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:42.376139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:42.376139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:42.376139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:42.376139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:42.376139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:42.376139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:42.376139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:42.376139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:13:42.376139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:42.376139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 411/818] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jul 28 05:13:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:42.376712 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a45ff-3902-4e9d-83fb-fe655bdb4f35 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:42.436883 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:42.442465 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:42.457244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92622c30-1960-41fe-ab39-9b9423d76ccc None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:42.485217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a45ff-3902-4e9d-83fb-fe655bdb4f35 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:42.492325 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676c3e9-02b4-4e32-846f-6b526da799ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:42.493030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676c3e9-02b4-4e32-846f-6b526da799ad None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:42.493311 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676c3e9-02b4-4e32-846f-6b526da799ad None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:42.493982 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676c3e9-02b4-4e32-846f-6b526da799ad None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:42.494970 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676c3e9-02b4-4e32-846f-6b526da799ad None admin] RBAC: Adding query filter params (name=network) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:42.495275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676c3e9-02b4-4e32-846f-6b526da799ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:42.497045 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676c3e9-02b4-4e32-846f-6b526da799ad None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:42.506604 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 408/819] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jul 28 05:13:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:42.506604 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676c3e9-02b4-4e32-846f-6b526da799ad None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:42.526364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbc1d4-764e-4a69-a898-b731d6149199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:42.527087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbc1d4-764e-4a69-a898-b731d6149199 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:42.527453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbc1d4-764e-4a69-a898-b731d6149199 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:42.527832 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbc1d4-764e-4a69-a898-b731d6149199 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:42.528616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbc1d4-764e-4a69-a898-b731d6149199 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:42.529034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbc1d4-764e-4a69-a898-b731d6149199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:42.530553 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbc1d4-764e-4a69-a898-b731d6149199 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:42.540559 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 412/820] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jul 28 05:13:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:42.540559 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbc1d4-764e-4a69-a898-b731d6149199 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:42.616270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676c3e9-02b4-4e32-846f-6b526da799ad None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:42.643385 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbc1d4-764e-4a69-a898-b731d6149199 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:42.652572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba0b9e-cb7a-473d-97af-372c69376c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:42.653339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba0b9e-cb7a-473d-97af-372c69376c7f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:42.653451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba0b9e-cb7a-473d-97af-372c69376c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:42.653751 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba0b9e-cb7a-473d-97af-372c69376c7f None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:42.654494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba0b9e-cb7a-473d-97af-372c69376c7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:42.654800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba0b9e-cb7a-473d-97af-372c69376c7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:42.656239 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba0b9e-cb7a-473d-97af-372c69376c7f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:42.662902 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:42.673592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 409/821] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:42.673592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba0b9e-cb7a-473d-97af-372c69376c7f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:42.686803 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8111a7-fb0f-4a55-965d-900c8948cb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:42.687491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8111a7-fb0f-4a55-965d-900c8948cb51 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:42.687921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8111a7-fb0f-4a55-965d-900c8948cb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:42.688428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:42.688533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8111a7-fb0f-4a55-965d-900c8948cb51 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:42.689849 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8111a7-fb0f-4a55-965d-900c8948cb51 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:42.690173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8111a7-fb0f-4a55-965d-900c8948cb51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:42.691765 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8111a7-fb0f-4a55-965d-900c8948cb51 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:42.715574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 413/822] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jul 28 05:13:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:42.715574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8111a7-fb0f-4a55-965d-900c8948cb51 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:42.788074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba0b9e-cb7a-473d-97af-372c69376c7f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:42.824058 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5fe3c-4063-4422-bbba-c664fe7d939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:42.824685 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5fe3c-4063-4422-bbba-c664fe7d939d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:42.824967 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5fe3c-4063-4422-bbba-c664fe7d939d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:42.825247 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5fe3c-4063-4422-bbba-c664fe7d939d None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:42.825974 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5fe3c-4063-4422-bbba-c664fe7d939d None admin] RBAC: Adding query filter params (type=network) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:42.826284 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5fe3c-4063-4422-bbba-c664fe7d939d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:42.827765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5fe3c-4063-4422-bbba-c664fe7d939d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:42.828511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8111a7-fb0f-4a55-965d-900c8948cb51 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:42.855659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 410/823] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jul 28 05:13:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:42.855659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5fe3c-4063-4422-bbba-c664fe7d939d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:42.869847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b52303-3abe-4255-a704-478bc3cfa628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:42.870403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b52303-3abe-4255-a704-478bc3cfa628 None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:42.870684 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b52303-3abe-4255-a704-478bc3cfa628 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:42.870964 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b52303-3abe-4255-a704-478bc3cfa628 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:42.871674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b52303-3abe-4255-a704-478bc3cfa628 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:42.873029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b52303-3abe-4255-a704-478bc3cfa628 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:42.935623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:42.960519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5fe3c-4063-4422-bbba-c664fe7d939d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:42.976003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 414/824] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:13:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:13:42.976003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b52303-3abe-4255-a704-478bc3cfa628 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:43.021036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:43.034139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d09a3-4e57-456f-b49a-1eda94310983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:43.035196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d09a3-4e57-456f-b49a-1eda94310983 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:43.035660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d09a3-4e57-456f-b49a-1eda94310983 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:43.038333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d09a3-4e57-456f-b49a-1eda94310983 None admin] PATH_INFO: `/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/2d45700d35664abaae5eb8b42e2e05fb/roles/04fcac2c505f40a89923fa2f26cf548c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:43.070144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d09a3-4e57-456f-b49a-1eda94310983 None admin] RBAC: Authorizing `identity:create_grant(project_id=089d8f58fc104484b617ec4a1317dbeb, user_id=2d45700d35664abaae5eb8b42e2e05fb, role_id=04fcac2c505f40a89923fa2f26cf548c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:43.072657 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d09a3-4e57-456f-b49a-1eda94310983 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:43.116967 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b52303-3abe-4255-a704-478bc3cfa628 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:43.155895 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a38f1-a972-4368-b1ad-c298369ae461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:43.156525 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a38f1-a972-4368-b1ad-c298369ae461 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:43.156703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a38f1-a972-4368-b1ad-c298369ae461 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:43.157543 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a38f1-a972-4368-b1ad-c298369ae461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:43.165686 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 411/825] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:13:42 2022] PUT /identity/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/2d45700d35664abaae5eb8b42e2e05fb/roles/04fcac2c505f40a89923fa2f26cf548c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:13:43.166790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d09a3-4e57-456f-b49a-1eda94310983 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:43.242061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a38f1-a972-4368-b1ad-c298369ae461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:43.244105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a38f1-a972-4368-b1ad-c298369ae461 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:43.295400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:43.318858 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d09a3-4e57-456f-b49a-1eda94310983 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:43.346702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:43.362992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ff313-18e2-4242-ba0c-24a402a67da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:43.363873 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ff313-18e2-4242-ba0c-24a402a67da8 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:43.364303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ff313-18e2-4242-ba0c-24a402a67da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:43.365289 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ff313-18e2-4242-ba0c-24a402a67da8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:43.366401 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ff313-18e2-4242-ba0c-24a402a67da8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:43.368747 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ff313-18e2-4242-ba0c-24a402a67da8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:43.397999 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 415/826] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:13:43.404422 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a38f1-a972-4368-b1ad-c298369ae461 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:43.474126 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 412/827] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:13:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:13:43.550175 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a38f1-a972-4368-b1ad-c298369ae461 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:43.585570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:43.600480 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f5880-1f31-419b-8807-a12d1213b7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:43.601129 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f5880-1f31-419b-8807-a12d1213b7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:43.601406 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f5880-1f31-419b-8807-a12d1213b7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:43.601702 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f5880-1f31-419b-8807-a12d1213b7e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:43.620108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f5880-1f31-419b-8807-a12d1213b7e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:43.622185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f5880-1f31-419b-8807-a12d1213b7e8 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:43.646470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-294f5880-1f31-419b-8807-a12d1213b7e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:43.646470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:43.646470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:43.646470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:43.646470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:43.646470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:43.646470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:43.646470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:43.646470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:43.646470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:43.646470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:43.646470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:43.646470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:43.646470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:43.646470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:43.647534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:43.648526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:43.648526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:43.648526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:43.648526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:43.649565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 416/828] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:43.655586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ff313-18e2-4242-ba0c-24a402a67da8 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:43.820520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ff313-18e2-4242-ba0c-24a402a67da8 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:43.858755 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b8a21-be13-47c7-b4d7-824fc853cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:43.859389 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b8a21-be13-47c7-b4d7-824fc853cd92 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:43.859674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b8a21-be13-47c7-b4d7-824fc853cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:43.859955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b8a21-be13-47c7-b4d7-824fc853cd92 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:43.860662 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b8a21-be13-47c7-b4d7-824fc853cd92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:43.860971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b8a21-be13-47c7-b4d7-824fc853cd92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:43.862379 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b8a21-be13-47c7-b4d7-824fc853cd92 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:43.876196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 413/829] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:43.882079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f5880-1f31-419b-8807-a12d1213b7e8 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:43.984941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa0be6-b517-41dc-9229-45d51070f186 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:43.985265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa0be6-b517-41dc-9229-45d51070f186 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:43.985526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa0be6-b517-41dc-9229-45d51070f186 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:43.988213 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 414/830] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:43.992854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b79664-ef14-4779-a642-8c8e770806bd None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:43.993141 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b79664-ef14-4779-a642-8c8e770806bd None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:43.993520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b79664-ef14-4779-a642-8c8e770806bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:43.999210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f5880-1f31-419b-8807-a12d1213b7e8 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:44.012731 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-56b79664-ef14-4779-a642-8c8e770806bd None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:44.013793 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-56b79664-ef14-4779-a642-8c8e770806bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:44.045056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb7994-0d65-427c-a103-786cea8f0395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:44.046317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb7994-0d65-427c-a103-786cea8f0395 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:44.046973 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb7994-0d65-427c-a103-786cea8f0395 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:44.047476 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb7994-0d65-427c-a103-786cea8f0395 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:44.048189 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:44.057671 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb7994-0d65-427c-a103-786cea8f0395 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:44.059296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb7994-0d65-427c-a103-786cea8f0395 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:44.073972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-47bb7994-0d65-427c-a103-786cea8f0395 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:44.073972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:44.073972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:44.073972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:44.073972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:44.073972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:44.073972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:44.073972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:44.073972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:44.073972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:44.073972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:44.073972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:44.073972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:44.073972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:44.073972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:44.074962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:44.075855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:44.075855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:44.075855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:44.075855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:44.075855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:44.075855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:44.075855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:44.075855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:44.078503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 417/831] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:44.086790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb7994-0d65-427c-a103-786cea8f0395 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:44.101610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 415/832] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:13:44.123735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b79664-ef14-4779-a642-8c8e770806bd None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:44.133732 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:44.199271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb7994-0d65-427c-a103-786cea8f0395 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:44.234306 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b79664-ef14-4779-a642-8c8e770806bd None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:44.237623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afc18e-6cde-4843-bf11-b2fe2cfbb281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:44.237623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afc18e-6cde-4843-bf11-b2fe2cfbb281 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:44.237826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afc18e-6cde-4843-bf11-b2fe2cfbb281 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:44.238273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afc18e-6cde-4843-bf11-b2fe2cfbb281 None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:44.239092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afc18e-6cde-4843-bf11-b2fe2cfbb281 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:44.239468 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afc18e-6cde-4843-bf11-b2fe2cfbb281 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:44.241177 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afc18e-6cde-4843-bf11-b2fe2cfbb281 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:44.254656 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 418/833] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:44.260484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afc18e-6cde-4843-bf11-b2fe2cfbb281 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:44.277417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4801b8-bee3-42f4-a20d-1ce73fea231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:44.278422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4801b8-bee3-42f4-a20d-1ce73fea231e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:44.279376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4801b8-bee3-42f4-a20d-1ce73fea231e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:44.279861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4801b8-bee3-42f4-a20d-1ce73fea231e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:44.293873 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4801b8-bee3-42f4-a20d-1ce73fea231e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:44.300853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-2a4801b8-bee3-42f4-a20d-1ce73fea231e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:13:44.300853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:44.300853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:44.300853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:44.300853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:44.300853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:44.300853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:44.300853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:44.300853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:44.300853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:44.300853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:44.300853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:44.300853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:44.300853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:44.300853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:44.300853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:44.301787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:44.301787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:44.301787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:44.301787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:44.301787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:44.301787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:44.301787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:44.301787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:44.301787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:44.301787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:44.301787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:44.301787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:44.301787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:44.301787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:44.301787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:44.301787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:44.302744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:44.302744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:44.302744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:44.302744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:44.302744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:44.302744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:44.302744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:44.302744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:44.302744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:44.302744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:44.302744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:13:44.302744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:44.304018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 416/834] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:13:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:44.313724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4801b8-bee3-42f4-a20d-1ce73fea231e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:44.362568 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:44.395448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:44.400741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afc18e-6cde-4843-bf11-b2fe2cfbb281 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:44.446320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3446a4e-8319-4232-bd23-9435316aa6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:44.447586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3446a4e-8319-4232-bd23-9435316aa6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:44.448262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3446a4e-8319-4232-bd23-9435316aa6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:44.448692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3446a4e-8319-4232-bd23-9435316aa6b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:44.449825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3446a4e-8319-4232-bd23-9435316aa6b3 None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=99d8c709e6f4462c98c055cb03eebf42) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:44.450291 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3446a4e-8319-4232-bd23-9435316aa6b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:44.452127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3446a4e-8319-4232-bd23-9435316aa6b3 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:44.460894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 419/835] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:44 2022] GET /identity/v3/role_assignments?user.id=99d8c709e6f4462c98c055cb03eebf42&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:44.469498 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4801b8-bee3-42f4-a20d-1ce73fea231e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:44.508978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d80e0-a1fe-4498-97ef-65f719c936f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:44.509657 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d80e0-a1fe-4498-97ef-65f719c936f1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:44.509937 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d80e0-a1fe-4498-97ef-65f719c936f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:44.510211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d80e0-a1fe-4498-97ef-65f719c936f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:44.510951 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d80e0-a1fe-4498-97ef-65f719c936f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:44.511367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d80e0-a1fe-4498-97ef-65f719c936f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:44.512840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d80e0-a1fe-4498-97ef-65f719c936f1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:44.523803 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 417/836] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:13:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:44.529556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3446a4e-8319-4232-bd23-9435316aa6b3 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:44.640300 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3446a4e-8319-4232-bd23-9435316aa6b3 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:44.680592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017b664-ffcc-41a5-bc3b-9d6b2182d444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:44.681632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017b664-ffcc-41a5-bc3b-9d6b2182d444 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:44.682124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017b664-ffcc-41a5-bc3b-9d6b2182d444 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:44.682604 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017b664-ffcc-41a5-bc3b-9d6b2182d444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:44.694700 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017b664-ffcc-41a5-bc3b-9d6b2182d444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:44.696491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017b664-ffcc-41a5-bc3b-9d6b2182d444 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:44.712288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-9017b664-ffcc-41a5-bc3b-9d6b2182d444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:44.712288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:44.712288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:44.712288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:44.712288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:44.712288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:44.712288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:44.712288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:44.712288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:44.712288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:44.712288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:44.712288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:44.712288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:44.712288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:44.712288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:44.713192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:44.714110 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:44.714110 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:44.714110 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:44.714110 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:44.716350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 420/837] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:44.721606 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d80e0-a1fe-4498-97ef-65f719c936f1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:44.826591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:44.837083 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d80e0-a1fe-4498-97ef-65f719c936f1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:44.872768 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb4b79-bb0d-450d-9e00-412d85976755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:44.873401 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb4b79-bb0d-450d-9e00-412d85976755 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:44.873713 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb4b79-bb0d-450d-9e00-412d85976755 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:44.873993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb4b79-bb0d-450d-9e00-412d85976755 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:44.874694 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb4b79-bb0d-450d-9e00-412d85976755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:44.875001 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb4b79-bb0d-450d-9e00-412d85976755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:44.876407 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb4b79-bb0d-450d-9e00-412d85976755 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:44.889062 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 418/838] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:44.894970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017b664-ffcc-41a5-bc3b-9d6b2182d444 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:44.915738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:44.997919 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017b664-ffcc-41a5-bc3b-9d6b2182d444 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:45.032530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d36d1f-0874-4d93-803c-6680d7e7e051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:45.033180 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d36d1f-0874-4d93-803c-6680d7e7e051 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:45.033478 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d36d1f-0874-4d93-803c-6680d7e7e051 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:45.033775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d36d1f-0874-4d93-803c-6680d7e7e051 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:45.042052 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d36d1f-0874-4d93-803c-6680d7e7e051 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:45.043486 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d36d1f-0874-4d93-803c-6680d7e7e051 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:45.055524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-66d36d1f-0874-4d93-803c-6680d7e7e051 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:13:45.055524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:45.055524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:45.055524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:45.055524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:45.055524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:45.055524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:45.055524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:45.055524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:45.055524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:45.055524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:45.055524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:45.055524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:45.055524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:45.055524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:45.055524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:45.056436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:45.057774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:45.057774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:45.057774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:45.057774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:45.057774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:45.057774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:45.057774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:45.057774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:45.057774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:13:45.057774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:45.057774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 421/839] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:13:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:45.062458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb4b79-bb0d-450d-9e00-412d85976755 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:45.166475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb4b79-bb0d-450d-9e00-412d85976755 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:45.202958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b16f1-6637-4d5e-bb7a-1eebfe1516be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:45.203587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b16f1-6637-4d5e-bb7a-1eebfe1516be None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:45.203871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b16f1-6637-4d5e-bb7a-1eebfe1516be None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:45.204145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b16f1-6637-4d5e-bb7a-1eebfe1516be None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:45.205005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b16f1-6637-4d5e-bb7a-1eebfe1516be None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:45.205320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b16f1-6637-4d5e-bb7a-1eebfe1516be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:45.206774 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b16f1-6637-4d5e-bb7a-1eebfe1516be None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:45.225896 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 419/840] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jul 28 05:13:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:45.231218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d36d1f-0874-4d93-803c-6680d7e7e051 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:45.324010 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:45.348188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d36d1f-0874-4d93-803c-6680d7e7e051 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:45.384093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087c8e8-a8d4-40e5-b82c-0536110940e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:45.384724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087c8e8-a8d4-40e5-b82c-0536110940e8 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:45.385007 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087c8e8-a8d4-40e5-b82c-0536110940e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:45.385287 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087c8e8-a8d4-40e5-b82c-0536110940e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:45.455867 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087c8e8-a8d4-40e5-b82c-0536110940e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:45.457239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087c8e8-a8d4-40e5-b82c-0536110940e8 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:45.534375 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:45.559425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 422/841] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:13:45.565262 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b16f1-6637-4d5e-bb7a-1eebfe1516be None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:45.578689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:45.676877 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b16f1-6637-4d5e-bb7a-1eebfe1516be None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:45.714280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60650694-3e59-4d1d-b776-29b0509568bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:45.714867 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60650694-3e59-4d1d-b776-29b0509568bc None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:45.715152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60650694-3e59-4d1d-b776-29b0509568bc None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:45.715430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60650694-3e59-4d1d-b776-29b0509568bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:45.727886 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60650694-3e59-4d1d-b776-29b0509568bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:45.729351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60650694-3e59-4d1d-b776-29b0509568bc None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:45.739595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6fe9a-656c-4fa1-a699-97a5af6d8e04 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:45.740163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6fe9a-656c-4fa1-a699-97a5af6d8e04 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:45.740450 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6fe9a-656c-4fa1-a699-97a5af6d8e04 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:45.742083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 423/842] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:45.745201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-60650694-3e59-4d1d-b776-29b0509568bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:45.745201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:45.745201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:45.745201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:45.745201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:45.745201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:45.745201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:45.745201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:45.745201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:45.745201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:45.745201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:45.745201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:45.745201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:45.745201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:45.745201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:45.746134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:45.747027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:45.747027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:45.747027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:45.747027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:45.747027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 420/843] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:45.748901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5638d-56a6-4ff6-95ed-5abdfa5e48c7 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:45.749394 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5638d-56a6-4ff6-95ed-5abdfa5e48c7 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:45.749892 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5638d-56a6-4ff6-95ed-5abdfa5e48c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:45.752065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60650694-3e59-4d1d-b776-29b0509568bc None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:45.770680 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-7ed5638d-56a6-4ff6-95ed-5abdfa5e48c7 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:45.776055 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7ed5638d-56a6-4ff6-95ed-5abdfa5e48c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:45.824279 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:45.846011 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 424/844] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:13:45.847645 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fe4c6-bd05-4e3d-a60e-fb9d024ae9fb None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:45.848220 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fe4c6-bd05-4e3d-a60e-fb9d024ae9fb None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:45.848506 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fe4c6-bd05-4e3d-a60e-fb9d024ae9fb None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:45.858610 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 425/845] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:45.858610 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690daaf7-e441-461d-8cc8-955ea3e26524 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:45.858610 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690daaf7-e441-461d-8cc8-955ea3e26524 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:45.858610 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690daaf7-e441-461d-8cc8-955ea3e26524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:45.876676 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60650694-3e59-4d1d-b776-29b0509568bc None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:45.877084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-690daaf7-e441-461d-8cc8-955ea3e26524 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:45.878361 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-690daaf7-e441-461d-8cc8-955ea3e26524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:45.914035 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174811b-1aed-4115-9473-5359299e9410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:45.914671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174811b-1aed-4115-9473-5359299e9410 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:45.914956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174811b-1aed-4115-9473-5359299e9410 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:45.915236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174811b-1aed-4115-9473-5359299e9410 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:45.915926 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174811b-1aed-4115-9473-5359299e9410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:45.916282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174811b-1aed-4115-9473-5359299e9410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:45.917621 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174811b-1aed-4115-9473-5359299e9410 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:45.934708 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 421/846] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:45.934708 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174811b-1aed-4115-9473-5359299e9410 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:45.959107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 426/847] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:13:45.960151 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690daaf7-e441-461d-8cc8-955ea3e26524 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:45.996058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:46.057128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174811b-1aed-4115-9473-5359299e9410 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:46.066715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690daaf7-e441-461d-8cc8-955ea3e26524 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:46.079565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:46.094402 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7857d1a-408e-45f3-9541-f0615e1d65c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:46.095161 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7857d1a-408e-45f3-9541-f0615e1d65c6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:46.095439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7857d1a-408e-45f3-9541-f0615e1d65c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:46.095826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7857d1a-408e-45f3-9541-f0615e1d65c6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:46.096449 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7857d1a-408e-45f3-9541-f0615e1d65c6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:46.097841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7857d1a-408e-45f3-9541-f0615e1d65c6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:46.104454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbca51-a754-42cb-8cad-bc597f6ff100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:46.105103 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbca51-a754-42cb-8cad-bc597f6ff100 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:46.105386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbca51-a754-42cb-8cad-bc597f6ff100 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:46.105690 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbca51-a754-42cb-8cad-bc597f6ff100 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c7857d1a-408e-45f3-9541-f0615e1d65c6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:46.107992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:46.108989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:46.108989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:46.108989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:46.108989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:46.108989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:46.108989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:46.108989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:13:46.108989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:13:46.108989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:13:46.108989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:13:46.108989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:46.108989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:46.108989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:46.108989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:46.108989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:46.108989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:46.110163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:46.110163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:46.110163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:46.110163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:46.110163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:46.110163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:46.110163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:46.110163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:46.110163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:46.110163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:46.110163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:13:46.110163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:46.110163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:13:46.110163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:46.113604 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 422/848] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:13:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:46.115160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7857d1a-408e-45f3-9541-f0615e1d65c6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:46.115526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbca51-a754-42cb-8cad-bc597f6ff100 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:46.116999 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbca51-a754-42cb-8cad-bc597f6ff100 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:46.128679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-e0fbca51-a754-42cb-8cad-bc597f6ff100 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:46.128679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:46.128679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:46.128679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:46.128679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:46.128679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:46.128679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:46.128679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:46.128679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:46.128679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:46.128679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:46.128679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:46.128679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:46.128679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:46.128679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:46.129617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:46.131094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:46.131094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:46.131094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:46.131094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:46.131094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:46.131094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:46.131094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:46.131094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:46.131094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 427/849] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:46.131563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbca51-a754-42cb-8cad-bc597f6ff100 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:46.227495 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7857d1a-408e-45f3-9541-f0615e1d65c6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:46.232097 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:46.238224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbca51-a754-42cb-8cad-bc597f6ff100 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:46.269768 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe31a65-8c05-45a2-a3f2-471c52c286d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:46.270422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe31a65-8c05-45a2-a3f2-471c52c286d2 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:46.270707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe31a65-8c05-45a2-a3f2-471c52c286d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:46.271528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe31a65-8c05-45a2-a3f2-471c52c286d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:46.280053 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f660318-14ae-40aa-afdf-69257b505935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:46.280686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f660318-14ae-40aa-afdf-69257b505935 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:46.280975 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f660318-14ae-40aa-afdf-69257b505935 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:46.281255 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f660318-14ae-40aa-afdf-69257b505935 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:46.282008 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f660318-14ae-40aa-afdf-69257b505935 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:46.282318 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f660318-14ae-40aa-afdf-69257b505935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:46.282432 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe31a65-8c05-45a2-a3f2-471c52c286d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:46.283686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f660318-14ae-40aa-afdf-69257b505935 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:46.287979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-9fe31a65-8c05-45a2-a3f2-471c52c286d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:46.287979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:46.287979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:46.287979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:46.287979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:46.287979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:46.287979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:46.287979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:46.287979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:46.287979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:46.287979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:46.287979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:46.287979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:46.287979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:46.287979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:46.287979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:46.293898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:46.293898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:46.293898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:46.293898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:46.293898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:46.293898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:46.293898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:46.293898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:46.293898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:46.293898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:46.293898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:46.293898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:46.293898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:46.293898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:46.293898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:46.293898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:46.294745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:46.294745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:46.294745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:46.294745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:46.294745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:46.294745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:46.294745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:46.294745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:46.294745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:46.294745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:46.294745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:13:46.294745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:46.295381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 428/850] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:13:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:46.295465 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 423/851] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:13:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:46.295465 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe31a65-8c05-45a2-a3f2-471c52c286d2 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:46.295589 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f660318-14ae-40aa-afdf-69257b505935 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:46.344252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:46.401591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f660318-14ae-40aa-afdf-69257b505935 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:46.409403 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe31a65-8c05-45a2-a3f2-471c52c286d2 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:46.438428 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e729efa-383c-427d-8178-186be27b6938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:46.439060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e729efa-383c-427d-8178-186be27b6938 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:46.439364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e729efa-383c-427d-8178-186be27b6938 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:46.439620 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e729efa-383c-427d-8178-186be27b6938 None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:46.440369 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e729efa-383c-427d-8178-186be27b6938 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:46.440682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e729efa-383c-427d-8178-186be27b6938 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:46.442135 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e729efa-383c-427d-8178-186be27b6938 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:46.445373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3375f45-323d-4cc2-aab4-797e7900a0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:46.446031 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3375f45-323d-4cc2-aab4-797e7900a0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:46.446316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3375f45-323d-4cc2-aab4-797e7900a0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:46.446592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3375f45-323d-4cc2-aab4-797e7900a0d4 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:46.447269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3375f45-323d-4cc2-aab4-797e7900a0d4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:46.447593 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3375f45-323d-4cc2-aab4-797e7900a0d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:46.448928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3375f45-323d-4cc2-aab4-797e7900a0d4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:46.461570 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 424/852] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:13:46 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:46.461570 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3375f45-323d-4cc2-aab4-797e7900a0d4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:46.461850 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 429/853] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:46.461850 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e729efa-383c-427d-8178-186be27b6938 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:46.485557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:46.580465 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e729efa-383c-427d-8178-186be27b6938 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:46.611256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3375f45-323d-4cc2-aab4-797e7900a0d4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:46.621900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:46.632078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa265fe3-0ad4-45f8-bb6a-a88401183bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:46.633239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa265fe3-0ad4-45f8-bb6a-a88401183bfc None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:46.633239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa265fe3-0ad4-45f8-bb6a-a88401183bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:46.633410 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa265fe3-0ad4-45f8-bb6a-a88401183bfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:46.643435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa265fe3-0ad4-45f8-bb6a-a88401183bfc None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=eb89e2ac885f42eb95fe3b67f3808ba9) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:46.643435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa265fe3-0ad4-45f8-bb6a-a88401183bfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:46.643435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa265fe3-0ad4-45f8-bb6a-a88401183bfc None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:46.649180 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 430/854] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:46 2022] GET /identity/v3/role_assignments?user.id=eb89e2ac885f42eb95fe3b67f3808ba9&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:46.653892 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d78259-896a-4260-a7f4-ab503b0f8009 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:46.654244 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d78259-896a-4260-a7f4-ab503b0f8009 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:46.654588 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d78259-896a-4260-a7f4-ab503b0f8009 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:46.656199 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 431/855] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:13:46.656326 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4a1b2-9703-4cab-bd2a-104d47b4f018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:46.656974 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4a1b2-9703-4cab-bd2a-104d47b4f018 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:46.657265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4a1b2-9703-4cab-bd2a-104d47b4f018 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:46.661826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4a1b2-9703-4cab-bd2a-104d47b4f018 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:46.664235 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac45c81-cbde-4e01-9bdb-9e21acf11e0d None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:46.664596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac45c81-cbde-4e01-9bdb-9e21acf11e0d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:46.664872 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac45c81-cbde-4e01-9bdb-9e21acf11e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:46.666609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4a1b2-9703-4cab-bd2a-104d47b4f018 None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:46.667160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4a1b2-9703-4cab-bd2a-104d47b4f018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:46.668783 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4a1b2-9703-4cab-bd2a-104d47b4f018 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:46.682235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 425/856] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:13:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:46.685262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-cac45c81-cbde-4e01-9bdb-9e21acf11e0d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:46.686517 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-cac45c81-cbde-4e01-9bdb-9e21acf11e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:46.687839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4a1b2-9703-4cab-bd2a-104d47b4f018 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:46.766262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 432/857] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:13:46.788651 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac45c81-cbde-4e01-9bdb-9e21acf11e0d None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:46.812052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4a1b2-9703-4cab-bd2a-104d47b4f018 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:46.818413 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:46.857651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274119f-943b-4e71-bdd2-90cf46731cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:46.858641 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274119f-943b-4e71-bdd2-90cf46731cee None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:46.858923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274119f-943b-4e71-bdd2-90cf46731cee None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:46.859197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274119f-943b-4e71-bdd2-90cf46731cee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:46.872786 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274119f-943b-4e71-bdd2-90cf46731cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:46.874522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274119f-943b-4e71-bdd2-90cf46731cee None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:46.895027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-5274119f-943b-4e71-bdd2-90cf46731cee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:46.895027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:46.895027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:46.895027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:46.895027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:46.895027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:46.895027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:46.895027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:46.895027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:46.895027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:46.895027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:46.895027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:46.895027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:46.895027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:46.895027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:46.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:46.897414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:46.897414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:46.897414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:46.897414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:46.900967 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 426/858] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:46.903297 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274119f-943b-4e71-bdd2-90cf46731cee None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:46.916943 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac45c81-cbde-4e01-9bdb-9e21acf11e0d None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:46.934826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:46.973496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc6374-4290-41b6-b013-5d6b8ab36d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:46.973496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc6374-4290-41b6-b013-5d6b8ab36d94 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:46.973496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc6374-4290-41b6-b013-5d6b8ab36d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:46.973496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc6374-4290-41b6-b013-5d6b8ab36d94 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:46.973962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc6374-4290-41b6-b013-5d6b8ab36d94 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:46.973962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc6374-4290-41b6-b013-5d6b8ab36d94 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:46.985801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-6acc6374-4290-41b6-b013-5d6b8ab36d94 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:13:46.985801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:46.985801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:13:46.985801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:13:46.985801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:13:46.985801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:13:46.985801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:13:46.985801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:46.985801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:13:46.985801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:46.985801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:46.985801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:46.985801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:46.985801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:46.985801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:46.985801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:46.986731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:46.986731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:46.986731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:46.986731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:46.986731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:46.986731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:46.986731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:46.986731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:13:46.986731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:13:46.986731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:13:46.986731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:13:46.986731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:46.986731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:46.986731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:46.986731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:46.986731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:46.987581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:46.987581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:46.987581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:46.987581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:46.987581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:46.987581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:46.987581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:46.987581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:46.987581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:46.987581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:46.987581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:46.987581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:13:46.987581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:46.987581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:13:46.987581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:46.988376 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 433/859] 10.222.0.33 () {56 vars in 1132 bytes} [Thu Jul 28 05:13:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:46.994800 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc6374-4290-41b6-b013-5d6b8ab36d94 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:47.025723 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274119f-943b-4e71-bdd2-90cf46731cee None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:47.064324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629a2a8-a021-495a-b5a2-42676677cb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:47.065347 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629a2a8-a021-495a-b5a2-42676677cb7a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:47.065914 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629a2a8-a021-495a-b5a2-42676677cb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:47.066394 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629a2a8-a021-495a-b5a2-42676677cb7a None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:47.067312 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629a2a8-a021-495a-b5a2-42676677cb7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:47.068352 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629a2a8-a021-495a-b5a2-42676677cb7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:47.070076 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629a2a8-a021-495a-b5a2-42676677cb7a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:47.089516 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 427/860] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:47.090754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629a2a8-a021-495a-b5a2-42676677cb7a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:47.103039 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:47.130954 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc6374-4290-41b6-b013-5d6b8ab36d94 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:47.168833 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2e336-80e5-4ab6-93ed-c678f0f12aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:47.169521 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2e336-80e5-4ab6-93ed-c678f0f12aaa None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:47.169815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2e336-80e5-4ab6-93ed-c678f0f12aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:47.170093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2e336-80e5-4ab6-93ed-c678f0f12aaa None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:47.170775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2e336-80e5-4ab6-93ed-c678f0f12aaa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:47.171083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2e336-80e5-4ab6-93ed-c678f0f12aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:47.172521 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2e336-80e5-4ab6-93ed-c678f0f12aaa None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:47.183794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 434/861] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jul 28 05:13:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:47.184703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2e336-80e5-4ab6-93ed-c678f0f12aaa None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:47.207709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:47.228923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629a2a8-a021-495a-b5a2-42676677cb7a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:47.276966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fbc76-56f8-46a6-aae7-89b040901776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:47.278193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fbc76-56f8-46a6-aae7-89b040901776 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:47.278753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fbc76-56f8-46a6-aae7-89b040901776 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:47.279302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fbc76-56f8-46a6-aae7-89b040901776 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:47.288864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fbc76-56f8-46a6-aae7-89b040901776 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:47.290440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fbc76-56f8-46a6-aae7-89b040901776 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:47.302961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-b43fbc76-56f8-46a6-aae7-89b040901776 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:13:47.302961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:47.302961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:47.302961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:47.302961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:47.302961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:47.302961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:47.302961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:47.302961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:47.302961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:47.302961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:47.302961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:47.302961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:47.302961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:47.302961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:47.302961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:47.304002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:47.304941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:47.304941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:47.304941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:47.304941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:47.304941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:47.304941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:47.304941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:47.304941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:47.304941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:13:47.304941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:47.309064 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 428/862] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jul 28 05:13:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:47.310003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fbc76-56f8-46a6-aae7-89b040901776 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:47.324237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2e336-80e5-4ab6-93ed-c678f0f12aaa None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:47.367594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8144bdf-52bd-4300-bf20-ad230fef051b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:47.368332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8144bdf-52bd-4300-bf20-ad230fef051b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:47.368683 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8144bdf-52bd-4300-bf20-ad230fef051b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:47.369034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8144bdf-52bd-4300-bf20-ad230fef051b None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:47.369822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8144bdf-52bd-4300-bf20-ad230fef051b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:47.370205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8144bdf-52bd-4300-bf20-ad230fef051b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:47.371635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8144bdf-52bd-4300-bf20-ad230fef051b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:47.382660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 435/863] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jul 28 05:13:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:47.431563 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fbc76-56f8-46a6-aae7-89b040901776 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:47.472452 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da8b78-acc4-4575-a2be-08b40df68510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:47.473443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da8b78-acc4-4575-a2be-08b40df68510 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:47.474494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da8b78-acc4-4575-a2be-08b40df68510 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:47.474990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da8b78-acc4-4575-a2be-08b40df68510 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:47.476039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da8b78-acc4-4575-a2be-08b40df68510 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:47.476556 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da8b78-acc4-4575-a2be-08b40df68510 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:47.478218 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da8b78-acc4-4575-a2be-08b40df68510 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:47.495057 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:47.500625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 429/864] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jul 28 05:13:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:47.506887 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8144bdf-52bd-4300-bf20-ad230fef051b None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:47.517797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:47.617292 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8144bdf-52bd-4300-bf20-ad230fef051b None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:47.655327 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f47603-8d26-4792-b8c5-5204fdf4e3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:47.656314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f47603-8d26-4792-b8c5-5204fdf4e3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:47.656800 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f47603-8d26-4792-b8c5-5204fdf4e3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:47.657276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f47603-8d26-4792-b8c5-5204fdf4e3c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:47.732735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f47603-8d26-4792-b8c5-5204fdf4e3c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:47.734282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f47603-8d26-4792-b8c5-5204fdf4e3c6 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:47.743274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:47.837004 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 436/865] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:13:47.842866 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da8b78-acc4-4575-a2be-08b40df68510 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:47.949952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da8b78-acc4-4575-a2be-08b40df68510 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:47.985805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdca016-4fb0-46e9-a438-f0b80f33a7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:47.986451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdca016-4fb0-46e9-a438-f0b80f33a7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:47.986773 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdca016-4fb0-46e9-a438-f0b80f33a7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:47.987059 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdca016-4fb0-46e9-a438-f0b80f33a7f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:47.997521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdca016-4fb0-46e9-a438-f0b80f33a7f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:47.998972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdca016-4fb0-46e9-a438-f0b80f33a7f6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:48.014897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-2fdca016-4fb0-46e9-a438-f0b80f33a7f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:48.014897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:48.014897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:48.014897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:48.014897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:48.014897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:48.014897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:48.014897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:48.014897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:48.014897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:48.014897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:48.014897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:48.014897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:48.014897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:48.014897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:48.015815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:48.017111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:48.017111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:48.017111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:48.017111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:48.017111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 430/866] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:48.022766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f47603-8d26-4792-b8c5-5204fdf4e3c6 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:48.131795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f47603-8d26-4792-b8c5-5204fdf4e3c6 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:48.140500 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:48.170455 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033a04e-1f41-4de3-914a-f6feb48427b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:48.171391 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033a04e-1f41-4de3-914a-f6feb48427b3 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:48.171855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033a04e-1f41-4de3-914a-f6feb48427b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:48.172361 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033a04e-1f41-4de3-914a-f6feb48427b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:48.173233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033a04e-1f41-4de3-914a-f6feb48427b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:48.173752 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033a04e-1f41-4de3-914a-f6feb48427b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:48.175297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033a04e-1f41-4de3-914a-f6feb48427b3 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:48.188412 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 437/867] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:48.194505 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdca016-4fb0-46e9-a438-f0b80f33a7f6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:48.251497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:48.304255 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdca016-4fb0-46e9-a438-f0b80f33a7f6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:48.340920 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ac818-2293-4c1f-8477-02b6f680537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:48.341602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ac818-2293-4c1f-8477-02b6f680537a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:48.341889 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ac818-2293-4c1f-8477-02b6f680537a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:48.342169 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ac818-2293-4c1f-8477-02b6f680537a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:48.349113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ac818-2293-4c1f-8477-02b6f680537a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:48.350579 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ac818-2293-4c1f-8477-02b6f680537a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:48.362257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-877ac818-2293-4c1f-8477-02b6f680537a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:48.362257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:48.362257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:48.362257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:48.362257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:48.362257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:48.362257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:48.362257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:48.362257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:48.362257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:48.362257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:48.362257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:48.362257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:48.362257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:48.362257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:48.363144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:48.364458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:48.364458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:48.364458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:48.364458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:48.364458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:48.364458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:48.364458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:48.364458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:48.364458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 431/868] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:48.369584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033a04e-1f41-4de3-914a-f6feb48427b3 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:48.475784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033a04e-1f41-4de3-914a-f6feb48427b3 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:48.512078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db598ccb-9d00-421b-8c6a-32571c2634c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:48.512713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db598ccb-9d00-421b-8c6a-32571c2634c2 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:48.512995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db598ccb-9d00-421b-8c6a-32571c2634c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:48.513271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db598ccb-9d00-421b-8c6a-32571c2634c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:48.514061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db598ccb-9d00-421b-8c6a-32571c2634c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:48.514372 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db598ccb-9d00-421b-8c6a-32571c2634c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:48.515853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db598ccb-9d00-421b-8c6a-32571c2634c2 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:48.529552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 438/869] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:48.535598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ac818-2293-4c1f-8477-02b6f680537a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:48.639574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add84e2-4e7c-4205-9b36-55408f03a426 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:48.639574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add84e2-4e7c-4205-9b36-55408f03a426 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:48.640041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add84e2-4e7c-4205-9b36-55408f03a426 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:48.641526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 439/870] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:48.646937 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffff25-f682-4209-a9f8-8d8a86732d95 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:48.647478 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffff25-f682-4209-a9f8-8d8a86732d95 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:48.647958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffff25-f682-4209-a9f8-8d8a86732d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:48.650496 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ac818-2293-4c1f-8477-02b6f680537a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:48.665796 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:48.672870 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-37ffff25-f682-4209-a9f8-8d8a86732d95 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:48.674546 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-37ffff25-f682-4209-a9f8-8d8a86732d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:48.690048 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d3740-1b92-4a77-82c8-59f44799ee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:48.690680 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d3740-1b92-4a77-82c8-59f44799ee0f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:48.690993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d3740-1b92-4a77-82c8-59f44799ee0f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:48.691721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d3740-1b92-4a77-82c8-59f44799ee0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:48.692553 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d3740-1b92-4a77-82c8-59f44799ee0f None admin] RBAC: Adding query filter params (role.id=04fcac2c505f40a89923fa2f26cf548c, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=2d45700d35664abaae5eb8b42e2e05fb) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:48.692905 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d3740-1b92-4a77-82c8-59f44799ee0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:48.695070 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d3740-1b92-4a77-82c8-59f44799ee0f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:48.699353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:48.705628 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 432/871] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:48 2022] GET /identity/v3/role_assignments?user.id=2d45700d35664abaae5eb8b42e2e05fb&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=04fcac2c505f40a89923fa2f26cf548c => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:48.761189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 440/872] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:13:48.765446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925df51-1d9a-4999-a40f-85d29658107e None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:48.766031 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925df51-1d9a-4999-a40f-85d29658107e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:48.766516 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925df51-1d9a-4999-a40f-85d29658107e None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:48.768533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 433/873] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:13:48.774567 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06920a9b-43ac-41a0-a0fe-a1ce9754691e None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:48.774874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06920a9b-43ac-41a0-a0fe-a1ce9754691e None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:48.775127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06920a9b-43ac-41a0-a0fe-a1ce9754691e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:48.785746 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925df51-1d9a-4999-a40f-85d29658107e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:48.795750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-06920a9b-43ac-41a0-a0fe-a1ce9754691e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:48.797003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-06920a9b-43ac-41a0-a0fe-a1ce9754691e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:48.881633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 441/874] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:13:48.904005 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06920a9b-43ac-41a0-a0fe-a1ce9754691e None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:48.930683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925df51-1d9a-4999-a40f-85d29658107e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:48.975026 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9b046-3eed-4588-9b47-dbc1df7d01c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:48.975673 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9b046-3eed-4588-9b47-dbc1df7d01c5 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:48.975958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9b046-3eed-4588-9b47-dbc1df7d01c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:48.976306 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9b046-3eed-4588-9b47-dbc1df7d01c5 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:48.977376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9b046-3eed-4588-9b47-dbc1df7d01c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:48.978789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9b046-3eed-4588-9b47-dbc1df7d01c5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:49.008994 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:49.024984 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06920a9b-43ac-41a0-a0fe-a1ce9754691e None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:49.057710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 434/875] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jul 28 05:13:48 2022] POST /identity/v3/services => generated 251 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:13:49.081606 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e9fa8-47ac-4ddd-88a0-f48b127af432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:49.082569 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e9fa8-47ac-4ddd-88a0-f48b127af432 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:49.083087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e9fa8-47ac-4ddd-88a0-f48b127af432 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:49.084130 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e9fa8-47ac-4ddd-88a0-f48b127af432 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:49.084996 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e9fa8-47ac-4ddd-88a0-f48b127af432 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:49.086756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e9fa8-47ac-4ddd-88a0-f48b127af432 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-2f5e9fa8-47ac-4ddd-88a0-f48b127af432 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:49.098028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:49.099436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:49.099436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:49.099436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:49.099436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:49.099436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:49.099436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:49.099436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:13:49.099436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:13:49.099436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:13:49.099436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:13:49.099436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:49.099436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:49.099436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:49.099436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:49.099436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:49.099436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:49.100557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:49.100557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:49.100557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:49.100557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:49.100557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:49.100557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:49.100557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:49.100557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:49.100557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:49.100557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:49.100557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:13:49.100557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:49.100557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:13:49.100557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:49.103291 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 442/876] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jul 28 05:13:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:49.109051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9b046-3eed-4588-9b47-dbc1df7d01c5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:49.151495 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:49.227194 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9b046-3eed-4588-9b47-dbc1df7d01c5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:49.265684 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775265fa-7b42-4b1c-95f6-74e369b62dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:49.265684 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775265fa-7b42-4b1c-95f6-74e369b62dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:49.265684 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775265fa-7b42-4b1c-95f6-74e369b62dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:49.265972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775265fa-7b42-4b1c-95f6-74e369b62dc5 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:49.266648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775265fa-7b42-4b1c-95f6-74e369b62dc5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:49.267000 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775265fa-7b42-4b1c-95f6-74e369b62dc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:49.268358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775265fa-7b42-4b1c-95f6-74e369b62dc5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:49.275402 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 435/877] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jul 28 05:13:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:49.280524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e9fa8-47ac-4ddd-88a0-f48b127af432 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:49.394366 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e9fa8-47ac-4ddd-88a0-f48b127af432 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:49.433438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df06cc-1e2f-46da-9b2f-dc92a6302fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:49.434098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df06cc-1e2f-46da-9b2f-dc92a6302fac None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:49.434379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df06cc-1e2f-46da-9b2f-dc92a6302fac None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:49.434658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df06cc-1e2f-46da-9b2f-dc92a6302fac None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:49.435344 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df06cc-1e2f-46da-9b2f-dc92a6302fac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:49.435654 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df06cc-1e2f-46da-9b2f-dc92a6302fac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:49.437017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df06cc-1e2f-46da-9b2f-dc92a6302fac None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:49.442665 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 443/878] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jul 28 05:13:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:49.481348 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edda91-6d70-4545-bf36-66c5e50bf0a2 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:49.481700 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edda91-6d70-4545-bf36-66c5e50bf0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:49.481950 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edda91-6d70-4545-bf36-66c5e50bf0a2 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:49.483580 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 436/879] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:49.489109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95c8d1-78a6-4a86-a46a-51b1eaf988bb None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:49.490042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95c8d1-78a6-4a86-a46a-51b1eaf988bb None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:49.490420 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95c8d1-78a6-4a86-a46a-51b1eaf988bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:49.512070 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-0f95c8d1-78a6-4a86-a46a-51b1eaf988bb None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:49.513317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-0f95c8d1-78a6-4a86-a46a-51b1eaf988bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:49.517668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:49.593225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 444/880] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:13:49.616189 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edda91-6d70-4545-bf36-66c5e50bf0a2 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:49.721703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:49.726553 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edda91-6d70-4545-bf36-66c5e50bf0a2 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:49.762780 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0025159-10da-444a-9078-6e03ff553663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:49.763412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0025159-10da-444a-9078-6e03ff553663 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:49.763695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0025159-10da-444a-9078-6e03ff553663 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:49.763973 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0025159-10da-444a-9078-6e03ff553663 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:49.764673 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0025159-10da-444a-9078-6e03ff553663 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:49.766085 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0025159-10da-444a-9078-6e03ff553663 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:49.850620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 437/881] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jul 28 05:13:49 2022] POST /identity/v3/services => generated 269 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:13:50.875397 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9113d30-d51d-452a-8e78-0f17943d346f None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:50.875912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9113d30-d51d-452a-8e78-0f17943d346f None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:50.875992 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9113d30-d51d-452a-8e78-0f17943d346f None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:50.877682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 445/882] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:50.882834 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87138198-70bc-4e91-a716-be5e5196eedd None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:50.883270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87138198-70bc-4e91-a716-be5e5196eedd None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:50.883417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87138198-70bc-4e91-a716-be5e5196eedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:50.901933 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-87138198-70bc-4e91-a716-be5e5196eedd None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:50.903110 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-87138198-70bc-4e91-a716-be5e5196eedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:50.978578 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 438/883] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:13:51.001510 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9113d30-d51d-452a-8e78-0f17943d346f None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:51.105512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9113d30-d51d-452a-8e78-0f17943d346f None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:51.140605 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07037d6d-d77e-4762-bc92-d60ab4127472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:51.141167 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07037d6d-d77e-4762-bc92-d60ab4127472 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:51.141444 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07037d6d-d77e-4762-bc92-d60ab4127472 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:51.141743 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07037d6d-d77e-4762-bc92-d60ab4127472 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:51.149905 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:51.154438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07037d6d-d77e-4762-bc92-d60ab4127472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:51.159563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-07037d6d-d77e-4762-bc92-d60ab4127472 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:13:51.159563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:51.159563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:51.159563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:51.159563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:51.159563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:51.159563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:51.159563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:51.159563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:51.159563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:51.159563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:51.159563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:51.159563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:51.159563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:51.159563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:51.159563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:51.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:51.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:51.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:51.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:51.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:51.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:51.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:51.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:51.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:51.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:51.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:51.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:51.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:51.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:51.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:51.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:51.161839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:51.161839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:51.161839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:51.161839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:51.161839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:51.161839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:51.161839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:51.161839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:51.161839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:51.161839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:51.161839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:13:51.161839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:51.164018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 446/884] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jul 28 05:13:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:51.170562 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87138198-70bc-4e91-a716-be5e5196eedd None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:51.259864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:51.275331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87138198-70bc-4e91-a716-be5e5196eedd None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:51.301696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015761b-a814-49c7-b4cb-eab215486861 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:51.302154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015761b-a814-49c7-b4cb-eab215486861 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:51.302460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015761b-a814-49c7-b4cb-eab215486861 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:51.305051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 447/885] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:13:51.308904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a79981-2166-4734-8b16-d40234445dfd None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:51.309192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a79981-2166-4734-8b16-d40234445dfd None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:51.309491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a79981-2166-4734-8b16-d40234445dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:51.310078 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50850d62-731b-4709-a630-722cfe7d8574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:51.310736 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50850d62-731b-4709-a630-722cfe7d8574 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:51.310995 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50850d62-731b-4709-a630-722cfe7d8574 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:51.311274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50850d62-731b-4709-a630-722cfe7d8574 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:51.311997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50850d62-731b-4709-a630-722cfe7d8574 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:51.312310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50850d62-731b-4709-a630-722cfe7d8574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:51.314162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50850d62-731b-4709-a630-722cfe7d8574 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:51.323556 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 439/886] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jul 28 05:13:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:51.329031 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-f9a79981-2166-4734-8b16-d40234445dfd None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:51.330520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50850d62-731b-4709-a630-722cfe7d8574 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:51.330640 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f9a79981-2166-4734-8b16-d40234445dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:51.415951 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 448/887] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:13:51.438675 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a79981-2166-4734-8b16-d40234445dfd None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:51.449553 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50850d62-731b-4709-a630-722cfe7d8574 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:51.485800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d44e9-164a-4ae6-a814-6cc913a87d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:51.486830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d44e9-164a-4ae6-a814-6cc913a87d10 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:51.487252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d44e9-164a-4ae6-a814-6cc913a87d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:51.487674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d44e9-164a-4ae6-a814-6cc913a87d10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:51.499734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d44e9-164a-4ae6-a814-6cc913a87d10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:51.501520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d44e9-164a-4ae6-a814-6cc913a87d10 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:51.511674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:51.519688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-5a3d44e9-164a-4ae6-a814-6cc913a87d10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:51.519688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:51.519688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:51.519688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:51.519688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:51.519688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:51.519688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:51.519688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:51.519688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:51.519688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:51.519688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:51.519688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:51.519688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:51.519688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:51.519688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:51.527118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:51.528010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:51.528010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:51.528010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:51.528010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:51.528010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 440/888] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:51.528010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2dc5c-89d9-45d1-a0ed-2bd7fee5e38f None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:51.528010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2dc5c-89d9-45d1-a0ed-2bd7fee5e38f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:51.528010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2dc5c-89d9-45d1-a0ed-2bd7fee5e38f None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:51.528010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 441/889] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:51.528516 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2dc5c-89d9-45d1-a0ed-2bd7fee5e38f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:51.551050 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a79981-2166-4734-8b16-d40234445dfd None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:51.580808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:51.588320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02f529-d5d4-4c6e-8861-af42cd722d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:51.589014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02f529-d5d4-4c6e-8861-af42cd722d87 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:51.589300 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02f529-d5d4-4c6e-8861-af42cd722d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:51.598270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02f529-d5d4-4c6e-8861-af42cd722d87 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:51.598270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02f529-d5d4-4c6e-8861-af42cd722d87 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:51.598270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02f529-d5d4-4c6e-8861-af42cd722d87 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-aa02f529-d5d4-4c6e-8861-af42cd722d87 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:51.600714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:51.602012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:51.602012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:51.602012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:51.602012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:51.602012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:51.602012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:51.602012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:13:51.602012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:13:51.602012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:13:51.602012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:13:51.602012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:51.602012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:51.602012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:51.602012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:51.602012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:51.602012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:51.602997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:51.602997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:51.602997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:51.602997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:51.602997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:51.602997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:51.602997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:51.602997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:51.602997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:51.602997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:51.602997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:13:51.602997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:51.602997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:13:51.602997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:51.602997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 449/890] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:13:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:51.603941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10a83b-2155-48d9-87bd-fd245762c7f2 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:51.604217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10a83b-2155-48d9-87bd-fd245762c7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:51.604464 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10a83b-2155-48d9-87bd-fd245762c7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:51.625689 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-ad10a83b-2155-48d9-87bd-fd245762c7f2 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:51.626893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ad10a83b-2155-48d9-87bd-fd245762c7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:51.641693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2dc5c-89d9-45d1-a0ed-2bd7fee5e38f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:51.679166 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf7dde-c232-4d34-b509-2311810e5d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:51.679731 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf7dde-c232-4d34-b509-2311810e5d7e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:51.679998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf7dde-c232-4d34-b509-2311810e5d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:51.680270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf7dde-c232-4d34-b509-2311810e5d7e None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:51.680956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf7dde-c232-4d34-b509-2311810e5d7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:51.681263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf7dde-c232-4d34-b509-2311810e5d7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:51.682648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf7dde-c232-4d34-b509-2311810e5d7e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:51.696228 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 442/891] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:51.697228 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf7dde-c232-4d34-b509-2311810e5d7e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:51.709971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 450/892] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:13:51.709971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10a83b-2155-48d9-87bd-fd245762c7f2 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:51.763274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:51.808035 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf7dde-c232-4d34-b509-2311810e5d7e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:51.811104 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10a83b-2155-48d9-87bd-fd245762c7f2 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:51.836139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:51.844915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef75b8a-8563-435d-ae4f-37c261db34b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:51.845569 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef75b8a-8563-435d-ae4f-37c261db34b5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:51.848701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef75b8a-8563-435d-ae4f-37c261db34b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:51.848701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef75b8a-8563-435d-ae4f-37c261db34b5 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:51.848701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef75b8a-8563-435d-ae4f-37c261db34b5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:51.848701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef75b8a-8563-435d-ae4f-37c261db34b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:51.849560 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26d01e-fa85-4ea4-b4e2-db74fc4c33a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:51.849560 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26d01e-fa85-4ea4-b4e2-db74fc4c33a9 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:51.849560 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26d01e-fa85-4ea4-b4e2-db74fc4c33a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:51.849782 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef75b8a-8563-435d-ae4f-37c261db34b5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:51.849852 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26d01e-fa85-4ea4-b4e2-db74fc4c33a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:51.858993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 443/893] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:13:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:51.858993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef75b8a-8563-435d-ae4f-37c261db34b5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:51.860402 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26d01e-fa85-4ea4-b4e2-db74fc4c33a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:51.861917 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26d01e-fa85-4ea4-b4e2-db74fc4c33a9 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:51.874400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-1e26d01e-fa85-4ea4-b4e2-db74fc4c33a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:13:51.874400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:51.874400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:51.874400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:51.874400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:51.874400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:51.874400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:51.874400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:51.874400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:51.874400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:51.874400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:51.874400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:51.874400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:51.874400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:51.874400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:51.874400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:51.875363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:51.876746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:51.876746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:51.876746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:51.876746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:51.876746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:51.876746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:51.876746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:51.876746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:51.876746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:13:51.876746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:51.876746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 451/894] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jul 28 05:13:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:51.876746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26d01e-fa85-4ea4-b4e2-db74fc4c33a9 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:51.972241 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef75b8a-8563-435d-ae4f-37c261db34b5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:51.983755 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26d01e-fa85-4ea4-b4e2-db74fc4c33a9 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:51.995767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:52.006849 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95854a1f-dcc1-468b-b8c7-fb84478262af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:52.007476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95854a1f-dcc1-468b-b8c7-fb84478262af None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:52.007760 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95854a1f-dcc1-468b-b8c7-fb84478262af None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:52.008041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95854a1f-dcc1-468b-b8c7-fb84478262af None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:52.008735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95854a1f-dcc1-468b-b8c7-fb84478262af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:52.010137 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95854a1f-dcc1-468b-b8c7-fb84478262af None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:52.017425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fe510-d3c4-4c62-b564-369f234ef119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:52.018139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fe510-d3c4-4c62-b564-369f234ef119 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:52.018421 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fe510-d3c4-4c62-b564-369f234ef119 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:52.018696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fe510-d3c4-4c62-b564-369f234ef119 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:52.019361 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fe510-d3c4-4c62-b564-369f234ef119 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:52.019663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fe510-d3c4-4c62-b564-369f234ef119 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:52.021824 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fe510-d3c4-4c62-b564-369f234ef119 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:52.026634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 452/895] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:13:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:52.027403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fe510-d3c4-4c62-b564-369f234ef119 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:52.065716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 444/896] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jul 28 05:13:51 2022] POST /identity/v3/services => generated 241 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:13:52.066970 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a0981-19ef-44d6-a33d-8b00123c3b2e None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:52.067253 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a0981-19ef-44d6-a33d-8b00123c3b2e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:52.068093 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a0981-19ef-44d6-a33d-8b00123c3b2e None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:52.073537 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 445/897] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:52.073537 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a0981-19ef-44d6-a33d-8b00123c3b2e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:52.082509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:52.167433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fe510-d3c4-4c62-b564-369f234ef119 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:52.219321 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a0981-19ef-44d6-a33d-8b00123c3b2e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:52.219524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c3ac6-407c-4ee3-bc90-469889643196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:52.220319 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c3ac6-407c-4ee3-bc90-469889643196 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:52.220614 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c3ac6-407c-4ee3-bc90-469889643196 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:52.220890 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c3ac6-407c-4ee3-bc90-469889643196 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:52.221731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c3ac6-407c-4ee3-bc90-469889643196 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:52.222044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c3ac6-407c-4ee3-bc90-469889643196 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:52.223583 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c3ac6-407c-4ee3-bc90-469889643196 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:52.242760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 453/898] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jul 28 05:13:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:52.244041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e74f2-9eec-4d37-9038-bc68889c5217 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:52.244217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e74f2-9eec-4d37-9038-bc68889c5217 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:52.244956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e74f2-9eec-4d37-9038-bc68889c5217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:52.265298 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-6f2e74f2-9eec-4d37-9038-bc68889c5217 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:52.265610 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6f2e74f2-9eec-4d37-9038-bc68889c5217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:52.268845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f7b1b-1e85-4a52-88a9-d1cb64bd91a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:52.269558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f7b1b-1e85-4a52-88a9-d1cb64bd91a1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:52.269813 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f7b1b-1e85-4a52-88a9-d1cb64bd91a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:52.270088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f7b1b-1e85-4a52-88a9-d1cb64bd91a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:52.271516 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f7b1b-1e85-4a52-88a9-d1cb64bd91a1 None admin] RBAC: Adding query filter params (interface=public, service_id=6e4869d35f054ce48fbbb96f06082a8d, region_id=RegionOne) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:52.271831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f7b1b-1e85-4a52-88a9-d1cb64bd91a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:52.273202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f7b1b-1e85-4a52-88a9-d1cb64bd91a1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:52.285515 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 446/899] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jul 28 05:13:52 2022] GET /identity/v3/endpoints?service_id=6e4869d35f054ce48fbbb96f06082a8d&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:52.285515 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f7b1b-1e85-4a52-88a9-d1cb64bd91a1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:52.340520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 454/900] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:13:52.341686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e74f2-9eec-4d37-9038-bc68889c5217 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:52.346968 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:52.382499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:52.402435 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f7b1b-1e85-4a52-88a9-d1cb64bd91a1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:52.438712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f158431-d782-4dff-b232-2fb12d9272c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:52.439449 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f158431-d782-4dff-b232-2fb12d9272c2 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:52.439729 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f158431-d782-4dff-b232-2fb12d9272c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:52.440003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f158431-d782-4dff-b232-2fb12d9272c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:52.453774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e74f2-9eec-4d37-9038-bc68889c5217 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:52.489175 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4585f-8038-411f-afc8-cdcff8b74cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:52.490402 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4585f-8038-411f-afc8-cdcff8b74cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:52.490686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4585f-8038-411f-afc8-cdcff8b74cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:52.490957 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4585f-8038-411f-afc8-cdcff8b74cb1 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:52.491607 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4585f-8038-411f-afc8-cdcff8b74cb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:52.492972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4585f-8038-411f-afc8-cdcff8b74cb1 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:52.498904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 455/901] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jul 28 05:13:52 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:13:52.499748 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4585f-8038-411f-afc8-cdcff8b74cb1 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:52.523437 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f158431-d782-4dff-b232-2fb12d9272c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:52.525346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f158431-d782-4dff-b232-2fb12d9272c2 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:52.586079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:52.631629 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:52.638687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4585f-8038-411f-afc8-cdcff8b74cb1 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:52.661882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 447/902] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:13:52 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:13:52.664889 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f158431-d782-4dff-b232-2fb12d9272c2 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:52.682148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d30b4f-5cba-4f78-a909-e2ca524ce10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:52.683183 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d30b4f-5cba-4f78-a909-e2ca524ce10b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:52.683782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d30b4f-5cba-4f78-a909-e2ca524ce10b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:52.684071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d30b4f-5cba-4f78-a909-e2ca524ce10b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:52.684704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d30b4f-5cba-4f78-a909-e2ca524ce10b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:52.686122 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d30b4f-5cba-4f78-a909-e2ca524ce10b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:52.698722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-e7d30b4f-5cba-4f78-a909-e2ca524ce10b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:13:52.698722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:52.698722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:13:52.698722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:13:52.698722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:13:52.698722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:13:52.698722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:13:52.698722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:52.698722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:13:52.698722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:52.698722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:52.698722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:52.698722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:52.698722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:52.698722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:52.698722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:52.699749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:52.699749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:52.699749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:52.699749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:52.699749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:52.699749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:52.699749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:52.699749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:13:52.699749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:13:52.699749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:13:52.699749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:13:52.699749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:52.699749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:52.699749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:52.699749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:52.699749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:52.700720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:52.700720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:52.700720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:52.700720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:52.700720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:52.700720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:52.700720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:52.700720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:52.700720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:52.700720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:52.700720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:52.700720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:13:52.700720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:52.700720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:13:52.700720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:52.704817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 456/903] 10.222.0.33 () {56 vars in 1132 bytes} [Thu Jul 28 05:13:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:52.706092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d30b4f-5cba-4f78-a909-e2ca524ce10b None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:52.785355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f158431-d782-4dff-b232-2fb12d9272c2 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:52.823898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacd4d9-cb0f-495b-b5cb-93aa8bfceb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:52.824758 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacd4d9-cb0f-495b-b5cb-93aa8bfceb4d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:52.825181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacd4d9-cb0f-495b-b5cb-93aa8bfceb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:52.825584 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacd4d9-cb0f-495b-b5cb-93aa8bfceb4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:52.840235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacd4d9-cb0f-495b-b5cb-93aa8bfceb4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:52.842302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacd4d9-cb0f-495b-b5cb-93aa8bfceb4d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:52.847211 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d30b4f-5cba-4f78-a909-e2ca524ce10b None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:52.855378 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:52.863622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-bbacd4d9-cb0f-495b-b5cb-93aa8bfceb4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:52.863622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:52.863622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:52.863622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:52.863622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:52.863622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:52.863622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:52.863622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:52.863622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:52.863622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:52.863622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:52.863622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:52.863622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:52.863622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:52.863622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:52.864648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:52.870488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:52.870488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:52.870488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:52.870488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:52.870488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 448/904] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:52.870881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacd4d9-cb0f-495b-b5cb-93aa8bfceb4d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:52.898667 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe80d5e-0899-4354-ac43-41f473fee784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:52.900419 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe80d5e-0899-4354-ac43-41f473fee784 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:52.901161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe80d5e-0899-4354-ac43-41f473fee784 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:52.901739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe80d5e-0899-4354-ac43-41f473fee784 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:52.902843 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe80d5e-0899-4354-ac43-41f473fee784 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:52.903715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe80d5e-0899-4354-ac43-41f473fee784 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:52.905843 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe80d5e-0899-4354-ac43-41f473fee784 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:52.918633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 457/905] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jul 28 05:13:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:52.920408 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe80d5e-0899-4354-ac43-41f473fee784 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:52.955349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:52.995572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacd4d9-cb0f-495b-b5cb-93aa8bfceb4d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:53.039748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c8b93-acd2-4460-a5b4-8230ad610161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:53.040790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c8b93-acd2-4460-a5b4-8230ad610161 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:53.041213 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c8b93-acd2-4460-a5b4-8230ad610161 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:53.041521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c8b93-acd2-4460-a5b4-8230ad610161 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:53.042218 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c8b93-acd2-4460-a5b4-8230ad610161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:53.042562 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c8b93-acd2-4460-a5b4-8230ad610161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:53.044045 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c8b93-acd2-4460-a5b4-8230ad610161 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:53.051877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe80d5e-0899-4354-ac43-41f473fee784 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:53.057849 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 449/906] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:53.064507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c8b93-acd2-4460-a5b4-8230ad610161 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:53.100778 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc85e6-bad8-4ac0-8921-025fad82c44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:53.101436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc85e6-bad8-4ac0-8921-025fad82c44a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:53.101757 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc85e6-bad8-4ac0-8921-025fad82c44a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:53.102032 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc85e6-bad8-4ac0-8921-025fad82c44a None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:53.102956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc85e6-bad8-4ac0-8921-025fad82c44a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:53.103260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc85e6-bad8-4ac0-8921-025fad82c44a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:53.105329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc85e6-bad8-4ac0-8921-025fad82c44a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:53.118364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 458/907] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jul 28 05:13:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:53.120170 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc85e6-bad8-4ac0-8921-025fad82c44a None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:53.151068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:53.203475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c8b93-acd2-4460-a5b4-8230ad610161 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:53.247329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:53.248737 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289444d7-cb19-4be3-8040-4a699ed69e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:53.249684 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289444d7-cb19-4be3-8040-4a699ed69e63 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:53.249981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289444d7-cb19-4be3-8040-4a699ed69e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:53.250260 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289444d7-cb19-4be3-8040-4a699ed69e63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:53.261751 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289444d7-cb19-4be3-8040-4a699ed69e63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:53.261751 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289444d7-cb19-4be3-8040-4a699ed69e63 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:53.264397 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc85e6-bad8-4ac0-8921-025fad82c44a None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:53.276787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-289444d7-cb19-4be3-8040-4a699ed69e63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:53.276787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:53.276787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:53.276787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:53.276787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:53.276787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:53.276787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:53.276787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:53.276787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:53.276787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:53.276787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:53.276787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:53.276787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:53.276787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:53.276787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:53.277979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:53.278850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:53.278850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:53.278850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:53.278850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:53.278850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:53.278850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:53.278850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:53.278850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:53.278850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 450/908] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:53.285119 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289444d7-cb19-4be3-8040-4a699ed69e63 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:53.315110 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27eb55-87d2-4cee-ba22-5b48b7f09468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:53.315644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27eb55-87d2-4cee-ba22-5b48b7f09468 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:53.315929 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27eb55-87d2-4cee-ba22-5b48b7f09468 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:53.316206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27eb55-87d2-4cee-ba22-5b48b7f09468 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:53.317410 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27eb55-87d2-4cee-ba22-5b48b7f09468 None admin] RBAC: Adding query filter params (interface=public, service_id=3327c7d138d2437c9becf4582b5aa0ae, region_id=RegionOne) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:53.318896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27eb55-87d2-4cee-ba22-5b48b7f09468 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:53.320646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27eb55-87d2-4cee-ba22-5b48b7f09468 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:53.332170 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 459/909] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jul 28 05:13:53 2022] GET /identity/v3/endpoints?service_id=3327c7d138d2437c9becf4582b5aa0ae&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:53.333425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27eb55-87d2-4cee-ba22-5b48b7f09468 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:53.403125 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289444d7-cb19-4be3-8040-4a699ed69e63 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:53.424317 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:53.440608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac83f9-7350-4e2e-8c01-9e2a60815e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:53.441651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac83f9-7350-4e2e-8c01-9e2a60815e85 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:53.442135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac83f9-7350-4e2e-8c01-9e2a60815e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:53.443231 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac83f9-7350-4e2e-8c01-9e2a60815e85 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:53.443354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27eb55-87d2-4cee-ba22-5b48b7f09468 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:53.444405 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac83f9-7350-4e2e-8c01-9e2a60815e85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:53.445008 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac83f9-7350-4e2e-8c01-9e2a60815e85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:53.446726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac83f9-7350-4e2e-8c01-9e2a60815e85 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:53.465959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 451/910] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:53.467167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac83f9-7350-4e2e-8c01-9e2a60815e85 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:53.479269 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed004353-cddf-4031-9fa3-deb2c88e92cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:53.479895 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004353-cddf-4031-9fa3-deb2c88e92cb None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:53.480391 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004353-cddf-4031-9fa3-deb2c88e92cb None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:53.480527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004353-cddf-4031-9fa3-deb2c88e92cb None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:53.481069 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed004353-cddf-4031-9fa3-deb2c88e92cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:53.482580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed004353-cddf-4031-9fa3-deb2c88e92cb None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:53.493677 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 460/911] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jul 28 05:13:53 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:13:53.586052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac83f9-7350-4e2e-8c01-9e2a60815e85 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:53.625888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f86222-e11c-4d54-b52c-d27c9e867d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:53.626920 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f86222-e11c-4d54-b52c-d27c9e867d55 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:53.627397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f86222-e11c-4d54-b52c-d27c9e867d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:53.627865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f86222-e11c-4d54-b52c-d27c9e867d55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:53.628881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f86222-e11c-4d54-b52c-d27c9e867d55 None admin] RBAC: Adding query filter params (role.id=e45edf32cb2c4b328908432d6c62fd36, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=2d45700d35664abaae5eb8b42e2e05fb) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:53.629391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f86222-e11c-4d54-b52c-d27c9e867d55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:53.631125 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f86222-e11c-4d54-b52c-d27c9e867d55 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:53.638249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 452/912] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:13:53 2022] GET /identity/v3/role_assignments?user.id=2d45700d35664abaae5eb8b42e2e05fb&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=e45edf32cb2c4b328908432d6c62fd36 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:54.165030 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb32b88-f01b-4239-8925-0c7093f132aa None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:54.165572 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb32b88-f01b-4239-8925-0c7093f132aa None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:54.165572 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb32b88-f01b-4239-8925-0c7093f132aa None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:54.167138 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 461/913] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:54.172538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5acb1-e304-4ef4-9e82-59cb7cbc68b2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:54.172945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5acb1-e304-4ef4-9e82-59cb7cbc68b2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:54.173148 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5acb1-e304-4ef4-9e82-59cb7cbc68b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:54.194703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1cd5acb1-e304-4ef4-9e82-59cb7cbc68b2 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:54.195948 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1cd5acb1-e304-4ef4-9e82-59cb7cbc68b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:54.239881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:54.274563 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 453/914] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:13:54.296537 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb32b88-f01b-4239-8925-0c7093f132aa None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:54.315857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:54.408624 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb32b88-f01b-4239-8925-0c7093f132aa None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:54.444230 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95424c-eb6d-49ae-80d5-2a625def3929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:54.444800 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95424c-eb6d-49ae-80d5-2a625def3929 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:54.445075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95424c-eb6d-49ae-80d5-2a625def3929 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:54.445345 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95424c-eb6d-49ae-80d5-2a625def3929 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:54.445998 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95424c-eb6d-49ae-80d5-2a625def3929 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:54.447356 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95424c-eb6d-49ae-80d5-2a625def3929 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-6c95424c-eb6d-49ae-80d5-2a625def3929 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:54.456197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:54.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:54.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:54.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:54.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:54.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:54.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:54.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:13:54.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:13:54.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:13:54.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:13:54.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:54.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:54.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:54.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:54.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:54.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:54.458580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:54.458580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:54.458580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:54.458580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:54.458580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:54.458580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:54.458580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:54.458580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:54.458580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:54.458580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:54.458580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:13:54.458580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:54.458580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:13:54.458580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:54.458580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 462/915] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jul 28 05:13:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:54.464483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5acb1-e304-4ef4-9e82-59cb7cbc68b2 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:54.569660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5acb1-e304-4ef4-9e82-59cb7cbc68b2 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:54.606367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0456a-8665-4f8f-82c2-3081a909b31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:54.609572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0456a-8665-4f8f-82c2-3081a909b31f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:54.610091 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0456a-8665-4f8f-82c2-3081a909b31f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:54.610560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0456a-8665-4f8f-82c2-3081a909b31f None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:54.611432 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0456a-8665-4f8f-82c2-3081a909b31f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:54.611930 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0456a-8665-4f8f-82c2-3081a909b31f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:54.613512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0456a-8665-4f8f-82c2-3081a909b31f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:54.619213 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 454/916] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jul 28 05:13:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:54.625512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2e214-0e67-4f30-8d99-dfc1d958ffad None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:54.625512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2e214-0e67-4f30-8d99-dfc1d958ffad None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:54.625512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2e214-0e67-4f30-8d99-dfc1d958ffad None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:54.625512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 463/917] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:54.626471 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0456a-8665-4f8f-82c2-3081a909b31f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:54.630038 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a014230-6e9b-4180-b77c-45d889ff5755 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:54.630483 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a014230-6e9b-4180-b77c-45d889ff5755 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:54.630770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a014230-6e9b-4180-b77c-45d889ff5755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:54.649264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-7a014230-6e9b-4180-b77c-45d889ff5755 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:54.650517 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7a014230-6e9b-4180-b77c-45d889ff5755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:54.669879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:54.737842 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 464/918] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:13:54.747308 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0456a-8665-4f8f-82c2-3081a909b31f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:54.758247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a014230-6e9b-4180-b77c-45d889ff5755 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:54.771645 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:54.792353 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f18a0-0cdd-4214-bbda-018780d61117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:54.793560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f18a0-0cdd-4214-bbda-018780d61117 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:54.794431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f18a0-0cdd-4214-bbda-018780d61117 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:54.795180 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f18a0-0cdd-4214-bbda-018780d61117 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:54.796084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f18a0-0cdd-4214-bbda-018780d61117 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:54.796605 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f18a0-0cdd-4214-bbda-018780d61117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:54.799322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f18a0-0cdd-4214-bbda-018780d61117 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:54.806802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 455/919] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jul 28 05:13:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:54.813416 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f18a0-0cdd-4214-bbda-018780d61117 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:54.881884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a014230-6e9b-4180-b77c-45d889ff5755 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:54.921254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f133f-2ae5-4fa1-945d-5e044b6dca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:54.922296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f133f-2ae5-4fa1-945d-5e044b6dca79 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:54.922729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f133f-2ae5-4fa1-945d-5e044b6dca79 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:54.923140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f133f-2ae5-4fa1-945d-5e044b6dca79 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:54.923939 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f133f-2ae5-4fa1-945d-5e044b6dca79 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:54.925457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f133f-2ae5-4fa1-945d-5e044b6dca79 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-a27f133f-2ae5-4fa1-945d-5e044b6dca79 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:54.935731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:54.936871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:54.936871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:54.936871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:54.936871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:54.936871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:54.936871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:54.936871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:13:54.936871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:13:54.936871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:13:54.936871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:13:54.936871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:54.936871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:54.936871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:54.936871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:54.936871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:54.936871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:54.937744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:54.937744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:54.937744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:54.937744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:54.937744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:54.937744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:54.937744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:54.937744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:54.937744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:54.937744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:54.937744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:13:54.937744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:54.937744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:13:54.937744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:54.940389 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 465/920] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:13:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:54.947276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f133f-2ae5-4fa1-945d-5e044b6dca79 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:54.954952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f18a0-0cdd-4214-bbda-018780d61117 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:54.956657 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:55.002231 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804aaa9e-b870-4646-8871-d15857725e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:55.003614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aaa9e-b870-4646-8871-d15857725e62 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:55.004372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aaa9e-b870-4646-8871-d15857725e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:55.005457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aaa9e-b870-4646-8871-d15857725e62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:55.006759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804aaa9e-b870-4646-8871-d15857725e62 None admin] RBAC: Adding query filter params (interface=public, service_id=700a5371b3ea4488be55d532595a7783, region_id=RegionOne) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:55.007766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804aaa9e-b870-4646-8871-d15857725e62 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:55.009861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804aaa9e-b870-4646-8871-d15857725e62 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:55.017324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 456/921] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jul 28 05:13:54 2022] GET /identity/v3/endpoints?service_id=700a5371b3ea4488be55d532595a7783&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:55.023444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804aaa9e-b870-4646-8871-d15857725e62 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:55.048763 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:55.085857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f133f-2ae5-4fa1-945d-5e044b6dca79 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:55.124519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5dfa3-3cd3-40d1-9669-4cc4e53e0f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:55.125499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5dfa3-3cd3-40d1-9669-4cc4e53e0f68 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:55.125966 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5dfa3-3cd3-40d1-9669-4cc4e53e0f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:55.126516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5dfa3-3cd3-40d1-9669-4cc4e53e0f68 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:55.127484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5dfa3-3cd3-40d1-9669-4cc4e53e0f68 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:55.127973 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5dfa3-3cd3-40d1-9669-4cc4e53e0f68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:55.129561 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5dfa3-3cd3-40d1-9669-4cc4e53e0f68 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:55.133815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804aaa9e-b870-4646-8871-d15857725e62 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:55.140417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 466/922] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:13:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:55.141621 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5dfa3-3cd3-40d1-9669-4cc4e53e0f68 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:55.172551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b1d78-b3c1-4f57-9cd0-6833fcc538b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:55.173252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b1d78-b3c1-4f57-9cd0-6833fcc538b5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:55.173531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b1d78-b3c1-4f57-9cd0-6833fcc538b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:55.173816 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b1d78-b3c1-4f57-9cd0-6833fcc538b5 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:55.174619 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b1d78-b3c1-4f57-9cd0-6833fcc538b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:55.175944 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b1d78-b3c1-4f57-9cd0-6833fcc538b5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:55.189607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 457/923] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jul 28 05:13:55 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:13:55.260544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5dfa3-3cd3-40d1-9669-4cc4e53e0f68 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:55.300208 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ceb13-fb05-4050-9919-efa053488a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:55.300851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ceb13-fb05-4050-9919-efa053488a91 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:55.301133 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ceb13-fb05-4050-9919-efa053488a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:55.301410 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ceb13-fb05-4050-9919-efa053488a91 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:55.302757 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ceb13-fb05-4050-9919-efa053488a91 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:55.303073 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ceb13-fb05-4050-9919-efa053488a91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:55.304494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ceb13-fb05-4050-9919-efa053488a91 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:55.310380 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 467/924] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jul 28 05:13:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:55.316475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b1d78-b3c1-4f57-9cd0-6833fcc538b5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:55.354556 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:55.430629 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b1d78-b3c1-4f57-9cd0-6833fcc538b5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:55.466614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5ce96-dbcc-4682-b217-789a2a0bb2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:55.467252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5ce96-dbcc-4682-b217-789a2a0bb2d6 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:55.467536 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5ce96-dbcc-4682-b217-789a2a0bb2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:55.467813 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5ce96-dbcc-4682-b217-789a2a0bb2d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:55.468543 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5ce96-dbcc-4682-b217-789a2a0bb2d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:55.469937 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5ce96-dbcc-4682-b217-789a2a0bb2d6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:55.534745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 458/925] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:13:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:13:55.652403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00a0a0-a0c7-41e5-b264-911e9b0126cb None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:55.653055 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00a0a0-a0c7-41e5-b264-911e9b0126cb None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:55.653576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00a0a0-a0c7-41e5-b264-911e9b0126cb None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:55.655551 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 468/926] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:55.661330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08426c7-5d24-4265-86fd-5c34563a8d7f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:55.661681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08426c7-5d24-4265-86fd-5c34563a8d7f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:55.661935 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08426c7-5d24-4265-86fd-5c34563a8d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:55.682610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c08426c7-5d24-4265-86fd-5c34563a8d7f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:55.683824 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c08426c7-5d24-4265-86fd-5c34563a8d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:55.715621 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fdfc0-ec76-4852-9cf6-e7a5d4974b6e None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:55.715944 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fdfc0-ec76-4852-9cf6-e7a5d4974b6e None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:55.716181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fdfc0-ec76-4852-9cf6-e7a5d4974b6e None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:55.717830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 469/927] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:55.722876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676fe6b-751c-4cc2-b1e6-d966df4e0944 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:55.723157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676fe6b-751c-4cc2-b1e6-d966df4e0944 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:55.723434 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676fe6b-751c-4cc2-b1e6-d966df4e0944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:55.731263 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:55.744895 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-f676fe6b-751c-4cc2-b1e6-d966df4e0944 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:55.746385 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f676fe6b-751c-4cc2-b1e6-d966df4e0944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:55.774198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 459/928] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:13:55.797112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08426c7-5d24-4265-86fd-5c34563a8d7f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:55.811709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:55.825769 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 470/929] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:13:55.849451 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676fe6b-751c-4cc2-b1e6-d966df4e0944 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:55.913288 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08426c7-5d24-4265-86fd-5c34563a8d7f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:55.952920 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05cfeb-82c9-4ba4-acb5-b4bbb0698775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:55.953612 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05cfeb-82c9-4ba4-acb5-b4bbb0698775 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:55.953898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05cfeb-82c9-4ba4-acb5-b4bbb0698775 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:55.954178 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05cfeb-82c9-4ba4-acb5-b4bbb0698775 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:55.954924 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05cfeb-82c9-4ba4-acb5-b4bbb0698775 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:55.956425 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05cfeb-82c9-4ba4-acb5-b4bbb0698775 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:55.959006 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676fe6b-751c-4cc2-b1e6-d966df4e0944 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:55.966792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-ab05cfeb-82c9-4ba4-acb5-b4bbb0698775 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:13:55.966792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:55.966792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:13:55.966792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:13:55.966792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:13:55.966792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:13:55.966792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:13:55.966792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:55.966792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:13:55.966792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:55.966792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:55.966792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:55.966792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:55.966792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:55.966792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:55.966792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:55.967741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:55.967741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:55.967741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:55.967741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:55.967741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:55.967741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:55.967741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:55.967741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:13:55.967741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:13:55.967741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:13:55.967741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:13:55.967741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:55.967741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:55.967741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:55.967741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:55.967741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:55.968546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:55.968546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:55.968546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:55.968546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:55.968546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:55.968546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:55.968546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:55.968546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:55.968546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:55.968546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:55.968546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:55.968546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:13:55.968546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:55.968546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:13:55.968546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:55.968546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 460/930] 10.222.0.33 () {56 vars in 1132 bytes} [Thu Jul 28 05:13:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:55.975898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05cfeb-82c9-4ba4-acb5-b4bbb0698775 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:55.992062 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:55.997806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce726989-a434-4a24-a707-9bc08530ced5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:55.998502 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726989-a434-4a24-a707-9bc08530ced5 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:55.998785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726989-a434-4a24-a707-9bc08530ced5 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:55.999060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726989-a434-4a24-a707-9bc08530ced5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:56.011492 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce726989-a434-4a24-a707-9bc08530ced5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:13:56.016797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-ce726989-a434-4a24-a707-9bc08530ced5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:13:56.016797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:56.016797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:56.016797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:56.016797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:56.016797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:56.016797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:56.016797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:56.016797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:56.016797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:56.016797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:56.016797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:56.016797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:13:56.016797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:13:56.016797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:13:56.016797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:13:56.017742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:13:56.017742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:13:56.017742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:13:56.017742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:13:56.017742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:56.017742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:56.017742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:56.017742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:56.017742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:56.017742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:56.017742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:56.017742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:56.017742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:56.017742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:56.017742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:56.017742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:56.018570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:56.018570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:56.018570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:56.018570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:56.018570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:13:56.018570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:13:56.018570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:13:56.018570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:13:56.018570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:13:56.018570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:13:56.018570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:13:56.018570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:56.023973 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 471/931] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jul 28 05:13:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:56.025956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce726989-a434-4a24-a707-9bc08530ced5 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:56.074468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:56.105342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05cfeb-82c9-4ba4-acb5-b4bbb0698775 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:56.149875 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fa0f8-0c33-4b4c-a107-a772efadd99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:56.150826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fa0f8-0c33-4b4c-a107-a772efadd99c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:56.151239 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fa0f8-0c33-4b4c-a107-a772efadd99c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:56.151661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fa0f8-0c33-4b4c-a107-a772efadd99c None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:56.152408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fa0f8-0c33-4b4c-a107-a772efadd99c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:56.152927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fa0f8-0c33-4b4c-a107-a772efadd99c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:56.154927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fa0f8-0c33-4b4c-a107-a772efadd99c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:56.156984 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce726989-a434-4a24-a707-9bc08530ced5 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:56.161244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 461/932] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jul 28 05:13:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:56.166799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fa0f8-0c33-4b4c-a107-a772efadd99c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:56.203669 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07f88b-5029-4837-8fa3-90f8a57a6af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:56.204414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07f88b-5029-4837-8fa3-90f8a57a6af9 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:56.204847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07f88b-5029-4837-8fa3-90f8a57a6af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:56.205194 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07f88b-5029-4837-8fa3-90f8a57a6af9 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:56.206100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07f88b-5029-4837-8fa3-90f8a57a6af9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:56.206479 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07f88b-5029-4837-8fa3-90f8a57a6af9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:56.208704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07f88b-5029-4837-8fa3-90f8a57a6af9 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:56.218367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 472/933] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jul 28 05:13:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:56.225820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07f88b-5029-4837-8fa3-90f8a57a6af9 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:56.288823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:56.289852 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fa0f8-0c33-4b4c-a107-a772efadd99c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:56.326589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3319b1a-7c9a-49e5-82af-26ffa2339d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:56.327610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3319b1a-7c9a-49e5-82af-26ffa2339d3f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:56.327902 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3319b1a-7c9a-49e5-82af-26ffa2339d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:56.328183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3319b1a-7c9a-49e5-82af-26ffa2339d3f None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:56.328867 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3319b1a-7c9a-49e5-82af-26ffa2339d3f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:56.329173 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3319b1a-7c9a-49e5-82af-26ffa2339d3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:56.330581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3319b1a-7c9a-49e5-82af-26ffa2339d3f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:56.336991 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 462/934] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jul 28 05:13:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:13:56.340995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07f88b-5029-4837-8fa3-90f8a57a6af9 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:56.342597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3319b1a-7c9a-49e5-82af-26ffa2339d3f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:56.346474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:56.380704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cedf8-f24a-4fd9-810c-5d4cca99c9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:56.385632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cedf8-f24a-4fd9-810c-5d4cca99c9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:56.385632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cedf8-f24a-4fd9-810c-5d4cca99c9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:56.385632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cedf8-f24a-4fd9-810c-5d4cca99c9a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:56.396126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cedf8-f24a-4fd9-810c-5d4cca99c9a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:56.398173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cedf8-f24a-4fd9-810c-5d4cca99c9a7 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:56.416080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-db4cedf8-f24a-4fd9-810c-5d4cca99c9a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:56.416080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:56.416080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:56.416080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:56.416080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:56.416080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:56.416080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:56.416080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:56.416080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:56.416080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:56.416080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:56.416080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:56.416080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:56.416080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:56.416080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:56.417192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:56.418381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:56.418381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:56.418381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:56.418381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:56.422445 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 473/935] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:13:56.423611 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cedf8-f24a-4fd9-810c-5d4cca99c9a7 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:56.467199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3319b1a-7c9a-49e5-82af-26ffa2339d3f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:56.506947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcddca3-02d2-4a37-a207-11217c64ce33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:56.507605 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcddca3-02d2-4a37-a207-11217c64ce33 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:56.507889 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcddca3-02d2-4a37-a207-11217c64ce33 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:56.508172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcddca3-02d2-4a37-a207-11217c64ce33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:56.508883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcddca3-02d2-4a37-a207-11217c64ce33 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:56.510290 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcddca3-02d2-4a37-a207-11217c64ce33 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:56.547475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cedf8-f24a-4fd9-810c-5d4cca99c9a7 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:56.555945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:56.584305 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd63d5-a48e-44ff-b9cf-f104d78be368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:56.584861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd63d5-a48e-44ff-b9cf-f104d78be368 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:56.585139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd63d5-a48e-44ff-b9cf-f104d78be368 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:56.585411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd63d5-a48e-44ff-b9cf-f104d78be368 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:56.586128 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd63d5-a48e-44ff-b9cf-f104d78be368 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:56.586430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd63d5-a48e-44ff-b9cf-f104d78be368 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:56.587783 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd63d5-a48e-44ff-b9cf-f104d78be368 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:56.599807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 474/936] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:56.605421 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd63d5-a48e-44ff-b9cf-f104d78be368 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:56.617681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 463/937] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:13:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:13:56.733875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd63d5-a48e-44ff-b9cf-f104d78be368 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:56.778565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561ce9f-9da3-4e9d-a17c-02789260219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:56.779328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561ce9f-9da3-4e9d-a17c-02789260219c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:56.779619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561ce9f-9da3-4e9d-a17c-02789260219c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:56.779900 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561ce9f-9da3-4e9d-a17c-02789260219c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:56.789051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561ce9f-9da3-4e9d-a17c-02789260219c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:56.790598 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561ce9f-9da3-4e9d-a17c-02789260219c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:56.805299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-7561ce9f-9da3-4e9d-a17c-02789260219c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:13:56.805299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:56.805299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:56.805299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:56.805299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:56.805299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:56.805299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:56.805299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:56.805299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:56.805299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:56.805299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:56.805299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:56.805299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:13:56.805299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:13:56.805299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:13:56.805299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:56.820152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:56.821370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:56.821370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:56.821370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:13:56.821370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:13:56.821370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:13:56.821370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:13:56.821370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:13:56.821370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:13:56.821370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:13:56.821370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:56.821370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 475/938] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jul 28 05:13:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:56.822124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcddca3-02d2-4a37-a207-11217c64ce33 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:56.891107 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:56.940669 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcddca3-02d2-4a37-a207-11217c64ce33 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:56.977540 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f2012-edd4-4a2c-9eb7-d78597cf365e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:56.978180 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f2012-edd4-4a2c-9eb7-d78597cf365e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:56.978467 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f2012-edd4-4a2c-9eb7-d78597cf365e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:56.978749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f2012-edd4-4a2c-9eb7-d78597cf365e None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:56.979610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f2012-edd4-4a2c-9eb7-d78597cf365e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:56.979863 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f2012-edd4-4a2c-9eb7-d78597cf365e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:56.981294 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f2012-edd4-4a2c-9eb7-d78597cf365e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:57.000581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 464/939] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jul 28 05:13:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:57.006696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561ce9f-9da3-4e9d-a17c-02789260219c None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:57.032941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:57.114938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561ce9f-9da3-4e9d-a17c-02789260219c None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:57.150966 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ea1ba-7677-4b0e-b2b7-546642c107d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:57.151544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ea1ba-7677-4b0e-b2b7-546642c107d8 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:57.151825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ea1ba-7677-4b0e-b2b7-546642c107d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:57.152103 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ea1ba-7677-4b0e-b2b7-546642c107d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:57.163348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ea1ba-7677-4b0e-b2b7-546642c107d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:57.164814 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ea1ba-7677-4b0e-b2b7-546642c107d8 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:57.180409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-e28ea1ba-7677-4b0e-b2b7-546642c107d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:57.180409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:57.180409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:57.180409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:57.180409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:57.180409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:57.180409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:57.180409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:57.180409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:57.180409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:57.180409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:57.180409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:57.180409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:13:57.180409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:13:57.180409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:57.181350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:57.182282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:13:57.182282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:13:57.182282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:13:57.182282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:57.182282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 476/940] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:57.187664 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f2012-edd4-4a2c-9eb7-d78597cf365e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:57.293581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f2012-edd4-4a2c-9eb7-d78597cf365e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:57.326172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:57.329379 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88093003-b2ae-417f-a2c5-b8ddc06a9d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:57.330044 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88093003-b2ae-417f-a2c5-b8ddc06a9d48 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:57.330320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88093003-b2ae-417f-a2c5-b8ddc06a9d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:57.330595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88093003-b2ae-417f-a2c5-b8ddc06a9d48 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:57.331294 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88093003-b2ae-417f-a2c5-b8ddc06a9d48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:57.331605 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88093003-b2ae-417f-a2c5-b8ddc06a9d48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:57.333598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88093003-b2ae-417f-a2c5-b8ddc06a9d48 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:57.345458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 465/941] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:57.351148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ea1ba-7677-4b0e-b2b7-546642c107d8 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:57.420205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461ee0-5032-4507-afcb-fc3815f9ee98 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:57.420828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461ee0-5032-4507-afcb-fc3815f9ee98 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:57.421302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461ee0-5032-4507-afcb-fc3815f9ee98 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:57.425566 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 466/942] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:57.429087 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f3cf8-3898-4b12-8326-43d4267e9cab None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:57.429619 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f3cf8-3898-4b12-8326-43d4267e9cab None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:57.430129 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f3cf8-3898-4b12-8326-43d4267e9cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:57.436514 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:57.449368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-145f3cf8-3898-4b12-8326-43d4267e9cab None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:57.450935 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-145f3cf8-3898-4b12-8326-43d4267e9cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:57.464624 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ea1ba-7677-4b0e-b2b7-546642c107d8 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:57.517870 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ea862-ae0f-443b-a2b8-cc4b8e2c50ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:57.518899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ea862-ae0f-443b-a2b8-cc4b8e2c50ff None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:57.519190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ea862-ae0f-443b-a2b8-cc4b8e2c50ff None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:57.519469 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ea862-ae0f-443b-a2b8-cc4b8e2c50ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:57.529489 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ea862-ae0f-443b-a2b8-cc4b8e2c50ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:57.529489 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ea862-ae0f-443b-a2b8-cc4b8e2c50ff None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:57.530107 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 467/943] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:13:57.541729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-ce1ea862-ae0f-443b-a2b8-cc4b8e2c50ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:57.541729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:57.541729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:57.541729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:57.541729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:57.541729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:57.541729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:57.541729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:57.541729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:57.541729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:57.541729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:57.541729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:57.541729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:57.541729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:57.541729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:57.542811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:57.543740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:57.543740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:57.543740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:57.543740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:57.543740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:57.543740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:57.543740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:57.543740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:57.544612 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 477/944] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:57.550763 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ea862-ae0f-443b-a2b8-cc4b8e2c50ff None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:57.551554 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f3cf8-3898-4b12-8326-43d4267e9cab None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:57.657067 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f3cf8-3898-4b12-8326-43d4267e9cab None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:57.667661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:57.688961 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ea862-ae0f-443b-a2b8-cc4b8e2c50ff None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:57.691965 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f89ed-140d-4e4c-9012-268894911caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:57.692621 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f89ed-140d-4e4c-9012-268894911caa None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:57.692899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f89ed-140d-4e4c-9012-268894911caa None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:57.693171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f89ed-140d-4e4c-9012-268894911caa None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:57.694001 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f89ed-140d-4e4c-9012-268894911caa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:57.694312 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f89ed-140d-4e4c-9012-268894911caa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:57.695732 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f89ed-140d-4e4c-9012-268894911caa None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:57.708955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 468/945] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:13:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:57.710324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8172ab1-dc47-48ab-bd8d-38d0efa614d8 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:57.710616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8172ab1-dc47-48ab-bd8d-38d0efa614d8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:57.710890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8172ab1-dc47-48ab-bd8d-38d0efa614d8 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:57.712198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 469/946] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:57.716246 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8172ab1-dc47-48ab-bd8d-38d0efa614d8 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:57.731391 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eff7c9-8932-4aef-9a3b-2679d60f33e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:57.732036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eff7c9-8932-4aef-9a3b-2679d60f33e8 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:57.732313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eff7c9-8932-4aef-9a3b-2679d60f33e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:57.732583 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eff7c9-8932-4aef-9a3b-2679d60f33e8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:57.733212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eff7c9-8932-4aef-9a3b-2679d60f33e8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:57.734614 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eff7c9-8932-4aef-9a3b-2679d60f33e8 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:57.736510 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-03eff7c9-8932-4aef-9a3b-2679d60f33e8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:57.743894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:57.745256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:57.745256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:57.745256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:57.745256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:57.745256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:57.745256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:57.745256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:13:57.745256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:13:57.745256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:13:57.745256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:13:57.745256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:57.745256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:57.745256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:57.745256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:57.745256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:57.745256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:57.751875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:57.751875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:57.751875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:57.751875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:57.751875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:57.751875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:57.751875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:57.751875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:57.751875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:57.751875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:57.751875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:13:57.751875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:57.751875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:13:57.751875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:57.751875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 478/947] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jul 28 05:13:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:57.752684 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb36af9-5d9c-452a-b59f-4c54a5e9f0b4 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:57.752684 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb36af9-5d9c-452a-b59f-4c54a5e9f0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:57.752684 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb36af9-5d9c-452a-b59f-4c54a5e9f0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:57.769773 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-9bb36af9-5d9c-452a-b59f-4c54a5e9f0b4 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:57.774087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9bb36af9-5d9c-452a-b59f-4c54a5e9f0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:57.829311 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8172ab1-dc47-48ab-bd8d-38d0efa614d8 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:57.857620 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 479/948] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:13:57.858789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb36af9-5d9c-452a-b59f-4c54a5e9f0b4 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:57.864589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160420ff-0b03-4a6c-8fe3-50b720fd8c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:57.865362 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160420ff-0b03-4a6c-8fe3-50b720fd8c25 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:57.865681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160420ff-0b03-4a6c-8fe3-50b720fd8c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:57.865972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160420ff-0b03-4a6c-8fe3-50b720fd8c25 None admin] PATH_INFO: `/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/2d45700d35664abaae5eb8b42e2e05fb/roles/e45edf32cb2c4b328908432d6c62fd36` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:57.868287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160420ff-0b03-4a6c-8fe3-50b720fd8c25 None admin] RBAC: Authorizing `identity:create_grant(project_id=089d8f58fc104484b617ec4a1317dbeb, user_id=2d45700d35664abaae5eb8b42e2e05fb, role_id=e45edf32cb2c4b328908432d6c62fd36)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:57.869838 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160420ff-0b03-4a6c-8fe3-50b720fd8c25 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:57.923219 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 470/949] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:13:57 2022] PUT /identity/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/2d45700d35664abaae5eb8b42e2e05fb/roles/e45edf32cb2c4b328908432d6c62fd36 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:13:57.924141 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160420ff-0b03-4a6c-8fe3-50b720fd8c25 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:57.968977 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:57.994004 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb36af9-5d9c-452a-b59f-4c54a5e9f0b4 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:58.035743 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:58.047381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2a47a-ee26-4d69-9a9c-3ec1e6dc15ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:58.048544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a47a-ee26-4d69-9a9c-3ec1e6dc15ca None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:58.049006 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a47a-ee26-4d69-9a9c-3ec1e6dc15ca None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:58.049972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a47a-ee26-4d69-9a9c-3ec1e6dc15ca None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:58.051097 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2a47a-ee26-4d69-9a9c-3ec1e6dc15ca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:58.051936 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2a47a-ee26-4d69-9a9c-3ec1e6dc15ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:58.054321 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2a47a-ee26-4d69-9a9c-3ec1e6dc15ca None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:58.066192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 480/950] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jul 28 05:13:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:58.069779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2a47a-ee26-4d69-9a9c-3ec1e6dc15ca None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:58.072005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160420ff-0b03-4a6c-8fe3-50b720fd8c25 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:58.121665 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a38fab-af05-47e1-8c11-7b91f0d6e1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:58.122623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a38fab-af05-47e1-8c11-7b91f0d6e1d7 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:58.123096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a38fab-af05-47e1-8c11-7b91f0d6e1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:58.123622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a38fab-af05-47e1-8c11-7b91f0d6e1d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:58.124467 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a38fab-af05-47e1-8c11-7b91f0d6e1d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:58.126213 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a38fab-af05-47e1-8c11-7b91f0d6e1d7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:58.129262 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: WARNING keystone.server.flask.common [None req-54a38fab-af05-47e1-8c11-7b91f0d6e1d7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 05:13:58.179256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.sql.core [None req-54a38fab-af05-47e1-8c11-7b91f0d6e1d7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 05:13:58.179256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 05:13:58.179256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [parameters: {'id': '95f8d0ad6c21448eb93926b8d0b79751', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 05:13:58.179256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80267) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 05:13:58.186535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-54a38fab-af05-47e1-8c11-7b91f0d6e1d7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 95f8d0ad6c21448eb93926b8d0b79751.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 95f8d0ad6c21448eb93926b8d0b79751. Jul 28 05:13:58.186535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:58.186535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:13:58.186535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:13:58.186535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:13:58.186535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:13:58.186535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:13:58.186535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:13:58.186535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:13:58.186535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:13:58.186535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:13:58.186535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:13:58.186535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result.read() Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 05:13:58.187395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application yield resource Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise self.value Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application session.commit() Jul 28 05:13:58.188898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.session.flush() Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application compat.raise_( Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 05:13:58.190039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 05:13:58.190972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 05:13:58.190972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 05:13:58.190972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 05:13:58.190972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 05:13:58.190972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 05:13:58.190972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 05:13:58.190972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 05:13:58.190972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 05:13:58.190972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 05:13:58.190972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 05:13:58.190972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 05:13:58.190972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 05:13:58.190972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 05:13:58.190972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 05:13:58.190972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result.read() Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:13:58.191743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:13:58.193222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:13:58.193222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:13:58.193222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:13:58.193222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:13:58.193222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:13:58.193222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:13:58.193222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 05:13:58.193222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 05:13:58.193222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [parameters: {'id': '95f8d0ad6c21448eb93926b8d0b79751', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 05:13:58.193222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 05:13:58.193222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:58.193222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:58.193222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:58.193222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:58.193222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:58.194130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:58.195280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:58.195280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 05:13:58.195280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 05:13:58.195280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:58.195280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:58.195280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 05:13:58.195280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 05:13:58.195280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 95f8d0ad6c21448eb93926b8d0b79751. Jul 28 05:13:58.195280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:58.195280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 471/951] 10.222.0.33 () {60 vars in 1140 bytes} [Thu Jul 28 05:13:57 2022] POST /identity/v3/projects => generated 262 bytes in 264 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:58.195280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a38fab-af05-47e1-8c11-7b91f0d6e1d7 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:58.201768 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2a47a-ee26-4d69-9a9c-3ec1e6dc15ca None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:58.240341 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03070175-eccc-4110-b17d-e6331d070665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:58.240893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03070175-eccc-4110-b17d-e6331d070665 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:58.241176 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03070175-eccc-4110-b17d-e6331d070665 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:58.241436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03070175-eccc-4110-b17d-e6331d070665 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:58.242152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03070175-eccc-4110-b17d-e6331d070665 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:58.242460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03070175-eccc-4110-b17d-e6331d070665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:58.244402 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03070175-eccc-4110-b17d-e6331d070665 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:58.253828 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 481/952] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jul 28 05:13:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:58.257962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03070175-eccc-4110-b17d-e6331d070665 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:58.320853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:58.339352 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:58.340814 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a38fab-af05-47e1-8c11-7b91f0d6e1d7 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:58.378499 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0158256-eb82-4a46-962d-2ca7657f025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:58.379305 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0158256-eb82-4a46-962d-2ca7657f025c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:58.379715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0158256-eb82-4a46-962d-2ca7657f025c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:58.380668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0158256-eb82-4a46-962d-2ca7657f025c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:58.388451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0158256-eb82-4a46-962d-2ca7657f025c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:58.390211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0158256-eb82-4a46-962d-2ca7657f025c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:58.394864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03070175-eccc-4110-b17d-e6331d070665 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:58.402527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-b0158256-eb82-4a46-962d-2ca7657f025c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:58.402527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:58.402527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:58.402527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:58.402527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:58.402527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:58.402527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:58.402527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:58.402527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:58.402527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:58.402527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:58.402527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:58.402527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:13:58.402527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:13:58.402527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:58.406958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:58.407888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:13:58.407888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:13:58.407888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:13:58.407888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:13:58.407888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:13:58.407888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:13:58.407888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:13:58.407888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:13:58.409056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 472/953] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:58.410247 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0158256-eb82-4a46-962d-2ca7657f025c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:58.443931 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05fae2-6d78-49a0-bcbe-0bba25004353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:58.445337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05fae2-6d78-49a0-bcbe-0bba25004353 None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:58.445985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05fae2-6d78-49a0-bcbe-0bba25004353 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:58.446413 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05fae2-6d78-49a0-bcbe-0bba25004353 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:58.447525 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05fae2-6d78-49a0-bcbe-0bba25004353 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:58.449731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05fae2-6d78-49a0-bcbe-0bba25004353 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:58.521715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0158256-eb82-4a46-962d-2ca7657f025c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:58.534133 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 482/954] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:13:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:13:58.580369 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9137f1-484a-4e46-b891-e42839ca08b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:58.581051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9137f1-484a-4e46-b891-e42839ca08b6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:58.581338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9137f1-484a-4e46-b891-e42839ca08b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:58.581648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9137f1-484a-4e46-b891-e42839ca08b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:58.582434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9137f1-484a-4e46-b891-e42839ca08b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:58.582748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9137f1-484a-4e46-b891-e42839ca08b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:58.584631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9137f1-484a-4e46-b891-e42839ca08b6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:58.602316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:58.606458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 473/955] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jul 28 05:13:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:58.832339 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5e73a-9f61-4489-906c-f8a2cd2aca56 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:58.832635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5e73a-9f61-4489-906c-f8a2cd2aca56 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:58.833541 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5e73a-9f61-4489-906c-f8a2cd2aca56 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:58.835839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 483/956] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:13:58.842974 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc79ea-7dc9-403e-b471-b95513f25d4f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:58.842974 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc79ea-7dc9-403e-b471-b95513f25d4f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:58.843265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc79ea-7dc9-403e-b471-b95513f25d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:58.866945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-45bc79ea-7dc9-403e-b471-b95513f25d4f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:13:58.868712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-45bc79ea-7dc9-403e-b471-b95513f25d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:13:58.943433 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 474/957] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:13:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:13:58.967674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5e73a-9f61-4489-906c-f8a2cd2aca56 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:59.079184 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5e73a-9f61-4489-906c-f8a2cd2aca56 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:59.093616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:59.122256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab88ae6-6a9d-42a9-affe-626092ed27ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:59.122941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab88ae6-6a9d-42a9-affe-626092ed27ec None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:59.123227 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab88ae6-6a9d-42a9-affe-626092ed27ec None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:59.123507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab88ae6-6a9d-42a9-affe-626092ed27ec None admin] PATH_INFO: `/v3/services/compute` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:59.124157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab88ae6-6a9d-42a9-affe-626092ed27ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:59.129809 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab88ae6-6a9d-42a9-affe-626092ed27ec None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-8ab88ae6-6a9d-42a9-affe-626092ed27ec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:13:59.143203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:13:59.144373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:13:59.144373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:13:59.144373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:13:59.144373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:13:59.144373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:13:59.144373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:13:59.144373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:13:59.144373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:13:59.144373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:13:59.144373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:13:59.144373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:13:59.144373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:13:59.144373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:13:59.144373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:13:59.144373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:13:59.144373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:13:59.145587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:13:59.145587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:13:59.145587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:13:59.145587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:13:59.145587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:13:59.145587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:13:59.145587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:13:59.145587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:13:59.145587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:13:59.145587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:13:59.145587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:13:59.145587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:13:59.145587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:13:59.145587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:13:59.145587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 484/958] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:13:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:13:59.153512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc79ea-7dc9-403e-b471-b95513f25d4f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:59.314381 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc79ea-7dc9-403e-b471-b95513f25d4f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:59.348031 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:13:59.355103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f7437-0fc5-4e95-a6e0-adf165c2c945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:59.355743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f7437-0fc5-4e95-a6e0-adf165c2c945 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:59.356025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f7437-0fc5-4e95-a6e0-adf165c2c945 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:59.356309 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f7437-0fc5-4e95-a6e0-adf165c2c945 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:59.356971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f7437-0fc5-4e95-a6e0-adf165c2c945 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:59.357277 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f7437-0fc5-4e95-a6e0-adf165c2c945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:59.358686 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f7437-0fc5-4e95-a6e0-adf165c2c945 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:59.363911 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 475/959] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jul 28 05:13:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:13:59.369635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab88ae6-6a9d-42a9-affe-626092ed27ec None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:13:59.477297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab88ae6-6a9d-42a9-affe-626092ed27ec None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:13:59.512648 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc60068-f5e0-4b2b-af1c-c2f2736b88c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:13:59.513280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc60068-f5e0-4b2b-af1c-c2f2736b88c9 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:13:59.513592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc60068-f5e0-4b2b-af1c-c2f2736b88c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:13:59.513874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc60068-f5e0-4b2b-af1c-c2f2736b88c9 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:13:59.514558 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc60068-f5e0-4b2b-af1c-c2f2736b88c9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:13:59.514869 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc60068-f5e0-4b2b-af1c-c2f2736b88c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:13:59.516236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc60068-f5e0-4b2b-af1c-c2f2736b88c9 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:13:59.521846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 485/960] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jul 28 05:13:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:00.059016 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e3dff-6e26-4799-855e-f24226d5165d None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:00.059423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e3dff-6e26-4799-855e-f24226d5165d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:00.061214 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e3dff-6e26-4799-855e-f24226d5165d None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:00.061318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 476/961] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:00.066689 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481836d-867f-4aa9-b35d-105b39783379 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:00.066981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481836d-867f-4aa9-b35d-105b39783379 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:00.067404 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481836d-867f-4aa9-b35d-105b39783379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:00.086546 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-3481836d-867f-4aa9-b35d-105b39783379 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:00.087757 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-3481836d-867f-4aa9-b35d-105b39783379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:00.123540 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:00.161920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 486/962] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:00.182357 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e3dff-6e26-4799-855e-f24226d5165d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:00.295320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e3dff-6e26-4799-855e-f24226d5165d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:00.331548 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58184f-e5ef-476e-a7de-f16d8cf6b691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:00.332172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58184f-e5ef-476e-a7de-f16d8cf6b691 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:00.332458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58184f-e5ef-476e-a7de-f16d8cf6b691 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:00.332839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58184f-e5ef-476e-a7de-f16d8cf6b691 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:00.344754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58184f-e5ef-476e-a7de-f16d8cf6b691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:14:00.350134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-2e58184f-e5ef-476e-a7de-f16d8cf6b691 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:14:00.350134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:00.350134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:00.350134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:00.350134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:00.350134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:00.350134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:00.350134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:00.350134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:00.350134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:00.350134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:00.350134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:00.350134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:14:00.350134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:14:00.350134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:14:00.350134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:14:00.351510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:14:00.351510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:14:00.351510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:14:00.351510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:14:00.351510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:00.351510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:00.351510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:00.351510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:00.351510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:00.351510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:00.351510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:00.351510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:00.351510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:00.351510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:00.351510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:00.351510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:00.352346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:00.352346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:00.352346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:00.352346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:00.352346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:14:00.352346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:14:00.352346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:14:00.352346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:14:00.352346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:14:00.352346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:14:00.352346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:14:00.352346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:00.352346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 477/963] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jul 28 05:14:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:00.357704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481836d-867f-4aa9-b35d-105b39783379 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:00.468978 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481836d-867f-4aa9-b35d-105b39783379 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:00.505703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f421c2-a984-4eb8-adf9-11fcdcab0471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:00.506354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f421c2-a984-4eb8-adf9-11fcdcab0471 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:00.506598 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f421c2-a984-4eb8-adf9-11fcdcab0471 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:00.506879 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f421c2-a984-4eb8-adf9-11fcdcab0471 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:00.507608 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f421c2-a984-4eb8-adf9-11fcdcab0471 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:00.507917 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f421c2-a984-4eb8-adf9-11fcdcab0471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:00.509288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f421c2-a984-4eb8-adf9-11fcdcab0471 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:00.518300 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 487/964] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jul 28 05:14:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:00.523954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58184f-e5ef-476e-a7de-f16d8cf6b691 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:00.583863 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:00.630116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58184f-e5ef-476e-a7de-f16d8cf6b691 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:00.672654 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413692a-46ac-422b-9441-6ecbf16ad066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:00.673304 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413692a-46ac-422b-9441-6ecbf16ad066 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:00.673607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413692a-46ac-422b-9441-6ecbf16ad066 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:00.673882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413692a-46ac-422b-9441-6ecbf16ad066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:00.685023 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413692a-46ac-422b-9441-6ecbf16ad066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:00.686512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413692a-46ac-422b-9441-6ecbf16ad066 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:00.702338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-a413692a-46ac-422b-9441-6ecbf16ad066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:00.702338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:00.702338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:00.702338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:00.702338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:00.702338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:00.702338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:00.702338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:00.702338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:00.702338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:00.702338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:00.702338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:00.702338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:14:00.702338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:14:00.702338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:00.703248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:00.704127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:14:00.704127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:14:00.704127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:00.704127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:00.704127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 478/965] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:00.709768 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f421c2-a984-4eb8-adf9-11fcdcab0471 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:00.753250 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:00.806495 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414c94d-4e66-4417-be20-08e802e557d1 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:00.806790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414c94d-4e66-4417-be20-08e802e557d1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:00.807270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414c94d-4e66-4417-be20-08e802e557d1 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:00.808908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 479/966] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:00.814211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c11be1-ea7a-4191-834b-a38534744739 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:00.814561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c11be1-ea7a-4191-834b-a38534744739 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:00.814909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c11be1-ea7a-4191-834b-a38534744739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:00.817782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f421c2-a984-4eb8-adf9-11fcdcab0471 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:00.834958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-60c11be1-ea7a-4191-834b-a38534744739 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:00.836245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-60c11be1-ea7a-4191-834b-a38534744739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:00.860278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41e920-ae03-4f11-a1ba-e37a3f4d2462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:00.861187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41e920-ae03-4f11-a1ba-e37a3f4d2462 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:00.861494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41e920-ae03-4f11-a1ba-e37a3f4d2462 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:00.861778 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41e920-ae03-4f11-a1ba-e37a3f4d2462 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:00.862792 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41e920-ae03-4f11-a1ba-e37a3f4d2462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:00.863100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41e920-ae03-4f11-a1ba-e37a3f4d2462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:00.865446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41e920-ae03-4f11-a1ba-e37a3f4d2462 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:00.881337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 488/967] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:00.886800 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41e920-ae03-4f11-a1ba-e37a3f4d2462 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:00.921583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 480/968] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:14:00.943010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c11be1-ea7a-4191-834b-a38534744739 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:00.982503 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:00.984225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:00.993735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41e920-ae03-4f11-a1ba-e37a3f4d2462 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:01.031045 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92647f-788f-4d7a-a668-45dd77fba385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:01.032246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92647f-788f-4d7a-a668-45dd77fba385 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:01.033182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92647f-788f-4d7a-a668-45dd77fba385 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:01.033696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92647f-788f-4d7a-a668-45dd77fba385 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:01.044771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92647f-788f-4d7a-a668-45dd77fba385 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:01.046788 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92647f-788f-4d7a-a668-45dd77fba385 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:01.053623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c11be1-ea7a-4191-834b-a38534744739 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:01.061207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-3c92647f-788f-4d7a-a668-45dd77fba385 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:14:01.061207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:01.061207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:01.061207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:01.061207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:01.061207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:01.061207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:01.061207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:01.061207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:01.061207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:01.061207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:01.061207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:01.061207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:14:01.061207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:14:01.061207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:14:01.061207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:01.062329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:01.063571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:01.063571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:01.063571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:14:01.063571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:14:01.063571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:14:01.063571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:14:01.063571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:14:01.063571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:14:01.063571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:14:01.063571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:01.063571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 489/969] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jul 28 05:14:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:01.064219 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f22a2-b782-4718-aa7a-923bf6843a1f None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:01.064506 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f22a2-b782-4718-aa7a-923bf6843a1f None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:01.064782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f22a2-b782-4718-aa7a-923bf6843a1f None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:01.070098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 490/970] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:01.070773 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f22a2-b782-4718-aa7a-923bf6843a1f None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:01.094625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372bcb6-e230-4359-a5ed-d1a7fcc1d53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:01.095201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372bcb6-e230-4359-a5ed-d1a7fcc1d53a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:01.095519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372bcb6-e230-4359-a5ed-d1a7fcc1d53a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:01.095758 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372bcb6-e230-4359-a5ed-d1a7fcc1d53a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:01.096387 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372bcb6-e230-4359-a5ed-d1a7fcc1d53a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:01.097796 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372bcb6-e230-4359-a5ed-d1a7fcc1d53a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-4372bcb6-e230-4359-a5ed-d1a7fcc1d53a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:01.107595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:01.108645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:01.108645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:01.108645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:01.108645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:01.108645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:01.108645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:01.108645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:14:01.108645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:14:01.108645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:14:01.108645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:14:01.108645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:01.108645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:01.108645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:01.108645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:01.108645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:01.108645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:01.109507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:01.109507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:01.109507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:01.109507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:01.109507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:01.109507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:01.109507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:01.109507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:01.109507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:01.109507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:01.109507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:14:01.109507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:14:01.109507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:14:01.109507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:01.109507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 481/971] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jul 28 05:14:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:01.115317 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a450887-9865-4373-b7cd-1e5dc8c9a8f9 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:01.115605 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a450887-9865-4373-b7cd-1e5dc8c9a8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:01.115882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a450887-9865-4373-b7cd-1e5dc8c9a8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:01.133273 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-7a450887-9865-4373-b7cd-1e5dc8c9a8f9 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:01.134696 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7a450887-9865-4373-b7cd-1e5dc8c9a8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:01.185425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f22a2-b782-4718-aa7a-923bf6843a1f None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:01.206760 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 482/972] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:01.207982 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a450887-9865-4373-b7cd-1e5dc8c9a8f9 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:01.227160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ff478-8a34-4aa4-af08-b6865134552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:01.227785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ff478-8a34-4aa4-af08-b6865134552b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:01.228068 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ff478-8a34-4aa4-af08-b6865134552b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:01.228370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ff478-8a34-4aa4-af08-b6865134552b None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:01.229147 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ff478-8a34-4aa4-af08-b6865134552b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:01.229457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ff478-8a34-4aa4-af08-b6865134552b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:01.231073 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ff478-8a34-4aa4-af08-b6865134552b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:01.249764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:01.250855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 491/973] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jul 28 05:14:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:01.251650 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ff478-8a34-4aa4-af08-b6865134552b None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:01.271035 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:01.331184 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a450887-9865-4373-b7cd-1e5dc8c9a8f9 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:01.365114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ff478-8a34-4aa4-af08-b6865134552b None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:01.375597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eefcdc-0c66-416f-8d44-85a081cd6a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:01.376581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eefcdc-0c66-416f-8d44-85a081cd6a81 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:01.376873 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eefcdc-0c66-416f-8d44-85a081cd6a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:01.377312 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eefcdc-0c66-416f-8d44-85a081cd6a81 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:01.378032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eefcdc-0c66-416f-8d44-85a081cd6a81 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:01.378343 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eefcdc-0c66-416f-8d44-85a081cd6a81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:01.380234 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eefcdc-0c66-416f-8d44-85a081cd6a81 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:01.385004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 483/974] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jul 28 05:14:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:01.385817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eefcdc-0c66-416f-8d44-85a081cd6a81 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:01.405797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d5cfa-9a1b-4636-9be7-4e26536540f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:01.406770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d5cfa-9a1b-4636-9be7-4e26536540f2 None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:01.407320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d5cfa-9a1b-4636-9be7-4e26536540f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:01.407757 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d5cfa-9a1b-4636-9be7-4e26536540f2 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:01.408583 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d5cfa-9a1b-4636-9be7-4e26536540f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:01.410325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d5cfa-9a1b-4636-9be7-4e26536540f2 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:01.413416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: WARNING keystone.server.flask.common [None req-e67d5cfa-9a1b-4636-9be7-4e26536540f2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 05:14:01.483546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:01.488515 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.sql.core [None req-e67d5cfa-9a1b-4636-9be7-4e26536540f2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 05:14:01.488515 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 05:14:01.488515 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [parameters: {'user_id': '1cff909e810949a59700fb503942fb22', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 05:14:01.488515 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80268) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 05:14:01.490707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eefcdc-0c66-416f-8d44-85a081cd6a81 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:01.510487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-e67d5cfa-9a1b-4636-9be7-4e26536540f2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 05:14:01.510487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:01.510487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:14:01.510487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:14:01.510487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:14:01.510487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:14:01.510487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:14:01.510487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:14:01.510487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:14:01.510487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:14:01.510487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:14:01.510487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:14:01.510487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:14:01.510487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application result.read() Jul 28 05:14:01.510487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:14:01.511806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application yield resource Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise self.value Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application session.commit() Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 05:14:01.512770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self.session.flush() Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application compat.raise_( Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 05:14:01.513725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 05:14:01.514592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 05:14:01.514592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 05:14:01.514592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 05:14:01.514592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 05:14:01.514592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 05:14:01.514592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 05:14:01.514592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 05:14:01.514592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 05:14:01.514592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 05:14:01.514592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 05:14:01.514592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 05:14:01.514592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 05:14:01.514592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 05:14:01.514592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 05:14:01.514592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:14:01.514592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception Jul 28 05:14:01.517111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:14:01.517111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:14:01.517111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:14:01.517111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:14:01.517111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:14:01.517111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:14:01.517111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:14:01.517111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:14:01.517111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:14:01.517111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:14:01.517111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:14:01.517111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application result.read() Jul 28 05:14:01.517111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:14:01.517111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:14:01.517111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:14:01.517111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:14:01.518392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:14:01.518392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:14:01.518392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:14:01.518392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:14:01.518392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 05:14:01.518392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 05:14:01.518392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [parameters: {'user_id': '1cff909e810949a59700fb503942fb22', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 05:14:01.518392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 05:14:01.518392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:01.518392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:14:01.518392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:01.518392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:01.518392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:01.518392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:01.518392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 05:14:01.519494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 05:14:01.520861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 05:14:01.520861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 05:14:01.520861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 05:14:01.520861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 05:14:01.520861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 05:14:01.520861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:01.520861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 492/975] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Jul 28 05:14:01 2022] POST /identity/v3/users => generated 160 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:01.520861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d5cfa-9a1b-4636-9be7-4e26536540f2 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:01.534158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5728a-0cb3-4022-9a0e-7dd49a5b0c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:01.534947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5728a-0cb3-4022-9a0e-7dd49a5b0c1d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:01.535229 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5728a-0cb3-4022-9a0e-7dd49a5b0c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:01.535504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5728a-0cb3-4022-9a0e-7dd49a5b0c1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:01.592360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:01.605833 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5728a-0cb3-4022-9a0e-7dd49a5b0c1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:01.607335 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5728a-0cb3-4022-9a0e-7dd49a5b0c1d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:01.621948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d5cfa-9a1b-4636-9be7-4e26536540f2 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:01.656410 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173e2a8-e9e2-4f73-a768-526b57ec6f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:01.657035 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173e2a8-e9e2-4f73-a768-526b57ec6f1b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:01.657315 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173e2a8-e9e2-4f73-a768-526b57ec6f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:01.657712 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173e2a8-e9e2-4f73-a768-526b57ec6f1b None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:01.658390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173e2a8-e9e2-4f73-a768-526b57ec6f1b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:01.658695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173e2a8-e9e2-4f73-a768-526b57ec6f1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:01.660238 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173e2a8-e9e2-4f73-a768-526b57ec6f1b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:01.668107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 493/976] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jul 28 05:14:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:01.668888 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173e2a8-e9e2-4f73-a768-526b57ec6f1b None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:01.699511 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:01.707148 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 484/977] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:14:01 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:14:01.709004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c73c76-c2dd-4bc5-9db5-4b14825f77e6 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:01.711530 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c73c76-c2dd-4bc5-9db5-4b14825f77e6 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:01.711530 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c73c76-c2dd-4bc5-9db5-4b14825f77e6 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:01.711530 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 485/978] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:01.711530 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c73c76-c2dd-4bc5-9db5-4b14825f77e6 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:01.772952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173e2a8-e9e2-4f73-a768-526b57ec6f1b None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:01.806245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3f2ed-4d98-4d8e-af51-3fe4547c0557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:01.806926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3f2ed-4d98-4d8e-af51-3fe4547c0557 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:01.807204 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3f2ed-4d98-4d8e-af51-3fe4547c0557 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:01.807467 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3f2ed-4d98-4d8e-af51-3fe4547c0557 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:01.810779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:01.815206 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c73c76-c2dd-4bc5-9db5-4b14825f77e6 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:01.816104 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3f2ed-4d98-4d8e-af51-3fe4547c0557 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:01.818269 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3f2ed-4d98-4d8e-af51-3fe4547c0557 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:01.829308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-93b3f2ed-4d98-4d8e-af51-3fe4547c0557 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:14:01.829308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:01.829308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:01.829308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:01.829308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:01.829308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:01.829308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:01.829308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:01.829308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:01.829308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:01.829308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:01.829308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:01.829308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:14:01.829308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:14:01.829308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:14:01.829308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:01.830538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:01.831448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:01.831448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:01.831448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:14:01.831448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:14:01.831448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:14:01.831448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:14:01.831448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:14:01.831448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:14:01.831448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:14:01.831448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:01.831448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 494/979] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:14:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:01.831448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3f2ed-4d98-4d8e-af51-3fe4547c0557 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:01.854880 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a5d65-da9b-4d06-b081-7a335e1d4bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:01.855498 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a5d65-da9b-4d06-b081-7a335e1d4bab None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:01.855777 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a5d65-da9b-4d06-b081-7a335e1d4bab None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:01.856055 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a5d65-da9b-4d06-b081-7a335e1d4bab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:01.856809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a5d65-da9b-4d06-b081-7a335e1d4bab None admin] RBAC: Adding query filter params (interface=admin, service_id=700a5371b3ea4488be55d532595a7783, region_id=RegionOne) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:01.857116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a5d65-da9b-4d06-b081-7a335e1d4bab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:01.858518 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a5d65-da9b-4d06-b081-7a335e1d4bab None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:01.867915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 486/980] 10.222.0.33 () {56 vars in 1249 bytes} [Thu Jul 28 05:14:01 2022] GET /identity/v3/endpoints?service_id=700a5371b3ea4488be55d532595a7783&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:01.867915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0f8e2-420e-4f9b-8838-aa15493bcc3b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:01.867915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0f8e2-420e-4f9b-8838-aa15493bcc3b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:01.867915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0f8e2-420e-4f9b-8838-aa15493bcc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:01.883208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-20d0f8e2-420e-4f9b-8838-aa15493bcc3b None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:01.884336 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-20d0f8e2-420e-4f9b-8838-aa15493bcc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:01.932249 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3f2ed-4d98-4d8e-af51-3fe4547c0557 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:01.936726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:01.951014 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 487/981] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:01.951831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0f8e2-420e-4f9b-8838-aa15493bcc3b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:01.968268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5511e2-934f-4e94-b080-c4f5eaa856e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:01.969064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5511e2-934f-4e94-b080-c4f5eaa856e0 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:01.969346 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5511e2-934f-4e94-b080-c4f5eaa856e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:01.969920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5511e2-934f-4e94-b080-c4f5eaa856e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:01.982847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5511e2-934f-4e94-b080-c4f5eaa856e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:01.984298 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5511e2-934f-4e94-b080-c4f5eaa856e0 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:01.999132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-bd5511e2-934f-4e94-b080-c4f5eaa856e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:01.999132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:01.999132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:01.999132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:01.999132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:01.999132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:01.999132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:01.999132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:01.999132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:01.999132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:01.999132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:01.999132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:01.999132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:14:01.999132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:14:01.999132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:02.000212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:02.001109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:14:02.001109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:14:02.001109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:02.001109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:02.001109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 495/982] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:02.001382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5511e2-934f-4e94-b080-c4f5eaa856e0 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:02.049488 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:02.058013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0f8e2-420e-4f9b-8838-aa15493bcc3b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:02.094159 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45461d0c-6598-4dc6-81a3-a877b59caefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:02.094789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45461d0c-6598-4dc6-81a3-a877b59caefb None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:02.095070 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45461d0c-6598-4dc6-81a3-a877b59caefb None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:02.095350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45461d0c-6598-4dc6-81a3-a877b59caefb None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:02.096106 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45461d0c-6598-4dc6-81a3-a877b59caefb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:02.096412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45461d0c-6598-4dc6-81a3-a877b59caefb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:02.097992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45461d0c-6598-4dc6-81a3-a877b59caefb None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:02.101628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5511e2-934f-4e94-b080-c4f5eaa856e0 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:02.132054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 488/983] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jul 28 05:14:01 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:02.132865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45461d0c-6598-4dc6-81a3-a877b59caefb None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:02.135061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a37a28-4cdb-4bec-87d1-d71608c9bddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:02.135702 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a37a28-4cdb-4bec-87d1-d71608c9bddf None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:02.135984 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a37a28-4cdb-4bec-87d1-d71608c9bddf None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:02.136256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a37a28-4cdb-4bec-87d1-d71608c9bddf None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:02.136914 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a37a28-4cdb-4bec-87d1-d71608c9bddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:02.138354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a37a28-4cdb-4bec-87d1-d71608c9bddf None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:02.144987 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 496/984] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jul 28 05:14:02 2022] GET /identity/v3/services => generated 1497 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:14:02.146406 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a37a28-4cdb-4bec-87d1-d71608c9bddf None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:02.203827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:02.268730 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45461d0c-6598-4dc6-81a3-a877b59caefb None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:02.312567 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a37a28-4cdb-4bec-87d1-d71608c9bddf None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:02.314859 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5db29b-5bab-4261-8a3d-6be289a962b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:02.315728 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5db29b-5bab-4261-8a3d-6be289a962b3 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:02.316117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5db29b-5bab-4261-8a3d-6be289a962b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:02.316493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5db29b-5bab-4261-8a3d-6be289a962b3 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:02.317905 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5db29b-5bab-4261-8a3d-6be289a962b3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:02.319510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5db29b-5bab-4261-8a3d-6be289a962b3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:02.329417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:02.351526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b43e98-01b6-4b27-ab15-ca1f65dd4cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:02.352153 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b43e98-01b6-4b27-ab15-ca1f65dd4cfa None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:02.352429 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b43e98-01b6-4b27-ab15-ca1f65dd4cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:02.352704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b43e98-01b6-4b27-ab15-ca1f65dd4cfa None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:02.353393 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b43e98-01b6-4b27-ab15-ca1f65dd4cfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:02.353722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b43e98-01b6-4b27-ab15-ca1f65dd4cfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:02.355080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b43e98-01b6-4b27-ab15-ca1f65dd4cfa None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:02.372070 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 497/985] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:02.378389 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b43e98-01b6-4b27-ab15-ca1f65dd4cfa None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:02.397840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 489/986] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jul 28 05:14:02 2022] POST /identity/v3/services => generated 242 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:14:02.498829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b43e98-01b6-4b27-ab15-ca1f65dd4cfa None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:02.544601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f17cd-117b-4f64-97bc-4b1d37b79f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:02.545366 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f17cd-117b-4f64-97bc-4b1d37b79f4c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:02.545715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f17cd-117b-4f64-97bc-4b1d37b79f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:02.546051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f17cd-117b-4f64-97bc-4b1d37b79f4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:02.555529 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f17cd-117b-4f64-97bc-4b1d37b79f4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:02.557385 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f17cd-117b-4f64-97bc-4b1d37b79f4c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:02.570213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-913f17cd-117b-4f64-97bc-4b1d37b79f4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:14:02.570213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:02.570213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:02.570213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:02.570213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:02.570213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:02.570213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:02.570213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:02.570213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:02.570213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:02.570213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:02.570213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:02.570213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:14:02.570213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:14:02.570213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:02.571307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:02.572442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:14:02.572442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:14:02.572442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:14:02.572442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:14:02.572442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:14:02.572442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:14:02.572442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:14:02.572442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:02.572442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 498/987] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:14:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:02.578254 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5db29b-5bab-4261-8a3d-6be289a962b3 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:02.680723 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5db29b-5bab-4261-8a3d-6be289a962b3 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:02.688056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:02.715988 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33856c-f21e-4659-a97e-8d08a62faa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:02.716711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33856c-f21e-4659-a97e-8d08a62faa34 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:02.717070 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33856c-f21e-4659-a97e-8d08a62faa34 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:02.717421 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33856c-f21e-4659-a97e-8d08a62faa34 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:02.718275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33856c-f21e-4659-a97e-8d08a62faa34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:02.718664 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33856c-f21e-4659-a97e-8d08a62faa34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:02.720186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33856c-f21e-4659-a97e-8d08a62faa34 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:02.733700 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 490/988] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:14:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:02.739751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f17cd-117b-4f64-97bc-4b1d37b79f4c None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:02.771253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:02.845363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f17cd-117b-4f64-97bc-4b1d37b79f4c None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:02.881611 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19a9d7-ad66-49c2-84c2-93ba270a14b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:02.882235 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19a9d7-ad66-49c2-84c2-93ba270a14b0 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:02.882519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19a9d7-ad66-49c2-84c2-93ba270a14b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:02.882795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19a9d7-ad66-49c2-84c2-93ba270a14b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:02.883581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19a9d7-ad66-49c2-84c2-93ba270a14b0 None admin] RBAC: Adding query filter params (role.id=e45edf32cb2c4b328908432d6c62fd36, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=2d45700d35664abaae5eb8b42e2e05fb) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:02.883893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19a9d7-ad66-49c2-84c2-93ba270a14b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:02.885317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19a9d7-ad66-49c2-84c2-93ba270a14b0 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:02.891858 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 499/989] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:14:02 2022] GET /identity/v3/role_assignments?user.id=2d45700d35664abaae5eb8b42e2e05fb&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=e45edf32cb2c4b328908432d6c62fd36 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:04.206049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4b7c5-22d9-486a-9969-e1ebd2a755e4 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:04.206606 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4b7c5-22d9-486a-9969-e1ebd2a755e4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:04.206606 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4b7c5-22d9-486a-9969-e1ebd2a755e4 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:04.208145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 491/990] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:04.213370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7ff81-0d89-4b07-96b4-0c506c04dea9 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:04.213823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7ff81-0d89-4b07-96b4-0c506c04dea9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:04.213966 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7ff81-0d89-4b07-96b4-0c506c04dea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:04.232818 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-8fa7ff81-0d89-4b07-96b4-0c506c04dea9 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:04.234465 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-8fa7ff81-0d89-4b07-96b4-0c506c04dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:04.311152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 500/991] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:04.334317 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4b7c5-22d9-486a-9969-e1ebd2a755e4 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:04.438155 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4b7c5-22d9-486a-9969-e1ebd2a755e4 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:04.448817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404d25c-1eed-43c8-83f1-b4bd5eff405a None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:04.449109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404d25c-1eed-43c8-83f1-b4bd5eff405a None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:04.449398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404d25c-1eed-43c8-83f1-b4bd5eff405a None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:04.450860 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 501/992] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:04.455710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd875b-87cb-4342-aae2-e4f077c38a37 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:04.456132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd875b-87cb-4342-aae2-e4f077c38a37 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:04.456365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd875b-87cb-4342-aae2-e4f077c38a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:04.475440 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-5bbd875b-87cb-4342-aae2-e4f077c38a37 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:04.476027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355cc32-35b8-4164-af5b-f279dca57443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:04.476636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5bbd875b-87cb-4342-aae2-e4f077c38a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:04.476749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355cc32-35b8-4164-af5b-f279dca57443 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:04.476943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355cc32-35b8-4164-af5b-f279dca57443 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:04.477216 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355cc32-35b8-4164-af5b-f279dca57443 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:04.477876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355cc32-35b8-4164-af5b-f279dca57443 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:04.479228 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355cc32-35b8-4164-af5b-f279dca57443 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-0355cc32-35b8-4164-af5b-f279dca57443 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:04.488165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:04.489458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:04.489458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:04.489458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:04.489458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:04.489458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:04.489458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:04.489458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:14:04.489458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:14:04.489458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:14:04.489458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:14:04.489458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:04.489458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:04.489458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:04.489458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:04.489458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:04.489458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:04.490332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:04.490332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:04.490332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:04.490332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:04.490332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:04.490332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:04.490332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:04.490332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:04.490332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:04.490332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:04.490332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:14:04.490332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:14:04.490332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:14:04.490332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:04.494432 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 492/993] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jul 28 05:14:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:04.495179 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355cc32-35b8-4164-af5b-f279dca57443 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:04.497614 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:04.527351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:04.554924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 502/994] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:04.577415 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd875b-87cb-4342-aae2-e4f077c38a37 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:04.605760 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355cc32-35b8-4164-af5b-f279dca57443 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:04.645856 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef9005-c82d-4c44-a971-2d2a3084fe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:04.646440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef9005-c82d-4c44-a971-2d2a3084fe5f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:04.646713 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef9005-c82d-4c44-a971-2d2a3084fe5f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:04.646984 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef9005-c82d-4c44-a971-2d2a3084fe5f None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:04.647658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef9005-c82d-4c44-a971-2d2a3084fe5f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:04.647965 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef9005-c82d-4c44-a971-2d2a3084fe5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:04.649323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef9005-c82d-4c44-a971-2d2a3084fe5f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:04.654543 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 493/995] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jul 28 05:14:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:04.659916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef9005-c82d-4c44-a971-2d2a3084fe5f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:04.693532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd875b-87cb-4342-aae2-e4f077c38a37 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:04.729135 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190b591-73a2-44e6-8641-4e72a16a08cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:04.729742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190b591-73a2-44e6-8641-4e72a16a08cf None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:04.730020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190b591-73a2-44e6-8641-4e72a16a08cf None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:04.730303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190b591-73a2-44e6-8641-4e72a16a08cf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:04.730931 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190b591-73a2-44e6-8641-4e72a16a08cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:04.732296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190b591-73a2-44e6-8641-4e72a16a08cf None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-e190b591-73a2-44e6-8641-4e72a16a08cf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:04.742348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:04.743353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:04.743353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:04.743353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:04.743353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:04.743353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:04.743353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:04.743353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:14:04.743353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:14:04.743353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:14:04.743353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:14:04.743353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:04.743353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:04.743353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:04.743353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:04.743353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:04.743353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:04.744166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:04.744166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:04.744166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:04.744166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:04.744166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:04.744166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:04.744166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:04.744166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:04.744166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:04.744166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:04.744166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:14:04.744166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:14:04.744166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:14:04.744166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:04.744166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 503/996] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:14:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:14:04.749577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190b591-73a2-44e6-8641-4e72a16a08cf None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:04.765274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:04.772182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:04.773049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef9005-c82d-4c44-a971-2d2a3084fe5f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:04.809398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6f342-366f-4187-9f04-10dd30afced4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:04.810127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6f342-366f-4187-9f04-10dd30afced4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:04.810440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6f342-366f-4187-9f04-10dd30afced4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:04.810693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6f342-366f-4187-9f04-10dd30afced4 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:04.811375 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6f342-366f-4187-9f04-10dd30afced4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:04.811683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6f342-366f-4187-9f04-10dd30afced4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:04.813346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6f342-366f-4187-9f04-10dd30afced4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:04.819274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 494/997] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jul 28 05:14:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:04.824690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6f342-366f-4187-9f04-10dd30afced4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:04.859240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190b591-73a2-44e6-8641-4e72a16a08cf None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:04.894018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f71e2f-7741-4736-bdcd-09f780ccd2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:04.894655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f71e2f-7741-4736-bdcd-09f780ccd2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:04.894922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f71e2f-7741-4736-bdcd-09f780ccd2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:04.895925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f71e2f-7741-4736-bdcd-09f780ccd2c6 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:04.896611 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f71e2f-7741-4736-bdcd-09f780ccd2c6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:04.896916 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f71e2f-7741-4736-bdcd-09f780ccd2c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:04.898304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f71e2f-7741-4736-bdcd-09f780ccd2c6 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:04.903284 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 504/998] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jul 28 05:14:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:04.908584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f71e2f-7741-4736-bdcd-09f780ccd2c6 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:04.927056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6f342-366f-4187-9f04-10dd30afced4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:04.961427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21fbb8-29e2-4ee5-8a45-67e5e73d3142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:04.962073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21fbb8-29e2-4ee5-8a45-67e5e73d3142 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:04.962360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21fbb8-29e2-4ee5-8a45-67e5e73d3142 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:04.962638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21fbb8-29e2-4ee5-8a45-67e5e73d3142 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:04.963345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21fbb8-29e2-4ee5-8a45-67e5e73d3142 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:04.964700 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21fbb8-29e2-4ee5-8a45-67e5e73d3142 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:04.988396 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:05.007171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f71e2f-7741-4736-bdcd-09f780ccd2c6 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:05.026019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 495/999] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:14:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:14:05.026019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854054e-a257-41bf-9c93-36a7b091cc87 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:05.026019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854054e-a257-41bf-9c93-36a7b091cc87 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:05.026019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854054e-a257-41bf-9c93-36a7b091cc87 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:05.026019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 496/1000] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:05.026019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cdaf5-18ce-44bf-b1cf-a04dce0fd498 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:05.026019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cdaf5-18ce-44bf-b1cf-a04dce0fd498 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:05.038204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cdaf5-18ce-44bf-b1cf-a04dce0fd498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:05.053332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaac784-42de-40f3-9efc-03344b0b2da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:05.054009 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaac784-42de-40f3-9efc-03344b0b2da9 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:05.054288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaac784-42de-40f3-9efc-03344b0b2da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:05.054558 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaac784-42de-40f3-9efc-03344b0b2da9 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:05.055249 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaac784-42de-40f3-9efc-03344b0b2da9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:05.055554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaac784-42de-40f3-9efc-03344b0b2da9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:05.056718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b59cdaf5-18ce-44bf-b1cf-a04dce0fd498 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:05.056949 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaac784-42de-40f3-9efc-03344b0b2da9 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:05.058463 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b59cdaf5-18ce-44bf-b1cf-a04dce0fd498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:05.063523 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 505/1001] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jul 28 05:14:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:05.070334 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaac784-42de-40f3-9efc-03344b0b2da9 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:05.078735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:05.147024 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 497/1002] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:14:05.165081 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cdaf5-18ce-44bf-b1cf-a04dce0fd498 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:05.188747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaac784-42de-40f3-9efc-03344b0b2da9 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:05.228757 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c25d5b-3e68-47ff-98fa-227676895d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:05.229784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c25d5b-3e68-47ff-98fa-227676895d1d None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:05.229895 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c25d5b-3e68-47ff-98fa-227676895d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:05.230112 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c25d5b-3e68-47ff-98fa-227676895d1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:05.230870 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c25d5b-3e68-47ff-98fa-227676895d1d None admin] RBAC: Adding query filter params (interface=public, service_id=78488562e4ff4e84bb8eb50af45cddc2, region_id=RegionOne) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:05.231185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c25d5b-3e68-47ff-98fa-227676895d1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:05.232805 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c25d5b-3e68-47ff-98fa-227676895d1d None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:05.239029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 506/1003] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jul 28 05:14:05 2022] GET /identity/v3/endpoints?service_id=78488562e4ff4e84bb8eb50af45cddc2&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:05.244545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c25d5b-3e68-47ff-98fa-227676895d1d None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:05.248884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:05.283146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cdaf5-18ce-44bf-b1cf-a04dce0fd498 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:05.320477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fef390-2889-44a3-b6c5-d10966ceb543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:05.321226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fef390-2889-44a3-b6c5-d10966ceb543 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:05.321420 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fef390-2889-44a3-b6c5-d10966ceb543 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:05.321730 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fef390-2889-44a3-b6c5-d10966ceb543 None admin] PATH_INFO: `/v3/services/image` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:05.323070 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fef390-2889-44a3-b6c5-d10966ceb543 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:05.323782 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fef390-2889-44a3-b6c5-d10966ceb543 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-35fef390-2889-44a3-b6c5-d10966ceb543 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:05.333408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:05.334567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:05.334567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:05.334567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:05.334567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:05.334567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:05.334567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:05.334567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:14:05.334567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:14:05.334567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:14:05.334567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:14:05.334567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:05.334567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:05.334567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:05.334567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:05.334567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:05.334567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:05.335408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:05.335408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:05.335408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:05.335408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:05.335408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:05.335408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:05.335408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:05.335408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:05.335408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:05.335408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:05.335408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:14:05.335408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:14:05.335408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:14:05.335408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:05.335408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 498/1004] 10.222.0.33 () {56 vars in 1105 bytes} [Thu Jul 28 05:14:05 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:05.340394 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fef390-2889-44a3-b6c5-d10966ceb543 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:05.356697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:05.358372 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c25d5b-3e68-47ff-98fa-227676895d1d None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:05.393873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebeaefd-8525-4e29-a742-fc33b2663760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:05.394556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeaefd-8525-4e29-a742-fc33b2663760 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:05.394837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeaefd-8525-4e29-a742-fc33b2663760 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:05.395670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeaefd-8525-4e29-a742-fc33b2663760 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:05.396329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebeaefd-8525-4e29-a742-fc33b2663760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:05.397736 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebeaefd-8525-4e29-a742-fc33b2663760 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:05.409947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 507/1005] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jul 28 05:14:05 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:14:05.450024 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fef390-2889-44a3-b6c5-d10966ceb543 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:05.491270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0afed5-5f5b-40a7-b492-5943913576e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:05.491832 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0afed5-5f5b-40a7-b492-5943913576e9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:05.492117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0afed5-5f5b-40a7-b492-5943913576e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:05.492398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0afed5-5f5b-40a7-b492-5943913576e9 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:05.493098 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0afed5-5f5b-40a7-b492-5943913576e9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:05.493408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0afed5-5f5b-40a7-b492-5943913576e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:05.494861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0afed5-5f5b-40a7-b492-5943913576e9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:05.500767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 499/1006] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:05.507204 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebeaefd-8525-4e29-a742-fc33b2663760 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:05.585043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:05.620406 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebeaefd-8525-4e29-a742-fc33b2663760 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:05.653904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bd485-7ea5-41f1-8d65-eb79f1bd11fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:05.654531 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bd485-7ea5-41f1-8d65-eb79f1bd11fa None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:05.654812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bd485-7ea5-41f1-8d65-eb79f1bd11fa None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:05.655085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bd485-7ea5-41f1-8d65-eb79f1bd11fa None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:05.655762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bd485-7ea5-41f1-8d65-eb79f1bd11fa None admin] RBAC: Adding query filter params (type=image) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:05.656068 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bd485-7ea5-41f1-8d65-eb79f1bd11fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:05.657419 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bd485-7ea5-41f1-8d65-eb79f1bd11fa None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:05.662695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 508/1007] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:07.074803 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68420b52-da9c-478b-9fd6-18aba2a48f3a None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:07.075330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68420b52-da9c-478b-9fd6-18aba2a48f3a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:07.075448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68420b52-da9c-478b-9fd6-18aba2a48f3a None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:07.076753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 500/1008] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:07.081895 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f89e99-062a-4f2a-8040-e6c0a89a9550 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:07.082318 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f89e99-062a-4f2a-8040-e6c0a89a9550 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:07.082506 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f89e99-062a-4f2a-8040-e6c0a89a9550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:07.101435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-81f89e99-062a-4f2a-8040-e6c0a89a9550 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:07.102672 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-81f89e99-062a-4f2a-8040-e6c0a89a9550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:07.172877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 509/1009] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:07 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:07.196538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68420b52-da9c-478b-9fd6-18aba2a48f3a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:07.285367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:07.309735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68420b52-da9c-478b-9fd6-18aba2a48f3a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:07.345196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63ad4c-8309-4758-8d0b-bd34f609a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:07.345808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63ad4c-8309-4758-8d0b-bd34f609a6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:07.346093 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63ad4c-8309-4758-8d0b-bd34f609a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:07.346370 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63ad4c-8309-4758-8d0b-bd34f609a6d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:07.347541 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63ad4c-8309-4758-8d0b-bd34f609a6d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:07.349606 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63ad4c-8309-4758-8d0b-bd34f609a6d3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:07.351568 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 501/1010] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:07.357092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f89e99-062a-4f2a-8040-e6c0a89a9550 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:07.419631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:07.426875 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b79db-b2a7-4699-b484-60e783e9d17e None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:07.427442 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b79db-b2a7-4699-b484-60e783e9d17e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:07.427742 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b79db-b2a7-4699-b484-60e783e9d17e None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:07.429192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 502/1011] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:07.433869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e107ecb-91f8-436f-a453-1bdf6b259e7e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:07.434153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e107ecb-91f8-436f-a453-1bdf6b259e7e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:07.434434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e107ecb-91f8-436f-a453-1bdf6b259e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:07.455133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-0e107ecb-91f8-436f-a453-1bdf6b259e7e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:07.456336 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0e107ecb-91f8-436f-a453-1bdf6b259e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:07.467993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f89e99-062a-4f2a-8040-e6c0a89a9550 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:07.506439 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fdc92-f030-4007-93ab-5a8453e40a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:07.507381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fdc92-f030-4007-93ab-5a8453e40a8f None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:07.507853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fdc92-f030-4007-93ab-5a8453e40a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:07.508301 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fdc92-f030-4007-93ab-5a8453e40a8f None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:07.509152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fdc92-f030-4007-93ab-5a8453e40a8f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:07.510774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fdc92-f030-4007-93ab-5a8453e40a8f None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:07.531311 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 503/1012] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:07 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:14:07.554827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e107ecb-91f8-436f-a453-1bdf6b259e7e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:07.597584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 510/1013] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jul 28 05:14:07 2022] POST /identity/v3/projects => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:14:07.635977 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:07.665492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e107ecb-91f8-436f-a453-1bdf6b259e7e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:07.672631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d8458-261d-44eb-adc5-a15d7c4602b5 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:07.672994 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d8458-261d-44eb-adc5-a15d7c4602b5 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:07.673206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d8458-261d-44eb-adc5-a15d7c4602b5 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:07.674790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 511/1014] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:14:07.680275 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c7703-8712-4f02-a084-609e4b33d5d1 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:07.680571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c7703-8712-4f02-a084-609e4b33d5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:07.680853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c7703-8712-4f02-a084-609e4b33d5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:07.701115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-6a9c7703-8712-4f02-a084-609e4b33d5d1 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:07.702391 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6a9c7703-8712-4f02-a084-609e4b33d5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:07.705374 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494428be-2930-4bae-93ef-4c68c829cd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:07.706072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494428be-2930-4bae-93ef-4c68c829cd56 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:07.706355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494428be-2930-4bae-93ef-4c68c829cd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:07.706638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494428be-2930-4bae-93ef-4c68c829cd56 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:07.707283 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494428be-2930-4bae-93ef-4c68c829cd56 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:07.709576 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494428be-2930-4bae-93ef-4c68c829cd56 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-494428be-2930-4bae-93ef-4c68c829cd56 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:07.719653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:07.720710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:07.720710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:07.720710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:07.720710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:07.720710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:07.720710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:07.720710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:14:07.720710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:14:07.720710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:14:07.720710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:14:07.720710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:07.720710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:07.720710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:07.720710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:07.720710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:07.720710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:07.721583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:07.721583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:07.721583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:07.721583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:07.721583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:07.721583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:07.721583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:07.721583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:07.721583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:07.721583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:07.721583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:14:07.721583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:14:07.721583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:14:07.721583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:07.721583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 504/1015] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:14:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:14:07.727818 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494428be-2930-4bae-93ef-4c68c829cd56 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:07.789320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 512/1016] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:07 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:14:07.821138 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c7703-8712-4f02-a084-609e4b33d5d1 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:07.846899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494428be-2930-4bae-93ef-4c68c829cd56 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:07.879143 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:07.884426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d29c3-7a5c-4c5b-a53e-3997e9dcb5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:07.885060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d29c3-7a5c-4c5b-a53e-3997e9dcb5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:07.885342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d29c3-7a5c-4c5b-a53e-3997e9dcb5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:07.885669 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d29c3-7a5c-4c5b-a53e-3997e9dcb5b4 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:07.886350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d29c3-7a5c-4c5b-a53e-3997e9dcb5b4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:07.886695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d29c3-7a5c-4c5b-a53e-3997e9dcb5b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:07.888035 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d29c3-7a5c-4c5b-a53e-3997e9dcb5b4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:07.898100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 505/1017] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jul 28 05:14:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:07.899789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d29c3-7a5c-4c5b-a53e-3997e9dcb5b4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:07.903129 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:07.936522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c7703-8712-4f02-a084-609e4b33d5d1 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:07.972956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343abac-9ba6-466c-b0d5-ccb3cd052226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:07.973708 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343abac-9ba6-466c-b0d5-ccb3cd052226 None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:07.974154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343abac-9ba6-466c-b0d5-ccb3cd052226 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:07.974433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343abac-9ba6-466c-b0d5-ccb3cd052226 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:07.975126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343abac-9ba6-466c-b0d5-ccb3cd052226 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:07.976520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343abac-9ba6-466c-b0d5-ccb3cd052226 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:08.005853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d29c3-7a5c-4c5b-a53e-3997e9dcb5b4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:08.040615 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed08de-9b78-44be-a58e-5167de200e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:08.041299 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed08de-9b78-44be-a58e-5167de200e28 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:08.041619 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed08de-9b78-44be-a58e-5167de200e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:08.041900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed08de-9b78-44be-a58e-5167de200e28 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:08.042578 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed08de-9b78-44be-a58e-5167de200e28 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:08.042887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed08de-9b78-44be-a58e-5167de200e28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:08.044245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed08de-9b78-44be-a58e-5167de200e28 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:08.049128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 506/1018] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jul 28 05:14:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:08.054633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed08de-9b78-44be-a58e-5167de200e28 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:08.095015 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 513/1019] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jul 28 05:14:07 2022] POST /identity/v3/services => generated 242 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:14:08.125852 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:08.164771 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed08de-9b78-44be-a58e-5167de200e28 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:08.211340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339bea6-41a5-4caa-a833-8dd8d49fee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:08.211978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339bea6-41a5-4caa-a833-8dd8d49fee85 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:08.212259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339bea6-41a5-4caa-a833-8dd8d49fee85 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:08.212538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339bea6-41a5-4caa-a833-8dd8d49fee85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:08.213252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339bea6-41a5-4caa-a833-8dd8d49fee85 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:08.214685 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339bea6-41a5-4caa-a833-8dd8d49fee85 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:08.288964 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 507/1020] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:14:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:14:09.671490 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a92296-7c34-4697-8de0-9103ca7d143c None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:09.672011 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a92296-7c34-4697-8de0-9103ca7d143c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:09.672111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a92296-7c34-4697-8de0-9103ca7d143c None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:09.673560 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 514/1021] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:09.679215 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3c7fb-2095-479a-9b97-e569e8bd8865 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:09.679609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3c7fb-2095-479a-9b97-e569e8bd8865 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:09.679784 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3c7fb-2095-479a-9b97-e569e8bd8865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:09.698626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8ed3c7fb-2095-479a-9b97-e569e8bd8865 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:09.699819 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8ed3c7fb-2095-479a-9b97-e569e8bd8865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:09.776217 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 508/1022] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:09.799802 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a92296-7c34-4697-8de0-9103ca7d143c None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:09.903488 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a92296-7c34-4697-8de0-9103ca7d143c None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:09.905931 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:09.939511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480be01f-5bff-45bd-bc66-adf8e3de224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:09.940262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480be01f-5bff-45bd-bc66-adf8e3de224c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:09.940547 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480be01f-5bff-45bd-bc66-adf8e3de224c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:09.941203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480be01f-5bff-45bd-bc66-adf8e3de224c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:09.942493 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480be01f-5bff-45bd-bc66-adf8e3de224c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:09.944002 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480be01f-5bff-45bd-bc66-adf8e3de224c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:09.949421 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 515/1023] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:09.951726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3c7fb-2095-479a-9b97-e569e8bd8865 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:09.998703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:10.054912 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3c7fb-2095-479a-9b97-e569e8bd8865 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:10.091370 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8beef83-e966-4100-b761-1552fadaa2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:10.092004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8beef83-e966-4100-b761-1552fadaa2f0 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:10.092287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8beef83-e966-4100-b761-1552fadaa2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:10.092565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8beef83-e966-4100-b761-1552fadaa2f0 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:10.093260 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8beef83-e966-4100-b761-1552fadaa2f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:10.094725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8beef83-e966-4100-b761-1552fadaa2f0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:10.149479 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c63e96-5491-4694-a32b-dd185ad58755 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:10.149784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c63e96-5491-4694-a32b-dd185ad58755 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:10.150051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c63e96-5491-4694-a32b-dd185ad58755 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:10.151415 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 516/1024] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:10.156144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b68fce-4759-40e1-baf7-d6242ee6dc06 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:10.156435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b68fce-4759-40e1-baf7-d6242ee6dc06 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:10.164761 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b68fce-4759-40e1-baf7-d6242ee6dc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:10.174835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-74b68fce-4759-40e1-baf7-d6242ee6dc06 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:10.176060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-74b68fce-4759-40e1-baf7-d6242ee6dc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:10.217577 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 509/1025] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:14:09 2022] POST /identity/v3/users => generated 285 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:14:10.251940 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 517/1026] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:14:10.276020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8beef83-e966-4100-b761-1552fadaa2f0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:10.386976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:10.388288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4a830-4ac1-4730-8328-2cd8dbf2b97a None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:10.388577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4a830-4ac1-4730-8328-2cd8dbf2b97a None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:10.388858 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4a830-4ac1-4730-8328-2cd8dbf2b97a None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:10.390081 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8beef83-e966-4100-b761-1552fadaa2f0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:10.390526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 518/1027] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:14:10.395349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b759db8-0cfc-4fde-9fdf-5d9692815084 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:10.401001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b759db8-0cfc-4fde-9fdf-5d9692815084 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:10.401001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b759db8-0cfc-4fde-9fdf-5d9692815084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:10.414991 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-3b759db8-0cfc-4fde-9fdf-5d9692815084 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:10.416909 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-3b759db8-0cfc-4fde-9fdf-5d9692815084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:10.429218 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53e964-7a85-45c1-8416-b0195ac70cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:10.430044 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53e964-7a85-45c1-8416-b0195ac70cbb None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:10.430326 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53e964-7a85-45c1-8416-b0195ac70cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:10.430604 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53e964-7a85-45c1-8416-b0195ac70cbb None admin] PATH_INFO: `/v3/services/image` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:10.431236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53e964-7a85-45c1-8416-b0195ac70cbb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:10.432610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53e964-7a85-45c1-8416-b0195ac70cbb None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-be53e964-7a85-45c1-8416-b0195ac70cbb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:10.445638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:10.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:10.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:10.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:10.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:10.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:10.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:10.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:14:10.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:14:10.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:14:10.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:14:10.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:10.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:10.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:10.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:10.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:10.446703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:10.447724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:10.447724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:10.447724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:10.447724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:10.447724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:10.447724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:10.447724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:10.447724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:10.447724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:10.447724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:10.447724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:14:10.447724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:14:10.447724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:14:10.447724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:10.447724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 510/1028] 10.222.0.33 () {56 vars in 1105 bytes} [Thu Jul 28 05:14:10 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:10.454213 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53e964-7a85-45c1-8416-b0195ac70cbb None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:10.494126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 519/1029] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:14:10.517397 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b759db8-0cfc-4fde-9fdf-5d9692815084 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:10.548767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:10.563592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53e964-7a85-45c1-8416-b0195ac70cbb None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:10.601387 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db78b5-20f4-476e-9d13-a444d801a73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:10.602050 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db78b5-20f4-476e-9d13-a444d801a73e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:10.602335 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db78b5-20f4-476e-9d13-a444d801a73e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:10.602610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db78b5-20f4-476e-9d13-a444d801a73e None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:10.603292 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db78b5-20f4-476e-9d13-a444d801a73e None admin] RBAC: Adding query filter params (name=image) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:10.603602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db78b5-20f4-476e-9d13-a444d801a73e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:10.604962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db78b5-20f4-476e-9d13-a444d801a73e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:10.610075 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 511/1030] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:10.616064 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db78b5-20f4-476e-9d13-a444d801a73e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:10.626679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b759db8-0cfc-4fde-9fdf-5d9692815084 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:10.644265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:10.663947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cdd0a-ba21-4a1f-a2d8-a33822fb9798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:10.664591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cdd0a-ba21-4a1f-a2d8-a33822fb9798 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:10.664868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cdd0a-ba21-4a1f-a2d8-a33822fb9798 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:10.665141 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cdd0a-ba21-4a1f-a2d8-a33822fb9798 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:10.675427 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cdd0a-ba21-4a1f-a2d8-a33822fb9798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:14:10.680898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-db4cdd0a-ba21-4a1f-a2d8-a33822fb9798 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:14:10.680898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:10.680898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:10.680898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:10.680898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:10.680898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:10.680898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:10.680898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:10.680898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:10.680898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:10.680898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:10.680898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:10.680898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:14:10.680898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:14:10.680898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:14:10.680898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:14:10.681859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:14:10.681859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:14:10.681859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:14:10.681859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:14:10.681859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:10.681859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:10.681859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:10.681859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:10.681859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:10.681859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:10.681859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:10.681859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:10.681859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:10.681859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:10.681859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:10.681859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:10.682718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:10.682718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:10.682718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:10.682718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:10.682718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:14:10.682718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:14:10.682718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:14:10.682718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:14:10.682718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:14:10.682718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:14:10.682718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:14:10.682718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:10.682718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 520/1031] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jul 28 05:14:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:14:10.688068 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cdd0a-ba21-4a1f-a2d8-a33822fb9798 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:10.723913 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db78b5-20f4-476e-9d13-a444d801a73e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:10.759244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ea983-74a3-43c1-b3ab-da39e3943d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:10.759789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ea983-74a3-43c1-b3ab-da39e3943d89 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:10.760073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ea983-74a3-43c1-b3ab-da39e3943d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:10.760349 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ea983-74a3-43c1-b3ab-da39e3943d89 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:10.761026 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ea983-74a3-43c1-b3ab-da39e3943d89 None admin] RBAC: Adding query filter params (type=image) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:10.761392 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ea983-74a3-43c1-b3ab-da39e3943d89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:10.762808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ea983-74a3-43c1-b3ab-da39e3943d89 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:10.773580 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 512/1032] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:10.774439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ea983-74a3-43c1-b3ab-da39e3943d89 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:10.782619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:10.791331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cdd0a-ba21-4a1f-a2d8-a33822fb9798 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:10.828133 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6b77c-0f3e-498e-b36b-d3bce73813e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:10.828841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6b77c-0f3e-498e-b36b-d3bce73813e2 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:10.829605 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6b77c-0f3e-498e-b36b-d3bce73813e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:10.829890 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6b77c-0f3e-498e-b36b-d3bce73813e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:10.830609 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6b77c-0f3e-498e-b36b-d3bce73813e2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:10.830917 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6b77c-0f3e-498e-b36b-d3bce73813e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:10.832282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6b77c-0f3e-498e-b36b-d3bce73813e2 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:10.842605 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 521/1033] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jul 28 05:14:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:10.847861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6b77c-0f3e-498e-b36b-d3bce73813e2 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:10.874234 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:10.883303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ea983-74a3-43c1-b3ab-da39e3943d89 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:10.919837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6752b33-6c93-4750-8c6c-6682d9837f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:10.920454 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6752b33-6c93-4750-8c6c-6682d9837f71 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:10.920745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6752b33-6c93-4750-8c6c-6682d9837f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:10.921007 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6752b33-6c93-4750-8c6c-6682d9837f71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:10.921786 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6752b33-6c93-4750-8c6c-6682d9837f71 None admin] RBAC: Adding query filter params (interface=public, service_id=cf0cb7555fca4749ab5d4dc3c70d13ab, region_id=RegionOne) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:10.922097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6752b33-6c93-4750-8c6c-6682d9837f71 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:10.923444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6752b33-6c93-4750-8c6c-6682d9837f71 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:10.933034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 513/1034] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jul 28 05:14:10 2022] GET /identity/v3/endpoints?service_id=cf0cb7555fca4749ab5d4dc3c70d13ab&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:10.934101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6752b33-6c93-4750-8c6c-6682d9837f71 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:10.965586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6b77c-0f3e-498e-b36b-d3bce73813e2 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:11.001955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51467b-25e1-4f42-bf69-2d55720f85a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:11.002894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51467b-25e1-4f42-bf69-2d55720f85a9 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:11.003376 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51467b-25e1-4f42-bf69-2d55720f85a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:11.003793 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51467b-25e1-4f42-bf69-2d55720f85a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:11.018074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51467b-25e1-4f42-bf69-2d55720f85a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:11.019696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51467b-25e1-4f42-bf69-2d55720f85a9 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:11.035065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-0b51467b-25e1-4f42-bf69-2d55720f85a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:11.035065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:11.035065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:11.035065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:11.035065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:11.035065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:11.035065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:11.035065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:11.035065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:11.035065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:11.035065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:11.035065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:11.035065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:14:11.035065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:14:11.035065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:11.036766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:11.037910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:14:11.037910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:14:11.037910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:11.037910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:11.037910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 522/1035] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:14:11.041869 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51467b-25e1-4f42-bf69-2d55720f85a9 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:11.045926 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6752b33-6c93-4750-8c6c-6682d9837f71 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:11.050927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:11.087990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba9940-a84b-4115-b3ec-5cd1034ca4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:11.088821 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba9940-a84b-4115-b3ec-5cd1034ca4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:11.089107 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba9940-a84b-4115-b3ec-5cd1034ca4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:11.089757 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba9940-a84b-4115-b3ec-5cd1034ca4c9 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:11.090670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba9940-a84b-4115-b3ec-5cd1034ca4c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:11.092202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba9940-a84b-4115-b3ec-5cd1034ca4c9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:11.110874 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 514/1036] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jul 28 05:14:10 2022] GET /identity/v3/services => generated 1957 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:14:11.148050 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51467b-25e1-4f42-bf69-2d55720f85a9 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:11.185783 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be97462-5911-4a25-9293-ae392c8ac025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:11.186415 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be97462-5911-4a25-9293-ae392c8ac025 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:11.186694 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be97462-5911-4a25-9293-ae392c8ac025 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:11.186966 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be97462-5911-4a25-9293-ae392c8ac025 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:11.187921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be97462-5911-4a25-9293-ae392c8ac025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:11.188227 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be97462-5911-4a25-9293-ae392c8ac025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:11.189802 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be97462-5911-4a25-9293-ae392c8ac025 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:11.208938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 523/1037] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:11.210474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba9940-a84b-4115-b3ec-5cd1034ca4c9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:11.234545 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:11.320822 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba9940-a84b-4115-b3ec-5cd1034ca4c9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:11.356474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccb802-7442-4867-8174-26a9b12ef2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:11.357121 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccb802-7442-4867-8174-26a9b12ef2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:11.357397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccb802-7442-4867-8174-26a9b12ef2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:11.357698 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccb802-7442-4867-8174-26a9b12ef2b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:11.365870 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccb802-7442-4867-8174-26a9b12ef2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:11.367301 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccb802-7442-4867-8174-26a9b12ef2b7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:11.380022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-45ccb802-7442-4867-8174-26a9b12ef2b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:14:11.380022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:11.380022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:11.380022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:11.380022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:11.380022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:11.380022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:11.380022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:11.380022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:11.380022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:11.380022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:11.380022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:11.380022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:14:11.380022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:14:11.380022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:14:11.380022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:11.381124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:11.382588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:11.382588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:11.382588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:14:11.382588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:14:11.382588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:14:11.382588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:14:11.382588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:14:11.382588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:14:11.382588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:14:11.382588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:11.382588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 515/1038] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jul 28 05:14:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:14:11.387129 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be97462-5911-4a25-9293-ae392c8ac025 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:11.456960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:11.493523 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be97462-5911-4a25-9293-ae392c8ac025 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:11.529949 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a6cad-6c82-4829-97c5-52a95d2b2d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:11.530570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a6cad-6c82-4829-97c5-52a95d2b2d48 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:11.530845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a6cad-6c82-4829-97c5-52a95d2b2d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:11.531116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a6cad-6c82-4829-97c5-52a95d2b2d48 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:11.531898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a6cad-6c82-4829-97c5-52a95d2b2d48 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:11.532201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a6cad-6c82-4829-97c5-52a95d2b2d48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:11.533622 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a6cad-6c82-4829-97c5-52a95d2b2d48 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:11.556689 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 524/1039] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jul 28 05:14:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:11.558229 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccb802-7442-4867-8174-26a9b12ef2b7 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:11.643373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:11.662325 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccb802-7442-4867-8174-26a9b12ef2b7 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:11.696326 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2aac3-3f54-4150-b4b3-6e197dfd63f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:11.696946 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2aac3-3f54-4150-b4b3-6e197dfd63f1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:11.697224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2aac3-3f54-4150-b4b3-6e197dfd63f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:11.697515 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2aac3-3f54-4150-b4b3-6e197dfd63f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:11.764507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2aac3-3f54-4150-b4b3-6e197dfd63f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:11.765985 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2aac3-3f54-4150-b4b3-6e197dfd63f1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:11.847343 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:11.872857 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 516/1040] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:14:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 05:14:11.874195 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a6cad-6c82-4829-97c5-52a95d2b2d48 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:11.974525 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a6cad-6c82-4829-97c5-52a95d2b2d48 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:11.997648 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:12.008780 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd723048-3bf4-4cf3-abae-0d2cab783c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:12.009425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd723048-3bf4-4cf3-abae-0d2cab783c83 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:12.016685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd723048-3bf4-4cf3-abae-0d2cab783c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:12.016685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd723048-3bf4-4cf3-abae-0d2cab783c83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:12.020435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd723048-3bf4-4cf3-abae-0d2cab783c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:12.022068 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd723048-3bf4-4cf3-abae-0d2cab783c83 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:12.037845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-fd723048-3bf4-4cf3-abae-0d2cab783c83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:12.037845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:12.037845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:12.037845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:12.037845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:12.037845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:12.037845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:12.037845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:12.037845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:12.037845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:12.037845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:12.037845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:12.037845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:14:12.037845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:14:12.037845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:12.038759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:12.047874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:14:12.047874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:14:12.047874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:12.047874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:12.047874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 525/1041] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:12.048221 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2aac3-3f54-4150-b4b3-6e197dfd63f1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:12.149850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2aac3-3f54-4150-b4b3-6e197dfd63f1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:12.184808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b21f87-6298-429a-a173-45d36fc0c57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:12.185359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b21f87-6298-429a-a173-45d36fc0c57d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:12.185678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b21f87-6298-429a-a173-45d36fc0c57d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:12.185959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b21f87-6298-429a-a173-45d36fc0c57d None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:12.186655 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b21f87-6298-429a-a173-45d36fc0c57d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:12.186965 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b21f87-6298-429a-a173-45d36fc0c57d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:12.188575 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b21f87-6298-429a-a173-45d36fc0c57d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:12.200520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 517/1042] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:12.206136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd723048-3bf4-4cf3-abae-0d2cab783c83 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:12.304018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01950f1-5216-4f70-a46a-baf8686b38da None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:12.304318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01950f1-5216-4f70-a46a-baf8686b38da None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:12.304585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01950f1-5216-4f70-a46a-baf8686b38da None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:12.306095 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 518/1043] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:14:12.310836 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7bafe-3b79-47c8-ae2f-c3c5b37ebb4a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:12.311121 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7bafe-3b79-47c8-ae2f-c3c5b37ebb4a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:12.311402 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7bafe-3b79-47c8-ae2f-c3c5b37ebb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:12.322432 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd723048-3bf4-4cf3-abae-0d2cab783c83 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:12.330864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1fe7bafe-3b79-47c8-ae2f-c3c5b37ebb4a None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:12.332052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1fe7bafe-3b79-47c8-ae2f-c3c5b37ebb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:12.357174 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da8b04-d0a5-4943-b59a-a7de89bcf6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:12.357848 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da8b04-d0a5-4943-b59a-a7de89bcf6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:12.358155 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da8b04-d0a5-4943-b59a-a7de89bcf6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:12.358435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da8b04-d0a5-4943-b59a-a7de89bcf6a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:12.365133 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da8b04-d0a5-4943-b59a-a7de89bcf6a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:12.366606 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da8b04-d0a5-4943-b59a-a7de89bcf6a1 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:12.367660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:12.378838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-08da8b04-d0a5-4943-b59a-a7de89bcf6a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:14:12.378838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:12.378838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:12.378838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:12.378838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:12.378838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:12.378838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:12.378838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:12.378838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:12.378838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:12.378838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:12.378838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:12.378838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:14:12.378838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:14:12.378838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:12.380288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:12.381178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:14:12.381178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:14:12.381178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:14:12.381178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:14:12.381178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:14:12.381178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:14:12.381178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:14:12.381178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:12.381178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 526/1044] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:14:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:12.386566 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da8b04-d0a5-4943-b59a-a7de89bcf6a1 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:12.405223 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 519/1045] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:14:12.424875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:12.428025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7bafe-3b79-47c8-ae2f-c3c5b37ebb4a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:12.492627 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da8b04-d0a5-4943-b59a-a7de89bcf6a1 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:12.528602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6131d-31a2-4848-8592-23e629942ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:12.529221 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6131d-31a2-4848-8592-23e629942ecb None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:12.529526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6131d-31a2-4848-8592-23e629942ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:12.529895 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6131d-31a2-4848-8592-23e629942ecb None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:12.530547 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6131d-31a2-4848-8592-23e629942ecb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:12.530856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6131d-31a2-4848-8592-23e629942ecb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:12.532293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6131d-31a2-4848-8592-23e629942ecb None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:12.534916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7bafe-3b79-47c8-ae2f-c3c5b37ebb4a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:12.545592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 527/1046] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:14:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:12.552100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6131d-31a2-4848-8592-23e629942ecb None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:12.572497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19dd57-4b33-4585-b7c4-798cbe9d34e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:12.573148 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19dd57-4b33-4585-b7c4-798cbe9d34e4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:12.573428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19dd57-4b33-4585-b7c4-798cbe9d34e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:12.573732 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19dd57-4b33-4585-b7c4-798cbe9d34e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:12.584955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19dd57-4b33-4585-b7c4-798cbe9d34e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:14:12.589917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-3f19dd57-4b33-4585-b7c4-798cbe9d34e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:14:12.589917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:12.589917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:12.589917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:12.589917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:12.589917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:12.589917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:12.589917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:12.589917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:12.589917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:12.589917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:12.589917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:12.589917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:14:12.589917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:14:12.589917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:14:12.589917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:14:12.590845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:14:12.590845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:14:12.590845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:14:12.590845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:14:12.590845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:12.590845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:12.590845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:12.590845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:12.590845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:12.590845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:12.590845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:12.590845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:12.590845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:12.590845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:12.590845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:12.590845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:12.591724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:12.591724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:12.591724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:12.591724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:12.591724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:14:12.591724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:14:12.591724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:14:12.591724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:14:12.591724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:14:12.591724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:14:12.591724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:14:12.591724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:12.596208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 520/1047] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:14:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:14:12.596866 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19dd57-4b33-4585-b7c4-798cbe9d34e4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:12.630302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:12.653381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:12.659933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6131d-31a2-4848-8592-23e629942ecb None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:12.697643 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3394164-8b9d-41a3-8b68-2dfed3cf5dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:12.698271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394164-8b9d-41a3-8b68-2dfed3cf5dff None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:12.698552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394164-8b9d-41a3-8b68-2dfed3cf5dff None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:12.698856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394164-8b9d-41a3-8b68-2dfed3cf5dff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:12.699630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3394164-8b9d-41a3-8b68-2dfed3cf5dff None admin] RBAC: Adding query filter params (role.id=e45edf32cb2c4b328908432d6c62fd36, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=99d8c709e6f4462c98c055cb03eebf42) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:12.699945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3394164-8b9d-41a3-8b68-2dfed3cf5dff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:12.701375 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3394164-8b9d-41a3-8b68-2dfed3cf5dff None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:12.703891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19dd57-4b33-4585-b7c4-798cbe9d34e4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:12.708769 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 528/1048] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:14:12 2022] GET /identity/v3/role_assignments?user.id=99d8c709e6f4462c98c055cb03eebf42&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=e45edf32cb2c4b328908432d6c62fd36 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:12.742890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a0310-fb58-4c20-ba36-6df91f8ba8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:12.743542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a0310-fb58-4c20-ba36-6df91f8ba8fe None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:12.743827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a0310-fb58-4c20-ba36-6df91f8ba8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:12.744106 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a0310-fb58-4c20-ba36-6df91f8ba8fe None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:12.744853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a0310-fb58-4c20-ba36-6df91f8ba8fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:12.745164 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a0310-fb58-4c20-ba36-6df91f8ba8fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:12.746615 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a0310-fb58-4c20-ba36-6df91f8ba8fe None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:12.761384 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 521/1049] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:14:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:12.762845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3394164-8b9d-41a3-8b68-2dfed3cf5dff None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:12.876595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3394164-8b9d-41a3-8b68-2dfed3cf5dff None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:12.914987 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae15c5-15aa-4d05-a9f4-a6e2d5957de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:12.915640 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae15c5-15aa-4d05-a9f4-a6e2d5957de3 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:12.915920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae15c5-15aa-4d05-a9f4-a6e2d5957de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:12.916196 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae15c5-15aa-4d05-a9f4-a6e2d5957de3 None admin] PATH_INFO: `/v3/users/6802eeecb6954cca9aaa264b3aa18494` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:12.930698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae15c5-15aa-4d05-a9f4-a6e2d5957de3 None admin] RBAC: Authorizing `identity:get_user(user_id=6802eeecb6954cca9aaa264b3aa18494)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:12.932145 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae15c5-15aa-4d05-a9f4-a6e2d5957de3 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:12.937780 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 529/1050] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:14:12 2022] GET /identity/v3/users/6802eeecb6954cca9aaa264b3aa18494 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:12.940276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a0310-fb58-4c20-ba36-6df91f8ba8fe None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:13.034660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:13.045002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a0310-fb58-4c20-ba36-6df91f8ba8fe None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:13.080340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7b622-25c6-4f09-bea8-f7c1f3d9e3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:13.080983 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7b622-25c6-4f09-bea8-f7c1f3d9e3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:13.081357 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7b622-25c6-4f09-bea8-f7c1f3d9e3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:13.081667 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7b622-25c6-4f09-bea8-f7c1f3d9e3c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:13.150861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7b622-25c6-4f09-bea8-f7c1f3d9e3c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:13.152235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7b622-25c6-4f09-bea8-f7c1f3d9e3c1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:13.155957 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1585871-8f2e-45bd-9e2a-65b67ad994f1 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:13.156244 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1585871-8f2e-45bd-9e2a-65b67ad994f1 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:13.156523 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1585871-8f2e-45bd-9e2a-65b67ad994f1 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:13.158050 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 530/1051] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:13.164164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeae8fc-7968-4005-8c77-fa9e8750e78b None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:13.164502 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeae8fc-7968-4005-8c77-fa9e8750e78b None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:13.164787 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeae8fc-7968-4005-8c77-fa9e8750e78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:13.183784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-ddeae8fc-7968-4005-8c77-fa9e8750e78b None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:13.184979 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ddeae8fc-7968-4005-8c77-fa9e8750e78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:13.198935 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:13.250421 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:13.256105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 531/1052] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:14:13.269128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 522/1053] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:14:12 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 05:14:13.275532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeae8fc-7968-4005-8c77-fa9e8750e78b None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:13.281350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7b622-25c6-4f09-bea8-f7c1f3d9e3c1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:13.382996 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeae8fc-7968-4005-8c77-fa9e8750e78b None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:13.389859 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7b622-25c6-4f09-bea8-f7c1f3d9e3c1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:13.420194 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ffeb0-6f8c-4780-866e-b96fbed895a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:13.420773 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ffeb0-6f8c-4780-866e-b96fbed895a9 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:13.421056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ffeb0-6f8c-4780-866e-b96fbed895a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:13.421331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ffeb0-6f8c-4780-866e-b96fbed895a9 None admin] PATH_INFO: `/v3/projects/55db7688239a44558b89a14fd9fd420a` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:13.422525 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ffeb0-6f8c-4780-866e-b96fbed895a9 None admin] RBAC: Authorizing `identity:get_project(project_id=55db7688239a44558b89a14fd9fd420a)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:13.423958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ffeb0-6f8c-4780-866e-b96fbed895a9 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:13.425643 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 532/1054] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:14:13 2022] GET /identity/v3/projects/55db7688239a44558b89a14fd9fd420a => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:13.432486 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ffeb0-6f8c-4780-866e-b96fbed895a9 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:13.432610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ddb4c-3df3-45c1-8c23-74acfdb55859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:13.433217 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ddb4c-3df3-45c1-8c23-74acfdb55859 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:13.433527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ddb4c-3df3-45c1-8c23-74acfdb55859 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:13.433805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ddb4c-3df3-45c1-8c23-74acfdb55859 None admin] PATH_INFO: `/v3/services/image` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:13.434560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ddb4c-3df3-45c1-8c23-74acfdb55859 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:13.435822 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ddb4c-3df3-45c1-8c23-74acfdb55859 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-0d6ddb4c-3df3-45c1-8c23-74acfdb55859 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:13.445923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:13.446945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:13.446945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:13.446945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:13.446945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:13.446945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:13.446945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:13.446945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:14:13.446945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:14:13.446945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:14:13.446945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:14:13.446945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:13.446945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:13.446945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:13.446945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:13.446945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:13.446945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:13.447817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:13.447817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:13.447817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:13.447817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:13.447817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:13.447817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:13.447817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:13.447817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:13.447817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:13.447817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:13.447817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:14:13.447817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:14:13.447817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:14:13.447817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:13.447817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 523/1055] 10.222.0.33 () {56 vars in 1105 bytes} [Thu Jul 28 05:14:13 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:14:13.452853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ddb4c-3df3-45c1-8c23-74acfdb55859 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:13.454845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:13.512919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:13.541788 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ffeb0-6f8c-4780-866e-b96fbed895a9 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:13.559178 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ddb4c-3df3-45c1-8c23-74acfdb55859 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:13.579160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf849f-f0ee-4019-a387-df3811e97dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:13.580012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf849f-f0ee-4019-a387-df3811e97dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:13.580484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf849f-f0ee-4019-a387-df3811e97dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:13.580755 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf849f-f0ee-4019-a387-df3811e97dd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:13.581563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf849f-f0ee-4019-a387-df3811e97dd1 None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=55db7688239a44558b89a14fd9fd420a, user.id=6802eeecb6954cca9aaa264b3aa18494) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:13.581876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf849f-f0ee-4019-a387-df3811e97dd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:13.583477 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf849f-f0ee-4019-a387-df3811e97dd1 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:13.601497 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 533/1056] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:14:13 2022] GET /identity/v3/role_assignments?user.id=6802eeecb6954cca9aaa264b3aa18494&scope.project.id=55db7688239a44558b89a14fd9fd420a&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:13.607451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cfb83-eb7c-4b1f-ac73-0476fd5b8567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:13.608232 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cfb83-eb7c-4b1f-ac73-0476fd5b8567 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:13.608590 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cfb83-eb7c-4b1f-ac73-0476fd5b8567 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:13.608939 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cfb83-eb7c-4b1f-ac73-0476fd5b8567 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:13.609750 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cfb83-eb7c-4b1f-ac73-0476fd5b8567 None admin] RBAC: Adding query filter params (name=image) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:13.610132 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cfb83-eb7c-4b1f-ac73-0476fd5b8567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:13.611620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cfb83-eb7c-4b1f-ac73-0476fd5b8567 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:13.623168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 524/1057] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:13.624292 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf849f-f0ee-4019-a387-df3811e97dd1 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:13.717090 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:13.738399 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf849f-f0ee-4019-a387-df3811e97dd1 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:13.776354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0de602-2a32-495e-b81e-8324bf40a6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:13.776990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0de602-2a32-495e-b81e-8324bf40a6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:13.777275 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0de602-2a32-495e-b81e-8324bf40a6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:13.777650 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0de602-2a32-495e-b81e-8324bf40a6b5 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:13.778310 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0de602-2a32-495e-b81e-8324bf40a6b5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:13.778621 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0de602-2a32-495e-b81e-8324bf40a6b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:13.780023 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0de602-2a32-495e-b81e-8324bf40a6b5 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:13.785293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 534/1058] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:13.791485 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cfb83-eb7c-4b1f-ac73-0476fd5b8567 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:13.897688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cfb83-eb7c-4b1f-ac73-0476fd5b8567 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:13.917180 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:13.931541 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedeff1-9b99-48e0-9fba-a1fc22a67f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:13.932213 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedeff1-9b99-48e0-9fba-a1fc22a67f05 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:13.932494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedeff1-9b99-48e0-9fba-a1fc22a67f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:13.932768 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedeff1-9b99-48e0-9fba-a1fc22a67f05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:13.933509 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedeff1-9b99-48e0-9fba-a1fc22a67f05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:13.934910 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedeff1-9b99-48e0-9fba-a1fc22a67f05 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:14.034607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 525/1059] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:14:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:14:14.734248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d9359-8d50-44c5-8aa6-8c294cbe3f55 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:14.734846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d9359-8d50-44c5-8aa6-8c294cbe3f55 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:14.734846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d9359-8d50-44c5-8aa6-8c294cbe3f55 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:14.736298 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 535/1060] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:14.741774 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c6776-ff5c-4637-912b-f1bced4eb1bb None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:14.742069 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c6776-ff5c-4637-912b-f1bced4eb1bb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:14.742352 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c6776-ff5c-4637-912b-f1bced4eb1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:14.761178 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-467c6776-ff5c-4637-912b-f1bced4eb1bb None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:14.762405 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-467c6776-ff5c-4637-912b-f1bced4eb1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:14.839414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 526/1061] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:14.861994 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d9359-8d50-44c5-8aa6-8c294cbe3f55 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:14.965987 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d9359-8d50-44c5-8aa6-8c294cbe3f55 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:14.999485 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2215b-f116-441d-adfc-98d780191de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:15.000067 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2215b-f116-441d-adfc-98d780191de1 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:15.000347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2215b-f116-441d-adfc-98d780191de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:15.000623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2215b-f116-441d-adfc-98d780191de1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:15.011981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2215b-f116-441d-adfc-98d780191de1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:14:15.016927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-7bc2215b-f116-441d-adfc-98d780191de1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:14:15.016927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:15.016927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:15.016927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:15.016927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:15.016927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:15.016927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:15.016927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:15.016927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:15.016927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:15.016927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:15.016927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:15.016927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:14:15.016927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:14:15.016927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:14:15.016927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:14:15.018061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:14:15.018061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:14:15.018061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:14:15.018061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:14:15.018061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:15.018061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:15.018061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:15.018061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:15.018061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:15.018061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:15.018061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:15.018061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:15.018061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:15.018061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:15.018061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:15.018061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:15.018922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:15.018922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:15.018922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:15.018922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:15.018922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:14:15.018922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:14:15.018922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:14:15.018922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:14:15.018922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:14:15.018922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:14:15.018922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:14:15.018922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:15.020353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 536/1062] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jul 28 05:14:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:15.024315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c6776-ff5c-4637-912b-f1bced4eb1bb None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:15.127186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c6776-ff5c-4637-912b-f1bced4eb1bb None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:15.128732 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:15.165254 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2242ffb-7456-458d-b0b9-5885c63298c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:15.166315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2242ffb-7456-458d-b0b9-5885c63298c3 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:15.166778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2242ffb-7456-458d-b0b9-5885c63298c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:15.167233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2242ffb-7456-458d-b0b9-5885c63298c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:15.168129 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2242ffb-7456-458d-b0b9-5885c63298c3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:15.168596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2242ffb-7456-458d-b0b9-5885c63298c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:15.170144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2242ffb-7456-458d-b0b9-5885c63298c3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:15.180634 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 527/1063] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jul 28 05:14:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:15.186073 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2215b-f116-441d-adfc-98d780191de1 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:15.190383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:15.293589 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2215b-f116-441d-adfc-98d780191de1 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:15.328411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d659d6-befe-4a25-8783-6fde62df3811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:15.329057 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d659d6-befe-4a25-8783-6fde62df3811 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:15.329340 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d659d6-befe-4a25-8783-6fde62df3811 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:15.329691 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d659d6-befe-4a25-8783-6fde62df3811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:15.341089 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d659d6-befe-4a25-8783-6fde62df3811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:15.342568 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d659d6-befe-4a25-8783-6fde62df3811 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:15.357857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-61d659d6-befe-4a25-8783-6fde62df3811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:15.357857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:15.357857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:15.357857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:15.357857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:15.357857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:15.357857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:15.357857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:15.357857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:15.357857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:15.357857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:15.357857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:15.357857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:14:15.357857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:14:15.357857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:15.358740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:15.365041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:14:15.365041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:14:15.365041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:15.365041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:15.365041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 537/1064] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:15.365579 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2242ffb-7456-458d-b0b9-5885c63298c3 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:15.466276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2242ffb-7456-458d-b0b9-5885c63298c3 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:15.505119 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb1221-fef5-428a-af13-e27bc316a65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:15.506143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb1221-fef5-428a-af13-e27bc316a65b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:15.506627 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb1221-fef5-428a-af13-e27bc316a65b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:15.507100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb1221-fef5-428a-af13-e27bc316a65b None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:15.508006 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb1221-fef5-428a-af13-e27bc316a65b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:15.508508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb1221-fef5-428a-af13-e27bc316a65b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:15.510183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb1221-fef5-428a-af13-e27bc316a65b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:15.523321 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 528/1065] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:15.529192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d659d6-befe-4a25-8783-6fde62df3811 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:15.590237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:15.597332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454880c-b392-4f16-ad63-9f3c5de402f8 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:15.597664 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454880c-b392-4f16-ad63-9f3c5de402f8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:15.598626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454880c-b392-4f16-ad63-9f3c5de402f8 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:15.600097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 529/1066] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:15.604775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908619a-99d2-4033-9ae9-77afe263a59a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:15.605056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908619a-99d2-4033-9ae9-77afe263a59a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:15.605334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908619a-99d2-4033-9ae9-77afe263a59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:15.623272 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2908619a-99d2-4033-9ae9-77afe263a59a None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:15.624456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2908619a-99d2-4033-9ae9-77afe263a59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:15.636718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d659d6-befe-4a25-8783-6fde62df3811 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:15.643231 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:15.673202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef40b0-dbad-4495-97e0-7a3abb23afdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:15.673885 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef40b0-dbad-4495-97e0-7a3abb23afdf None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:15.674170 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef40b0-dbad-4495-97e0-7a3abb23afdf None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:15.674446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef40b0-dbad-4495-97e0-7a3abb23afdf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:15.682444 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef40b0-dbad-4495-97e0-7a3abb23afdf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:15.683886 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef40b0-dbad-4495-97e0-7a3abb23afdf None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:15.695911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-39ef40b0-dbad-4495-97e0-7a3abb23afdf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:14:15.695911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:15.695911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:15.695911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:15.695911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:15.695911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:15.695911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:15.695911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:15.695911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:15.695911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:15.695911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:15.695911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:15.695911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:14:15.695911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:14:15.695911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:14:15.695911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:15.696853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:15.697873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:15.697873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:15.697873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:14:15.697873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:14:15.697873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:14:15.697873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:14:15.697873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:14:15.697873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:14:15.697873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:14:15.697873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:15.697873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 538/1067] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jul 28 05:14:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:15.701504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 530/1068] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:14:15.706628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef40b0-dbad-4495-97e0-7a3abb23afdf None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:15.723785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908619a-99d2-4033-9ae9-77afe263a59a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:15.815715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef40b0-dbad-4495-97e0-7a3abb23afdf None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:15.826114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908619a-99d2-4033-9ae9-77afe263a59a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:15.833851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:15.852595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bef5c-8f93-48a7-a259-0b0721b8d733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:15.853219 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bef5c-8f93-48a7-a259-0b0721b8d733 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:15.853522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bef5c-8f93-48a7-a259-0b0721b8d733 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:15.853799 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bef5c-8f93-48a7-a259-0b0721b8d733 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:15.854632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bef5c-8f93-48a7-a259-0b0721b8d733 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:15.854896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bef5c-8f93-48a7-a259-0b0721b8d733 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:15.856325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bef5c-8f93-48a7-a259-0b0721b8d733 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:15.874439 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 539/1069] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jul 28 05:14:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:15.879989 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bef5c-8f93-48a7-a259-0b0721b8d733 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:15.885931 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4f1ef-47e2-46ce-95ab-92fabed32952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:15.886587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4f1ef-47e2-46ce-95ab-92fabed32952 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:15.886870 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4f1ef-47e2-46ce-95ab-92fabed32952 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:15.887146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4f1ef-47e2-46ce-95ab-92fabed32952 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:15.898879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4f1ef-47e2-46ce-95ab-92fabed32952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:14:15.904775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-8de4f1ef-47e2-46ce-95ab-92fabed32952 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:14:15.904775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:15.904775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:15.904775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:15.904775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:15.904775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:15.904775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:15.904775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:15.904775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:15.904775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:15.904775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:15.904775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:15.904775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:14:15.904775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:14:15.904775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:14:15.904775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:14:15.905748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:14:15.905748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:14:15.905748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:14:15.905748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:14:15.905748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:15.905748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:15.905748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:15.905748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:15.905748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:15.905748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:15.905748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:15.905748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:15.905748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:15.905748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:15.905748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:15.905748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:15.906744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:15.906744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:15.906744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:15.906744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:15.906744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:14:15.906744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:14:15.906744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:14:15.906744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:14:15.906744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:14:15.906744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:14:15.906744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:14:15.906744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:15.908991 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 531/1070] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:14:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:14:15.915471 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4f1ef-47e2-46ce-95ab-92fabed32952 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:15.935772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:15.986685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bef5c-8f93-48a7-a259-0b0721b8d733 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:16.024402 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b0761-8f7a-438a-afa9-4cb5763bbcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:16.025049 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b0761-8f7a-438a-afa9-4cb5763bbcdd None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:16.025331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b0761-8f7a-438a-afa9-4cb5763bbcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:16.025635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b0761-8f7a-438a-afa9-4cb5763bbcdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:16.025967 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4f1ef-47e2-46ce-95ab-92fabed32952 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:16.037779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b0761-8f7a-438a-afa9-4cb5763bbcdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:16.039237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b0761-8f7a-438a-afa9-4cb5763bbcdd None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:16.055187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-550b0761-8f7a-438a-afa9-4cb5763bbcdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:16.055187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:16.055187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:16.055187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:16.055187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:16.055187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:16.055187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:16.055187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:16.055187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:16.055187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:16.055187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:16.055187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:16.055187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:14:16.055187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:14:16.055187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:16.056261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:16.057193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:14:16.057193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:14:16.057193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:16.057193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:16.057193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 540/1071] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:16.062031 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b0761-8f7a-438a-afa9-4cb5763bbcdd None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:16.067732 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c348b-11d1-45d4-82d3-2ddcf02a7d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:16.068296 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c348b-11d1-45d4-82d3-2ddcf02a7d65 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:16.068577 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c348b-11d1-45d4-82d3-2ddcf02a7d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:16.068851 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c348b-11d1-45d4-82d3-2ddcf02a7d65 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:16.069598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c348b-11d1-45d4-82d3-2ddcf02a7d65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:16.069906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c348b-11d1-45d4-82d3-2ddcf02a7d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:16.071703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c348b-11d1-45d4-82d3-2ddcf02a7d65 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:16.084942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 532/1072] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:14:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:16.084942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35002d-b884-4851-990b-56b5bf0f0786 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:16.084942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35002d-b884-4851-990b-56b5bf0f0786 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:16.084942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35002d-b884-4851-990b-56b5bf0f0786 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:16.084942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 533/1073] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:16.088217 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35002d-b884-4851-990b-56b5bf0f0786 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:16.093667 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:16.166495 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b0761-8f7a-438a-afa9-4cb5763bbcdd None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:16.167431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:16.191449 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35002d-b884-4851-990b-56b5bf0f0786 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:16.201485 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c22d4f-d10d-4afe-a7e8-febd96209cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:16.202227 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c22d4f-d10d-4afe-a7e8-febd96209cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:16.202513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c22d4f-d10d-4afe-a7e8-febd96209cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:16.202791 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c22d4f-d10d-4afe-a7e8-febd96209cd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:16.203480 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c22d4f-d10d-4afe-a7e8-febd96209cd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:16.203787 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c22d4f-d10d-4afe-a7e8-febd96209cd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:16.205148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c22d4f-d10d-4afe-a7e8-febd96209cd0 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:16.221740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 541/1074] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:16.221740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7496495-2924-477d-a8f5-8cad02b0e1c9 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:16.221740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7496495-2924-477d-a8f5-8cad02b0e1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:16.221740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7496495-2924-477d-a8f5-8cad02b0e1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:16.226451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56651a-35e8-4488-9c83-92d8147883e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:16.227894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56651a-35e8-4488-9c83-92d8147883e2 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:16.228177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56651a-35e8-4488-9c83-92d8147883e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:16.228452 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56651a-35e8-4488-9c83-92d8147883e2 None admin] PATH_INFO: `/v3/users/6802eeecb6954cca9aaa264b3aa18494` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:16.229674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56651a-35e8-4488-9c83-92d8147883e2 None admin] RBAC: Authorizing `identity:get_user(user_id=6802eeecb6954cca9aaa264b3aa18494)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:16.231101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56651a-35e8-4488-9c83-92d8147883e2 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:16.233288 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 534/1075] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:14:16 2022] GET /identity/v3/users/6802eeecb6954cca9aaa264b3aa18494 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:16.234181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56651a-35e8-4488-9c83-92d8147883e2 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:16.237100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-c7496495-2924-477d-a8f5-8cad02b0e1c9 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:16.238324 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c7496495-2924-477d-a8f5-8cad02b0e1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:16.307068 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 542/1076] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:16.307812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7496495-2924-477d-a8f5-8cad02b0e1c9 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:16.326455 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:16.343652 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56651a-35e8-4488-9c83-92d8147883e2 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:16.377574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b599c7d-7dca-4adc-a34f-8fc07fcf1c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:16.378219 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b599c7d-7dca-4adc-a34f-8fc07fcf1c50 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:16.378503 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b599c7d-7dca-4adc-a34f-8fc07fcf1c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:16.378782 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b599c7d-7dca-4adc-a34f-8fc07fcf1c50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:16.386623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b599c7d-7dca-4adc-a34f-8fc07fcf1c50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:16.388060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b599c7d-7dca-4adc-a34f-8fc07fcf1c50 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:16.400136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-6b599c7d-7dca-4adc-a34f-8fc07fcf1c50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:14:16.400136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:16.400136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:16.400136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:16.400136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:16.400136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:16.400136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:16.400136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:16.400136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:16.400136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:16.400136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:16.400136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:16.400136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:14:16.400136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:14:16.400136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:16.401071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:16.402003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:14:16.402003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:14:16.402003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:14:16.402003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:14:16.402003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:14:16.402003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:14:16.402003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:14:16.402003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:16.402003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 535/1077] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:16.402526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b599c7d-7dca-4adc-a34f-8fc07fcf1c50 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:16.405352 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:16.414388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7496495-2924-477d-a8f5-8cad02b0e1c9 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:16.450638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd8455-b13d-4f4d-8b98-6480bbe11792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:16.451280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd8455-b13d-4f4d-8b98-6480bbe11792 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:16.451565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd8455-b13d-4f4d-8b98-6480bbe11792 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:16.451838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd8455-b13d-4f4d-8b98-6480bbe11792 None admin] PATH_INFO: `/v3/projects/55db7688239a44558b89a14fd9fd420a` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:16.452991 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd8455-b13d-4f4d-8b98-6480bbe11792 None admin] RBAC: Authorizing `identity:get_project(project_id=55db7688239a44558b89a14fd9fd420a)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:16.454444 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd8455-b13d-4f4d-8b98-6480bbe11792 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:16.456107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 543/1078] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:14:16 2022] GET /identity/v3/projects/55db7688239a44558b89a14fd9fd420a => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:16.456857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd8455-b13d-4f4d-8b98-6480bbe11792 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:16.501628 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b599c7d-7dca-4adc-a34f-8fc07fcf1c50 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:16.535001 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98b3b7-bb13-46a4-9cff-5b883d91a96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:16.535840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b3b7-bb13-46a4-9cff-5b883d91a96e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:16.536124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b3b7-bb13-46a4-9cff-5b883d91a96e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:16.536403 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b3b7-bb13-46a4-9cff-5b883d91a96e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:16.540733 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:16.556383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd8455-b13d-4f4d-8b98-6480bbe11792 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:16.590661 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689333a-a0aa-4127-85d3-affd509d61c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:16.591202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689333a-a0aa-4127-85d3-affd509d61c4 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:16.591483 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689333a-a0aa-4127-85d3-affd509d61c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:16.591755 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689333a-a0aa-4127-85d3-affd509d61c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:16.592499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689333a-a0aa-4127-85d3-affd509d61c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:16.592803 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689333a-a0aa-4127-85d3-affd509d61c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:16.594271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689333a-a0aa-4127-85d3-affd509d61c4 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:16.604131 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98b3b7-bb13-46a4-9cff-5b883d91a96e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:16.605591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98b3b7-bb13-46a4-9cff-5b883d91a96e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:16.605721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 544/1079] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:14:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:16.606436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689333a-a0aa-4127-85d3-affd509d61c4 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:16.611380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:16.708513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689333a-a0aa-4127-85d3-affd509d61c4 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:16.709241 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 536/1080] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:14:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:14:16.710085 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98b3b7-bb13-46a4-9cff-5b883d91a96e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:16.742720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98416cdc-5e97-4c09-858b-46c260597b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:16.743384 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98416cdc-5e97-4c09-858b-46c260597b2c None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:16.743656 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98416cdc-5e97-4c09-858b-46c260597b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:16.743925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98416cdc-5e97-4c09-858b-46c260597b2c None admin] PATH_INFO: `/v3/projects/55db7688239a44558b89a14fd9fd420a/users/6802eeecb6954cca9aaa264b3aa18494/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:16.745864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98416cdc-5e97-4c09-858b-46c260597b2c None admin] RBAC: Authorizing `identity:create_grant(project_id=55db7688239a44558b89a14fd9fd420a, user_id=6802eeecb6954cca9aaa264b3aa18494, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:16.747285 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98416cdc-5e97-4c09-858b-46c260597b2c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:16.809526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98b3b7-bb13-46a4-9cff-5b883d91a96e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:16.811745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:16.842116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 545/1081] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:14:16 2022] PUT /identity/v3/projects/55db7688239a44558b89a14fd9fd420a/users/6802eeecb6954cca9aaa264b3aa18494/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:14:16.842882 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98416cdc-5e97-4c09-858b-46c260597b2c None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:16.845164 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0103aa4-dc2b-4e74-a03d-f6280b9373b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:16.846110 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0103aa4-dc2b-4e74-a03d-f6280b9373b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:16.846546 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:16.847293 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0103aa4-dc2b-4e74-a03d-f6280b9373b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:16.847582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0103aa4-dc2b-4e74-a03d-f6280b9373b1 None admin] PATH_INFO: `/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/99d8c709e6f4462c98c055cb03eebf42/roles/e45edf32cb2c4b328908432d6c62fd36` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:16.850675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0103aa4-dc2b-4e74-a03d-f6280b9373b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=089d8f58fc104484b617ec4a1317dbeb, user_id=99d8c709e6f4462c98c055cb03eebf42, role_id=e45edf32cb2c4b328908432d6c62fd36)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:16.852263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0103aa4-dc2b-4e74-a03d-f6280b9373b1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:16.951413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 537/1082] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:14:16 2022] PUT /identity/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/99d8c709e6f4462c98c055cb03eebf42/roles/e45edf32cb2c4b328908432d6c62fd36 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:14:16.955147 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98416cdc-5e97-4c09-858b-46c260597b2c None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:16.996958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f99f7d-ee62-4b96-8d73-189cb125a8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:16.996958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f99f7d-ee62-4b96-8d73-189cb125a8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:16.997271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f99f7d-ee62-4b96-8d73-189cb125a8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:16.997593 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f99f7d-ee62-4b96-8d73-189cb125a8b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:17.010503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f99f7d-ee62-4b96-8d73-189cb125a8b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:17.012103 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f99f7d-ee62-4b96-8d73-189cb125a8b9 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:17.029718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-79f99f7d-ee62-4b96-8d73-189cb125a8b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:17.029718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:17.029718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:17.029718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:17.029718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:17.029718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:17.029718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:17.029718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:17.029718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:17.029718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:17.029718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:17.029718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:17.029718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:14:17.029718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:14:17.029718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:17.030710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:17.031830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:14:17.031830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:14:17.031830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:17.031830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:17.031830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 546/1083] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:17.038114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0103aa4-dc2b-4e74-a03d-f6280b9373b1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:17.148942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0103aa4-dc2b-4e74-a03d-f6280b9373b1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:17.183851 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff90bac-25fe-4fab-8c40-b849498fccae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:17.184503 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff90bac-25fe-4fab-8c40-b849498fccae None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:17.184748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff90bac-25fe-4fab-8c40-b849498fccae None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:17.185030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff90bac-25fe-4fab-8c40-b849498fccae None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:17.185792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff90bac-25fe-4fab-8c40-b849498fccae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:17.186106 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff90bac-25fe-4fab-8c40-b849498fccae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:17.187724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff90bac-25fe-4fab-8c40-b849498fccae None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:17.200089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 538/1084] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:18.868558 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa53ea-58c1-49fc-a7de-8d65658f6786 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:18.869094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa53ea-58c1-49fc-a7de-8d65658f6786 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:18.869094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa53ea-58c1-49fc-a7de-8d65658f6786 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:18.870638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 547/1085] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:18.875499 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5981-97ff-4d2d-a8ce-28f572e5f721 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:18.875887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5981-97ff-4d2d-a8ce-28f572e5f721 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:18.876250 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5981-97ff-4d2d-a8ce-28f572e5f721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:18.894357 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-f83e5981-97ff-4d2d-a8ce-28f572e5f721 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:18.896045 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f83e5981-97ff-4d2d-a8ce-28f572e5f721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:18.913552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:18.963632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 539/1086] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:18.986665 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa53ea-58c1-49fc-a7de-8d65658f6786 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:18.988653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296320c8-76c6-4fbe-ad94-67d471c22bef None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:18.988943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296320c8-76c6-4fbe-ad94-67d471c22bef None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:18.989226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296320c8-76c6-4fbe-ad94-67d471c22bef None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:18.990643 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 540/1087] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:14:18.995523 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6297889-fbbb-4ac1-a7e7-0695dd92ff93 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:18.995803 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6297889-fbbb-4ac1-a7e7-0695dd92ff93 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:18.996079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6297889-fbbb-4ac1-a7e7-0695dd92ff93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:19.014924 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c6297889-fbbb-4ac1-a7e7-0695dd92ff93 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:19.016122 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c6297889-fbbb-4ac1-a7e7-0695dd92ff93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:19.044270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:19.084396 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 541/1088] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:14:19.090033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa53ea-58c1-49fc-a7de-8d65658f6786 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:19.107012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6297889-fbbb-4ac1-a7e7-0695dd92ff93 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:19.122943 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee4cac-acf0-43c0-9a27-42683da86a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:19.123513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee4cac-acf0-43c0-9a27-42683da86a45 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:19.123797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee4cac-acf0-43c0-9a27-42683da86a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:19.124072 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee4cac-acf0-43c0-9a27-42683da86a45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:19.135457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee4cac-acf0-43c0-9a27-42683da86a45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:14:19.140400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-30ee4cac-acf0-43c0-9a27-42683da86a45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:14:19.140400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:19.140400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:19.140400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:19.140400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:19.140400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:19.140400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:19.140400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:19.140400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:19.140400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:19.140400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:19.140400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:19.140400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:14:19.140400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:14:19.140400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:14:19.140400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:14:19.141407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:14:19.141407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:14:19.141407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:14:19.141407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:14:19.141407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:19.141407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:19.141407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:19.141407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:19.141407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:19.141407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:19.141407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:19.141407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:19.141407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:19.141407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:19.141407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:19.141407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:19.142279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:19.142279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:19.142279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:19.142279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:19.142279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:14:19.142279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:14:19.142279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:14:19.142279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:14:19.142279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:14:19.142279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:14:19.142279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:14:19.142279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:19.142279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 548/1089] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:14:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:19.148536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee4cac-acf0-43c0-9a27-42683da86a45 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:19.188492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:19.204713 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6297889-fbbb-4ac1-a7e7-0695dd92ff93 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:19.240284 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d168e7d-a3e3-4cb4-b6e9-83bd8b30f9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:19.240920 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d168e7d-a3e3-4cb4-b6e9-83bd8b30f9ee None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:19.241194 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d168e7d-a3e3-4cb4-b6e9-83bd8b30f9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:19.241481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d168e7d-a3e3-4cb4-b6e9-83bd8b30f9ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:19.247013 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee4cac-acf0-43c0-9a27-42683da86a45 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:19.251263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d168e7d-a3e3-4cb4-b6e9-83bd8b30f9ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:14:19.256404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-2d168e7d-a3e3-4cb4-b6e9-83bd8b30f9ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:14:19.256404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:19.256404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:19.256404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:19.256404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:19.256404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:19.256404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:19.256404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:19.256404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:19.256404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:19.256404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:19.256404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:19.256404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:14:19.256404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:14:19.256404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:14:19.256404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:14:19.257316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:14:19.257316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:14:19.257316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:14:19.257316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:14:19.257316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:19.257316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:19.257316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:19.257316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:19.257316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:19.257316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:19.257316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:19.257316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:19.257316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:19.257316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:19.257316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:19.257316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:19.258233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:19.258233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:19.258233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:19.258233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:19.258233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:14:19.258233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:14:19.258233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:14:19.258233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:14:19.258233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:14:19.258233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:14:19.258233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:14:19.258233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:19.262801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 542/1090] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jul 28 05:14:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:14:19.263544 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d168e7d-a3e3-4cb4-b6e9-83bd8b30f9ee None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:19.266847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:19.284569 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecfff7-3e8d-4a9f-8581-35320ef86a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:19.285706 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecfff7-3e8d-4a9f-8581-35320ef86a9f None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:19.285997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecfff7-3e8d-4a9f-8581-35320ef86a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:19.286327 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecfff7-3e8d-4a9f-8581-35320ef86a9f None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:19.287049 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecfff7-3e8d-4a9f-8581-35320ef86a9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:19.287358 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecfff7-3e8d-4a9f-8581-35320ef86a9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:19.288717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecfff7-3e8d-4a9f-8581-35320ef86a9f None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:19.297826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 549/1091] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:14:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:19.304206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecfff7-3e8d-4a9f-8581-35320ef86a9f None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:19.364488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d168e7d-a3e3-4cb4-b6e9-83bd8b30f9ee None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:19.397437 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fe850-d8bb-4e6a-8f31-06553811a6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:19.398017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fe850-d8bb-4e6a-8f31-06553811a6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:19.398302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fe850-d8bb-4e6a-8f31-06553811a6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:19.398580 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fe850-d8bb-4e6a-8f31-06553811a6b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:19.399288 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fe850-d8bb-4e6a-8f31-06553811a6b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:19.399591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fe850-d8bb-4e6a-8f31-06553811a6b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:19.400968 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fe850-d8bb-4e6a-8f31-06553811a6b6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:19.402534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecfff7-3e8d-4a9f-8581-35320ef86a9f None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:19.408695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 543/1092] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jul 28 05:14:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:19.415072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fe850-d8bb-4e6a-8f31-06553811a6b6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:19.423779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:19.440797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12355b5c-397a-46f5-b33e-463a199b4dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:19.441557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12355b5c-397a-46f5-b33e-463a199b4dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:19.441984 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12355b5c-397a-46f5-b33e-463a199b4dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:19.442264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12355b5c-397a-46f5-b33e-463a199b4dc9 None admin] PATH_INFO: `/v3/users/6802eeecb6954cca9aaa264b3aa18494` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:19.443462 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12355b5c-397a-46f5-b33e-463a199b4dc9 None admin] RBAC: Authorizing `identity:get_user(user_id=6802eeecb6954cca9aaa264b3aa18494)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:19.444893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12355b5c-397a-46f5-b33e-463a199b4dc9 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:19.446539 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 550/1093] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:14:19 2022] GET /identity/v3/users/6802eeecb6954cca9aaa264b3aa18494 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:19.452045 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12355b5c-397a-46f5-b33e-463a199b4dc9 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:19.498169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:19.513046 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fe850-d8bb-4e6a-8f31-06553811a6b6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:19.546711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7c9a3-e2b2-4f35-8f3d-68ff0a591611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:19.547564 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7c9a3-e2b2-4f35-8f3d-68ff0a591611 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:19.547845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7c9a3-e2b2-4f35-8f3d-68ff0a591611 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:19.548124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7c9a3-e2b2-4f35-8f3d-68ff0a591611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:19.550379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12355b5c-397a-46f5-b33e-463a199b4dc9 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:19.558434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7c9a3-e2b2-4f35-8f3d-68ff0a591611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:19.559872 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7c9a3-e2b2-4f35-8f3d-68ff0a591611 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:19.574291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-69d7c9a3-e2b2-4f35-8f3d-68ff0a591611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:19.574291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:19.574291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:19.574291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:19.574291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:19.574291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:19.574291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:19.574291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:19.574291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:19.574291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:19.574291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:19.574291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:19.574291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:14:19.574291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:14:19.574291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:19.575203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:19.576324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:14:19.576324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:14:19.576324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:19.576324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:19.576324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 544/1094] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:14:19.580996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7c9a3-e2b2-4f35-8f3d-68ff0a591611 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:19.586395 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb325e-41ef-4fdb-942f-4befa2480862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:19.587024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb325e-41ef-4fdb-942f-4befa2480862 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:19.587306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb325e-41ef-4fdb-942f-4befa2480862 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:19.587584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb325e-41ef-4fdb-942f-4befa2480862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:19.639423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:19.655536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb325e-41ef-4fdb-942f-4befa2480862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:19.656908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb325e-41ef-4fdb-942f-4befa2480862 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:19.683605 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7c9a3-e2b2-4f35-8f3d-68ff0a591611 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:19.703752 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:19.718569 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29ce9c-f2ed-46c3-83b8-5be034b62c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:19.719183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29ce9c-f2ed-46c3-83b8-5be034b62c88 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:19.719467 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29ce9c-f2ed-46c3-83b8-5be034b62c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:19.719740 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29ce9c-f2ed-46c3-83b8-5be034b62c88 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:19.720481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29ce9c-f2ed-46c3-83b8-5be034b62c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:19.720782 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29ce9c-f2ed-46c3-83b8-5be034b62c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:19.722162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29ce9c-f2ed-46c3-83b8-5be034b62c88 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:19.734689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 545/1095] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:19.740221 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29ce9c-f2ed-46c3-83b8-5be034b62c88 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:19.763023 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 551/1096] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:14:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:14:19.764139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb325e-41ef-4fdb-942f-4befa2480862 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:19.842443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29ce9c-f2ed-46c3-83b8-5be034b62c88 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:19.859710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:19.862159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb325e-41ef-4fdb-942f-4befa2480862 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:19.877188 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7f54a-770d-4981-9098-425561fb1cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:19.877885 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7f54a-770d-4981-9098-425561fb1cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:19.878165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7f54a-770d-4981-9098-425561fb1cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:19.883681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7f54a-770d-4981-9098-425561fb1cd7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:19.885991 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7f54a-770d-4981-9098-425561fb1cd7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:19.887419 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7f54a-770d-4981-9098-425561fb1cd7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:19.897308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bd697-d47f-48aa-86ad-f092afeaa825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:19.897997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bd697-d47f-48aa-86ad-f092afeaa825 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:19.898280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bd697-d47f-48aa-86ad-f092afeaa825 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:19.898560 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bd697-d47f-48aa-86ad-f092afeaa825 None admin] PATH_INFO: `/v3/projects/55db7688239a44558b89a14fd9fd420a` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:19.899611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-6be7f54a-770d-4981-9098-425561fb1cd7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:14:19.899611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:19.899611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:19.899611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:19.899611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:19.899611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:19.899611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:19.899611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:19.899611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:19.899611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:19.899611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:19.899611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:19.899611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:14:19.899611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:14:19.899611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:14:19.899611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:19.900623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:19.901779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:19.901779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:19.901779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:14:19.901779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:14:19.901779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:14:19.901779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:14:19.901779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:14:19.901779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:14:19.901779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:14:19.901779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:19.902320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bd697-d47f-48aa-86ad-f092afeaa825 None admin] RBAC: Authorizing `identity:get_project(project_id=55db7688239a44558b89a14fd9fd420a)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:19.902391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 546/1097] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jul 28 05:14:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:14:19.902468 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bd697-d47f-48aa-86ad-f092afeaa825 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:19.907736 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 552/1098] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:14:19 2022] GET /identity/v3/projects/55db7688239a44558b89a14fd9fd420a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:19.907857 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7f54a-770d-4981-9098-425561fb1cd7 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:19.908955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bd697-d47f-48aa-86ad-f092afeaa825 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:19.924815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:20.006317 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7f54a-770d-4981-9098-425561fb1cd7 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:20.009717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bd697-d47f-48aa-86ad-f092afeaa825 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:20.039906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7448b-83b6-4e2b-807f-4956237b194d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:20.040548 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7448b-83b6-4e2b-807f-4956237b194d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:20.040821 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7448b-83b6-4e2b-807f-4956237b194d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:20.041096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7448b-83b6-4e2b-807f-4956237b194d None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:20.041962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7448b-83b6-4e2b-807f-4956237b194d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:20.042274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7448b-83b6-4e2b-807f-4956237b194d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:20.043682 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7448b-83b6-4e2b-807f-4956237b194d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:20.045872 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04c1dc-3c71-4d36-af9e-4d221d39ab6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:20.046497 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04c1dc-3c71-4d36-af9e-4d221d39ab6c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:20.046779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04c1dc-3c71-4d36-af9e-4d221d39ab6c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:20.047058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04c1dc-3c71-4d36-af9e-4d221d39ab6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:20.047839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04c1dc-3c71-4d36-af9e-4d221d39ab6c None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=55db7688239a44558b89a14fd9fd420a, user.id=6802eeecb6954cca9aaa264b3aa18494) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:20.048152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04c1dc-3c71-4d36-af9e-4d221d39ab6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:20.049670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04c1dc-3c71-4d36-af9e-4d221d39ab6c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:20.061156 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 553/1099] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:14:19 2022] GET /identity/v3/role_assignments?user.id=6802eeecb6954cca9aaa264b3aa18494&scope.project.id=55db7688239a44558b89a14fd9fd420a&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:20.063087 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 547/1100] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jul 28 05:14:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:20.068146 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04c1dc-3c71-4d36-af9e-4d221d39ab6c None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:20.155762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:20.178967 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04c1dc-3c71-4d36-af9e-4d221d39ab6c None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:20.214808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340119fc-5f90-48eb-803e-38a7144e1a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:20.215437 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340119fc-5f90-48eb-803e-38a7144e1a44 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:20.215719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340119fc-5f90-48eb-803e-38a7144e1a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:20.215996 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340119fc-5f90-48eb-803e-38a7144e1a44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:20.285825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340119fc-5f90-48eb-803e-38a7144e1a44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:20.287308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340119fc-5f90-48eb-803e-38a7144e1a44 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:20.362517 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:20.385139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 554/1101] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:14:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:14:20.390866 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7448b-83b6-4e2b-807f-4956237b194d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:20.424769 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:20.490347 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7448b-83b6-4e2b-807f-4956237b194d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:20.524724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6435bfe-7f02-444f-8282-7b24e05cc824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:20.525367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6435bfe-7f02-444f-8282-7b24e05cc824 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:20.525677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6435bfe-7f02-444f-8282-7b24e05cc824 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:20.525953 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6435bfe-7f02-444f-8282-7b24e05cc824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:20.536302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6435bfe-7f02-444f-8282-7b24e05cc824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:20.537766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6435bfe-7f02-444f-8282-7b24e05cc824 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:20.553004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-e6435bfe-7f02-444f-8282-7b24e05cc824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:20.553004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:20.553004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:20.553004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:20.553004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:20.553004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:20.553004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:20.553004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:20.553004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:20.553004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:20.553004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:20.553004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:20.553004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:14:20.553004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:14:20.553004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:20.553925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:20.554794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:14:20.554794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:14:20.554794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:14:20.554794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:20.557743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 548/1102] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:14:20.559782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340119fc-5f90-48eb-803e-38a7144e1a44 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:20.655431 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340119fc-5f90-48eb-803e-38a7144e1a44 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:20.689115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdbcd9-19bb-4174-87fa-404008385759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:20.689759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdbcd9-19bb-4174-87fa-404008385759 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:20.690037 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdbcd9-19bb-4174-87fa-404008385759 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:20.690307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdbcd9-19bb-4174-87fa-404008385759 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:20.690984 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdbcd9-19bb-4174-87fa-404008385759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:20.691285 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdbcd9-19bb-4174-87fa-404008385759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:20.692801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdbcd9-19bb-4174-87fa-404008385759 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:20.703926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 555/1103] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:20.709559 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6435bfe-7f02-444f-8282-7b24e05cc824 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:20.795281 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:20.807469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6435bfe-7f02-444f-8282-7b24e05cc824 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:20.841289 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f80d4-e077-457f-b4ab-f7510c216ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:20.841953 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f80d4-e077-457f-b4ab-f7510c216ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:20.842232 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f80d4-e077-457f-b4ab-f7510c216ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:20.842505 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f80d4-e077-457f-b4ab-f7510c216ce8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:20.849663 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f80d4-e077-457f-b4ab-f7510c216ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:20.851089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f80d4-e077-457f-b4ab-f7510c216ce8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:20.862040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-6e8f80d4-e077-457f-b4ab-f7510c216ce8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:14:20.862040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:20.862040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:20.862040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:20.862040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:20.862040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:20.862040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:20.862040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:20.862040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:20.862040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:20.862040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:20.862040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:20.862040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:14:20.862040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:14:20.862040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:20.863063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:20.864208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:14:20.864208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:14:20.864208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:14:20.864208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:14:20.864208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:14:20.864208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:14:20.864208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:14:20.864208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:20.864208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 549/1104] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:14:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:14:20.869212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdbcd9-19bb-4174-87fa-404008385759 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:20.908330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:20.967876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdbcd9-19bb-4174-87fa-404008385759 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:21.000542 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6ccbd-35d0-42e5-b24b-86c29204b52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:21.001155 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6ccbd-35d0-42e5-b24b-86c29204b52e None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:21.001435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6ccbd-35d0-42e5-b24b-86c29204b52e None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:21.001735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6ccbd-35d0-42e5-b24b-86c29204b52e None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:21.002476 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6ccbd-35d0-42e5-b24b-86c29204b52e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:21.002785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6ccbd-35d0-42e5-b24b-86c29204b52e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:21.004498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6ccbd-35d0-42e5-b24b-86c29204b52e None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:21.016074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 556/1105] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:14:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:21.022738 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f80d4-e077-457f-b4ab-f7510c216ce8 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:21.124988 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f80d4-e077-457f-b4ab-f7510c216ce8 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:21.159146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4f57b-8e67-4f6a-8a22-af73a3c25895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:21.159769 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4f57b-8e67-4f6a-8a22-af73a3c25895 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:21.160051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4f57b-8e67-4f6a-8a22-af73a3c25895 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:21.160864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4f57b-8e67-4f6a-8a22-af73a3c25895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:21.161881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4f57b-8e67-4f6a-8a22-af73a3c25895 None admin] RBAC: Adding query filter params (role.id=e45edf32cb2c4b328908432d6c62fd36, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=99d8c709e6f4462c98c055cb03eebf42) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:21.162198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4f57b-8e67-4f6a-8a22-af73a3c25895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:21.163630 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4f57b-8e67-4f6a-8a22-af73a3c25895 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:21.169702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 550/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:14:21 2022] GET /identity/v3/role_assignments?user.id=99d8c709e6f4462c98c055cb03eebf42&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=e45edf32cb2c4b328908432d6c62fd36 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:22.104769 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd33b4c-068e-4bc7-93f7-e099a29fae51 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:22.105302 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd33b4c-068e-4bc7-93f7-e099a29fae51 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:22.105302 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd33b4c-068e-4bc7-93f7-e099a29fae51 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:22.106715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 557/1107] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:22.111874 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b616e-5c01-4553-8fa6-be329af9cb56 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:22.112255 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b616e-5c01-4553-8fa6-be329af9cb56 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:22.112417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b616e-5c01-4553-8fa6-be329af9cb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:22.131121 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6c7b616e-5c01-4553-8fa6-be329af9cb56 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:22.132372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6c7b616e-5c01-4553-8fa6-be329af9cb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:22.139737 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:22.198202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 551/1108] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:22.223147 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd33b4c-068e-4bc7-93f7-e099a29fae51 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:22.319585 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:22.324278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd33b4c-068e-4bc7-93f7-e099a29fae51 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:22.357837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94679a40-3914-43d4-a870-b80ba06899a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:22.358413 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94679a40-3914-43d4-a870-b80ba06899a6 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:22.358696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94679a40-3914-43d4-a870-b80ba06899a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:22.358974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94679a40-3914-43d4-a870-b80ba06899a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:22.360128 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94679a40-3914-43d4-a870-b80ba06899a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:22.361577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94679a40-3914-43d4-a870-b80ba06899a6 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:22.363654 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 558/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:22.369573 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b616e-5c01-4553-8fa6-be329af9cb56 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:22.465303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b616e-5c01-4553-8fa6-be329af9cb56 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:22.497669 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81594c7-be13-41fc-b25d-eb778129c2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:22.498284 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81594c7-be13-41fc-b25d-eb778129c2f1 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:22.498560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81594c7-be13-41fc-b25d-eb778129c2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:22.498831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81594c7-be13-41fc-b25d-eb778129c2f1 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:22.499510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81594c7-be13-41fc-b25d-eb778129c2f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:22.500915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81594c7-be13-41fc-b25d-eb778129c2f1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:22.596632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:22.602583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 552/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:14:22 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:14:24.640362 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29215c77-a43b-452c-bbd2-1f43b8b2f9a6 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:24.640916 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29215c77-a43b-452c-bbd2-1f43b8b2f9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:24.641040 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29215c77-a43b-452c-bbd2-1f43b8b2f9a6 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:24.642553 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 559/1111] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:24.648303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87df3b-159c-487c-89b6-4fb2b105aec0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:24.648704 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87df3b-159c-487c-89b6-4fb2b105aec0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:24.648862 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87df3b-159c-487c-89b6-4fb2b105aec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:24.667297 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ec87df3b-159c-487c-89b6-4fb2b105aec0 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:24.668487 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ec87df3b-159c-487c-89b6-4fb2b105aec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:24.733644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 553/1112] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:24.756882 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29215c77-a43b-452c-bbd2-1f43b8b2f9a6 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:24.875394 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29215c77-a43b-452c-bbd2-1f43b8b2f9a6 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:24.909519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aba1c-79dd-4a0a-aca0-9c7f6f94ae66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:24.910690 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aba1c-79dd-4a0a-aca0-9c7f6f94ae66 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:24.911049 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aba1c-79dd-4a0a-aca0-9c7f6f94ae66 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:24.911289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aba1c-79dd-4a0a-aca0-9c7f6f94ae66 None admin] PATH_INFO: `/v3/roles/07a2273f06f649d4a7f2117b3cf6b34d` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:24.912734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aba1c-79dd-4a0a-aca0-9c7f6f94ae66 None admin] RBAC: Authorizing `identity:get_role(role_id=07a2273f06f649d4a7f2117b3cf6b34d)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:24.914147 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aba1c-79dd-4a0a-aca0-9c7f6f94ae66 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:24.915481 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 560/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:14:24 2022] GET /identity/v3/roles/07a2273f06f649d4a7f2117b3cf6b34d => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:24.921417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87df3b-159c-487c-89b6-4fb2b105aec0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:25.018333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87df3b-159c-487c-89b6-4fb2b105aec0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:25.044135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:25.051922 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad336fe8-32b6-4d04-9a07-4dedc614b57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:25.052569 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad336fe8-32b6-4d04-9a07-4dedc614b57a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:25.052852 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad336fe8-32b6-4d04-9a07-4dedc614b57a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:25.053129 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad336fe8-32b6-4d04-9a07-4dedc614b57a None admin] PATH_INFO: `/v3/users/576debc20c684275b655166ff29daab1` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:25.067280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad336fe8-32b6-4d04-9a07-4dedc614b57a None admin] RBAC: Authorizing `identity:get_user(user_id=576debc20c684275b655166ff29daab1)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:25.068707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad336fe8-32b6-4d04-9a07-4dedc614b57a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:25.070362 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 554/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:14:24 2022] GET /identity/v3/users/576debc20c684275b655166ff29daab1 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:25.076150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aba1c-79dd-4a0a-aca0-9c7f6f94ae66 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:25.109955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:25.174474 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aba1c-79dd-4a0a-aca0-9c7f6f94ae66 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:25.207930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0a225-8be5-4039-a765-c16ad86213f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:25.208547 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0a225-8be5-4039-a765-c16ad86213f5 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:25.208832 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0a225-8be5-4039-a765-c16ad86213f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:25.209109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0a225-8be5-4039-a765-c16ad86213f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:25.274808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0a225-8be5-4039-a765-c16ad86213f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:25.276303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0a225-8be5-4039-a765-c16ad86213f5 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:25.307997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:25.374215 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 561/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:14:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:14:25.380976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad336fe8-32b6-4d04-9a07-4dedc614b57a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:25.477340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad336fe8-32b6-4d04-9a07-4dedc614b57a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:25.511377 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b97d4c-5ee3-4b8c-b675-58ebcf258f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:25.512050 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b97d4c-5ee3-4b8c-b675-58ebcf258f8f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:25.512333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b97d4c-5ee3-4b8c-b675-58ebcf258f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:25.512609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b97d4c-5ee3-4b8c-b675-58ebcf258f8f None admin] PATH_INFO: `/v3/projects/55db7688239a44558b89a14fd9fd420a` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:25.513784 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b97d4c-5ee3-4b8c-b675-58ebcf258f8f None admin] RBAC: Authorizing `identity:get_project(project_id=55db7688239a44558b89a14fd9fd420a)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:25.515212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b97d4c-5ee3-4b8c-b675-58ebcf258f8f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:25.516852 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 555/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:14:25 2022] GET /identity/v3/projects/55db7688239a44558b89a14fd9fd420a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:25.522815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0a225-8be5-4039-a765-c16ad86213f5 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:25.619395 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0a225-8be5-4039-a765-c16ad86213f5 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:25.653348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe969399-651c-42f2-9add-01da31291e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:25.653990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe969399-651c-42f2-9add-01da31291e8f None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:25.654270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe969399-651c-42f2-9add-01da31291e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:25.654545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe969399-651c-42f2-9add-01da31291e8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:25.655322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe969399-651c-42f2-9add-01da31291e8f None admin] RBAC: Adding query filter params (role.id=07a2273f06f649d4a7f2117b3cf6b34d, scope.project.id=55db7688239a44558b89a14fd9fd420a, user.id=576debc20c684275b655166ff29daab1) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:25.655635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe969399-651c-42f2-9add-01da31291e8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:25.657042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe969399-651c-42f2-9add-01da31291e8f None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:25.658807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:25.662983 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 562/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:14:25 2022] GET /identity/v3/role_assignments?user.id=576debc20c684275b655166ff29daab1&scope.project.id=55db7688239a44558b89a14fd9fd420a&role.id=07a2273f06f649d4a7f2117b3cf6b34d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:27.622959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4e821-89cb-47e9-aa20-7a963f980e52 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:27.623729 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4e821-89cb-47e9-aa20-7a963f980e52 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:27.623729 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4e821-89cb-47e9-aa20-7a963f980e52 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:27.624861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 556/1118] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:27.630705 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e308f-e55c-4daf-9a78-fd01aab73013 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:27.631115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e308f-e55c-4daf-9a78-fd01aab73013 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:27.631268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e308f-e55c-4daf-9a78-fd01aab73013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:27.649111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-270e308f-e55c-4daf-9a78-fd01aab73013 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:27.650350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-270e308f-e55c-4daf-9a78-fd01aab73013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:27.717305 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 563/1119] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:14:27.740417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4e821-89cb-47e9-aa20-7a963f980e52 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:27.797036 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:27.844518 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4e821-89cb-47e9-aa20-7a963f980e52 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:27.877507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151a562-8ae3-41b2-a595-2bea6e2c6f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:27.878083 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151a562-8ae3-41b2-a595-2bea6e2c6f81 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:27.878366 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151a562-8ae3-41b2-a595-2bea6e2c6f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:27.878670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151a562-8ae3-41b2-a595-2bea6e2c6f81 None admin] PATH_INFO: `/v3/roles/07a2273f06f649d4a7f2117b3cf6b34d` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:27.880112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151a562-8ae3-41b2-a595-2bea6e2c6f81 None admin] RBAC: Authorizing `identity:get_role(role_id=07a2273f06f649d4a7f2117b3cf6b34d)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:27.881529 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151a562-8ae3-41b2-a595-2bea6e2c6f81 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:27.882869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 557/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:14:27 2022] GET /identity/v3/roles/07a2273f06f649d4a7f2117b3cf6b34d => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:27.888722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e308f-e55c-4daf-9a78-fd01aab73013 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:27.984999 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e308f-e55c-4daf-9a78-fd01aab73013 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:28.010727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:28.018284 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b819a5d-658c-47b1-9c95-37c6cc9b7b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:28.023332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b819a5d-658c-47b1-9c95-37c6cc9b7b05 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:28.023332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b819a5d-658c-47b1-9c95-37c6cc9b7b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:28.023332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b819a5d-658c-47b1-9c95-37c6cc9b7b05 None admin] PATH_INFO: `/v3/users/576debc20c684275b655166ff29daab1` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:28.023332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b819a5d-658c-47b1-9c95-37c6cc9b7b05 None admin] RBAC: Authorizing `identity:get_user(user_id=576debc20c684275b655166ff29daab1)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:28.023332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b819a5d-658c-47b1-9c95-37c6cc9b7b05 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:28.024378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 564/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:14:27 2022] GET /identity/v3/users/576debc20c684275b655166ff29daab1 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:28.030056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151a562-8ae3-41b2-a595-2bea6e2c6f81 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:28.131865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151a562-8ae3-41b2-a595-2bea6e2c6f81 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:28.153965 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:28.165594 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ba5dc-4fce-4be8-bc8b-b589849d74a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:28.166333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ba5dc-4fce-4be8-bc8b-b589849d74a2 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:28.166552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ba5dc-4fce-4be8-bc8b-b589849d74a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:28.166831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ba5dc-4fce-4be8-bc8b-b589849d74a2 None admin] PATH_INFO: `/v3/projects/55db7688239a44558b89a14fd9fd420a` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:28.167988 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ba5dc-4fce-4be8-bc8b-b589849d74a2 None admin] RBAC: Authorizing `identity:get_project(project_id=55db7688239a44558b89a14fd9fd420a)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:28.169412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ba5dc-4fce-4be8-bc8b-b589849d74a2 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:28.171104 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 558/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:14:28 2022] GET /identity/v3/projects/55db7688239a44558b89a14fd9fd420a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:28.177224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b819a5d-658c-47b1-9c95-37c6cc9b7b05 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:28.275133 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b819a5d-658c-47b1-9c95-37c6cc9b7b05 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:28.308877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef1b37-aa44-4b43-963f-71147cba9fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:28.309566 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef1b37-aa44-4b43-963f-71147cba9fce None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:28.309854 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef1b37-aa44-4b43-963f-71147cba9fce None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:28.310130 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef1b37-aa44-4b43-963f-71147cba9fce None admin] PATH_INFO: `/v3/projects/55db7688239a44558b89a14fd9fd420a/users/576debc20c684275b655166ff29daab1/roles/07a2273f06f649d4a7f2117b3cf6b34d` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:28.312543 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef1b37-aa44-4b43-963f-71147cba9fce None admin] RBAC: Authorizing `identity:create_grant(project_id=55db7688239a44558b89a14fd9fd420a, user_id=576debc20c684275b655166ff29daab1, role_id=07a2273f06f649d4a7f2117b3cf6b34d)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:28.313995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef1b37-aa44-4b43-963f-71147cba9fce None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:28.389526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 565/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:14:28 2022] PUT /identity/v3/projects/55db7688239a44558b89a14fd9fd420a/users/576debc20c684275b655166ff29daab1/roles/07a2273f06f649d4a7f2117b3cf6b34d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:14:30.372759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207c28d-bb7a-4101-a7ff-9f8dd565bb8d None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:30.373276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207c28d-bb7a-4101-a7ff-9f8dd565bb8d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:30.373395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207c28d-bb7a-4101-a7ff-9f8dd565bb8d None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:30.374698 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 559/1124] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:30.380222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f09381-f0bd-4c05-a91b-cc6c9ddca5f5 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:30.380636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f09381-f0bd-4c05-a91b-cc6c9ddca5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:30.380771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f09381-f0bd-4c05-a91b-cc6c9ddca5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:30.398962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-76f09381-f0bd-4c05-a91b-cc6c9ddca5f5 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:30.400137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-76f09381-f0bd-4c05-a91b-cc6c9ddca5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:30.449095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:30.465457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 566/1125] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:30.488792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207c28d-bb7a-4101-a7ff-9f8dd565bb8d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:30.589146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207c28d-bb7a-4101-a7ff-9f8dd565bb8d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:30.622474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0b4be-0b62-4ae8-bef0-9b90895a4911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:30.623099 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0b4be-0b62-4ae8-bef0-9b90895a4911 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:30.623380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0b4be-0b62-4ae8-bef0-9b90895a4911 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:30.623655 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0b4be-0b62-4ae8-bef0-9b90895a4911 None admin] PATH_INFO: `/v3/roles/07a2273f06f649d4a7f2117b3cf6b34d` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:30.625100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0b4be-0b62-4ae8-bef0-9b90895a4911 None admin] RBAC: Authorizing `identity:get_role(role_id=07a2273f06f649d4a7f2117b3cf6b34d)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:30.626494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0b4be-0b62-4ae8-bef0-9b90895a4911 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:30.627820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 560/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:14:30 2022] GET /identity/v3/roles/07a2273f06f649d4a7f2117b3cf6b34d => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:30.634189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f09381-f0bd-4c05-a91b-cc6c9ddca5f5 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:30.730946 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f09381-f0bd-4c05-a91b-cc6c9ddca5f5 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:30.764518 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185790f-de1e-4e7a-b80a-2ea8d044de43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:30.765152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185790f-de1e-4e7a-b80a-2ea8d044de43 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:30.765435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185790f-de1e-4e7a-b80a-2ea8d044de43 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:30.765748 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185790f-de1e-4e7a-b80a-2ea8d044de43 None admin] PATH_INFO: `/v3/users/576debc20c684275b655166ff29daab1` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:30.766911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185790f-de1e-4e7a-b80a-2ea8d044de43 None admin] RBAC: Authorizing `identity:get_user(user_id=576debc20c684275b655166ff29daab1)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:30.768335 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185790f-de1e-4e7a-b80a-2ea8d044de43 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:30.769994 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 567/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:14:30 2022] GET /identity/v3/users/576debc20c684275b655166ff29daab1 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:30.775658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0b4be-0b62-4ae8-bef0-9b90895a4911 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:30.833368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:30.873514 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0b4be-0b62-4ae8-bef0-9b90895a4911 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:30.906439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6357d-20cd-430a-a330-a32db2e22fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:30.907044 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6357d-20cd-430a-a330-a32db2e22fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:30.907325 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6357d-20cd-430a-a330-a32db2e22fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:30.907600 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6357d-20cd-430a-a330-a32db2e22fb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:30.975224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6357d-20cd-430a-a330-a32db2e22fb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:30.976687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6357d-20cd-430a-a330-a32db2e22fb6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:31.030453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:31.072511 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 561/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:14:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:14:31.078417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185790f-de1e-4e7a-b80a-2ea8d044de43 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:31.133175 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:31.177388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185790f-de1e-4e7a-b80a-2ea8d044de43 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:31.210983 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf56cc-ea7a-40ef-8929-7e434ec55317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:31.211628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf56cc-ea7a-40ef-8929-7e434ec55317 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:31.211912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf56cc-ea7a-40ef-8929-7e434ec55317 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:31.212190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf56cc-ea7a-40ef-8929-7e434ec55317 None admin] PATH_INFO: `/v3/projects/55db7688239a44558b89a14fd9fd420a` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:31.213369 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf56cc-ea7a-40ef-8929-7e434ec55317 None admin] RBAC: Authorizing `identity:get_project(project_id=55db7688239a44558b89a14fd9fd420a)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:31.214823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf56cc-ea7a-40ef-8929-7e434ec55317 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:31.216477 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 568/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:14:31 2022] GET /identity/v3/projects/55db7688239a44558b89a14fd9fd420a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:31.223335 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6357d-20cd-430a-a330-a32db2e22fb6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:31.323534 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6357d-20cd-430a-a330-a32db2e22fb6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:31.357140 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4464a0-2a8f-4ccb-9282-eeb5f2753c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:31.357780 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4464a0-2a8f-4ccb-9282-eeb5f2753c26 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:31.358063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4464a0-2a8f-4ccb-9282-eeb5f2753c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:31.358339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4464a0-2a8f-4ccb-9282-eeb5f2753c26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:31.359119 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4464a0-2a8f-4ccb-9282-eeb5f2753c26 None admin] RBAC: Adding query filter params (role.id=07a2273f06f649d4a7f2117b3cf6b34d, scope.project.id=55db7688239a44558b89a14fd9fd420a, user.id=576debc20c684275b655166ff29daab1) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:31.359429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4464a0-2a8f-4ccb-9282-eeb5f2753c26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:31.360846 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4464a0-2a8f-4ccb-9282-eeb5f2753c26 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:31.366546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 562/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:14:31 2022] GET /identity/v3/role_assignments?user.id=576debc20c684275b655166ff29daab1&scope.project.id=55db7688239a44558b89a14fd9fd420a&role.id=07a2273f06f649d4a7f2117b3cf6b34d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:14:33.369644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b9810-3416-4424-a44a-c7554744a534 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:33.370150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b9810-3416-4424-a44a-c7554744a534 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:33.370236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b9810-3416-4424-a44a-c7554744a534 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:33.371550 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 569/1131] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:33.376697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fd0c0-9f80-42fe-9618-6067685417f6 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:33.377149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fd0c0-9f80-42fe-9618-6067685417f6 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:33.377252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fd0c0-9f80-42fe-9618-6067685417f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:33.396410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d92fd0c0-9f80-42fe-9618-6067685417f6 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:33.397626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d92fd0c0-9f80-42fe-9618-6067685417f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:33.414020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:33.463685 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 563/1132] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:33.486118 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b9810-3416-4424-a44a-c7554744a534 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:33.585325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b9810-3416-4424-a44a-c7554744a534 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:33.607096 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:33.618650 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd718cd-2d8b-48b5-9c9e-be9cbabc1fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:33.619282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd718cd-2d8b-48b5-9c9e-be9cbabc1fee None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:33.619567 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd718cd-2d8b-48b5-9c9e-be9cbabc1fee None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:33.619845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd718cd-2d8b-48b5-9c9e-be9cbabc1fee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:33.620991 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd718cd-2d8b-48b5-9c9e-be9cbabc1fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:33.622444 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd718cd-2d8b-48b5-9c9e-be9cbabc1fee None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:33.624039 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 570/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:33.630541 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fd0c0-9f80-42fe-9618-6067685417f6 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:33.728657 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fd0c0-9f80-42fe-9618-6067685417f6 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:33.760844 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6106eb-4520-459f-9f17-819e1284f3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:33.761462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6106eb-4520-459f-9f17-819e1284f3fe None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:33.761779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6106eb-4520-459f-9f17-819e1284f3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:33.762051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6106eb-4520-459f-9f17-819e1284f3fe None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:33.762738 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6106eb-4520-459f-9f17-819e1284f3fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:33.764141 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6106eb-4520-459f-9f17-819e1284f3fe None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:33.911791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 564/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jul 28 05:14:33 2022] POST /identity/v3/projects => generated 311 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:14:35.922094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde19310-0ba8-4484-ad26-d39567378904 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:35.922649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde19310-0ba8-4484-ad26-d39567378904 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:35.922649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde19310-0ba8-4484-ad26-d39567378904 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:35.924027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 571/1135] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:35.929832 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890c668-5e97-4f04-a4e8-738855d1201f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:35.930273 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890c668-5e97-4f04-a4e8-738855d1201f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:35.930391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890c668-5e97-4f04-a4e8-738855d1201f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:35.937896 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:35.949045 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c890c668-5e97-4f04-a4e8-738855d1201f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:35.950280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c890c668-5e97-4f04-a4e8-738855d1201f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:36.015986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 565/1136] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:36.040885 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde19310-0ba8-4484-ad26-d39567378904 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:36.140380 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde19310-0ba8-4484-ad26-d39567378904 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:36.174352 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08455b-bdae-47fe-8e9c-2b449260ceb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:36.174921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08455b-bdae-47fe-8e9c-2b449260ceb3 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:36.175201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08455b-bdae-47fe-8e9c-2b449260ceb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:36.175479 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08455b-bdae-47fe-8e9c-2b449260ceb3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:36.176752 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08455b-bdae-47fe-8e9c-2b449260ceb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:36.178929 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08455b-bdae-47fe-8e9c-2b449260ceb3 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:36.180509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 572/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:14:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:36.186626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890c668-5e97-4f04-a4e8-738855d1201f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:36.284808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890c668-5e97-4f04-a4e8-738855d1201f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:36.319121 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26154b0a-bafa-474d-9734-798e5f7a16a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:36.319750 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154b0a-bafa-474d-9734-798e5f7a16a5 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:36.320027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154b0a-bafa-474d-9734-798e5f7a16a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:36.320302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154b0a-bafa-474d-9734-798e5f7a16a5 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:36.320992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26154b0a-bafa-474d-9734-798e5f7a16a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:36.322457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26154b0a-bafa-474d-9734-798e5f7a16a5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:36.330240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:36.384734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 566/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:14:36 2022] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:14:38.413770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7550d1-e3d4-431b-9c5f-96604403498e None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:38.414311 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7550d1-e3d4-431b-9c5f-96604403498e None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:38.414311 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7550d1-e3d4-431b-9c5f-96604403498e None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:38.415658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 573/1139] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:38.420823 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb087763-a462-4af0-892f-534418c28e98 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:38.421230 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb087763-a462-4af0-892f-534418c28e98 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:38.421381 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb087763-a462-4af0-892f-534418c28e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:38.439759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-fb087763-a462-4af0-892f-534418c28e98 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:38.440958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fb087763-a462-4af0-892f-534418c28e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:38.507031 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 567/1140] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:38.529771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7550d1-e3d4-431b-9c5f-96604403498e None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:38.588398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:38.629235 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7550d1-e3d4-431b-9c5f-96604403498e None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:38.664417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f25e0c-b743-4105-ac7d-b8f959ed43f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:38.665054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f25e0c-b743-4105-ac7d-b8f959ed43f8 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:38.665334 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f25e0c-b743-4105-ac7d-b8f959ed43f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:38.665636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f25e0c-b743-4105-ac7d-b8f959ed43f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:38.675444 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f25e0c-b743-4105-ac7d-b8f959ed43f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:14:38.681071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-24f25e0c-b743-4105-ac7d-b8f959ed43f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:14:38.681071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:38.681071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:38.681071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:38.681071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:38.681071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:38.681071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:38.681071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:38.681071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:38.681071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:38.681071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:38.681071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:38.681071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:14:38.681071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:14:38.681071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:14:38.681071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:14:38.682271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:14:38.682271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:14:38.682271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:14:38.682271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:14:38.682271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:38.682271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:38.682271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:38.682271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:38.682271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:38.682271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:38.682271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:38.682271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:38.682271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:38.682271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:38.682271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:38.682271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:38.683160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:38.683160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:38.683160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:38.683160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:38.683160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:14:38.683160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:14:38.683160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:14:38.683160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:14:38.683160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:14:38.683160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:14:38.683160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:14:38.683160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:38.683160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 574/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:14:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:38.688650 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb087763-a462-4af0-892f-534418c28e98 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:38.785177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb087763-a462-4af0-892f-534418c28e98 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:38.804923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:38.819094 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1ec4c-cf83-4d59-ba79-f65364f33f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:38.819707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1ec4c-cf83-4d59-ba79-f65364f33f56 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:38.819990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1ec4c-cf83-4d59-ba79-f65364f33f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:38.820266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1ec4c-cf83-4d59-ba79-f65364f33f56 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:38.820978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1ec4c-cf83-4d59-ba79-f65364f33f56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:38.821285 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1ec4c-cf83-4d59-ba79-f65364f33f56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:38.822673 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1ec4c-cf83-4d59-ba79-f65364f33f56 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:38.830759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 568/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:14:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:38.836477 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f25e0c-b743-4105-ac7d-b8f959ed43f8 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:38.937382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f25e0c-b743-4105-ac7d-b8f959ed43f8 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:38.953917 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:38.970107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc77cab-eda8-411d-af29-d069e4f50269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:38.970740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc77cab-eda8-411d-af29-d069e4f50269 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:38.971022 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc77cab-eda8-411d-af29-d069e4f50269 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:38.971297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc77cab-eda8-411d-af29-d069e4f50269 None admin] PATH_INFO: `/v3/users/f85c0832be5c457d9b1c6a1ab204e232` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:38.984991 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc77cab-eda8-411d-af29-d069e4f50269 None admin] RBAC: Authorizing `identity:get_user(user_id=f85c0832be5c457d9b1c6a1ab204e232)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:38.986468 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc77cab-eda8-411d-af29-d069e4f50269 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:38.988084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 575/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:14:38 2022] GET /identity/v3/users/f85c0832be5c457d9b1c6a1ab204e232 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:38.994410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1ec4c-cf83-4d59-ba79-f65364f33f56 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:39.089506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1ec4c-cf83-4d59-ba79-f65364f33f56 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:39.121882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26363b28-0b8a-4ede-b662-0bce8d21ebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:39.122485 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26363b28-0b8a-4ede-b662-0bce8d21ebe0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:39.122760 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26363b28-0b8a-4ede-b662-0bce8d21ebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:39.123029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26363b28-0b8a-4ede-b662-0bce8d21ebe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:39.169167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:39.187509 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26363b28-0b8a-4ede-b662-0bce8d21ebe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:39.188915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26363b28-0b8a-4ede-b662-0bce8d21ebe0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:39.283908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 569/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:14:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:14:39.290133 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc77cab-eda8-411d-af29-d069e4f50269 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:39.387753 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc77cab-eda8-411d-af29-d069e4f50269 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:39.420097 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af5f49-d71c-4eaa-9744-7d3a014e45fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:39.420732 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af5f49-d71c-4eaa-9744-7d3a014e45fc None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:39.421014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af5f49-d71c-4eaa-9744-7d3a014e45fc None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:39.421292 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af5f49-d71c-4eaa-9744-7d3a014e45fc None admin] PATH_INFO: `/v3/projects/5331029f341e4ed6b0e07a8a8d5c1262` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:39.422465 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af5f49-d71c-4eaa-9744-7d3a014e45fc None admin] RBAC: Authorizing `identity:get_project(project_id=5331029f341e4ed6b0e07a8a8d5c1262)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:39.423878 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af5f49-d71c-4eaa-9744-7d3a014e45fc None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:39.425549 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 576/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:14:39 2022] GET /identity/v3/projects/5331029f341e4ed6b0e07a8a8d5c1262 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:39.432245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26363b28-0b8a-4ede-b662-0bce8d21ebe0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:39.511411 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:39.528906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26363b28-0b8a-4ede-b662-0bce8d21ebe0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:39.562708 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d0c78-3f5a-4e3e-af77-24dfd841d1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:39.563320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d0c78-3f5a-4e3e-af77-24dfd841d1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:39.563601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d0c78-3f5a-4e3e-af77-24dfd841d1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:39.563878 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d0c78-3f5a-4e3e-af77-24dfd841d1c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:39.564659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d0c78-3f5a-4e3e-af77-24dfd841d1c0 None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=5331029f341e4ed6b0e07a8a8d5c1262, user.id=f85c0832be5c457d9b1c6a1ab204e232) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:39.564972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d0c78-3f5a-4e3e-af77-24dfd841d1c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:39.566417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d0c78-3f5a-4e3e-af77-24dfd841d1c0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:39.572435 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 570/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:14:39 2022] GET /identity/v3/role_assignments?user.id=f85c0832be5c457d9b1c6a1ab204e232&scope.project.id=5331029f341e4ed6b0e07a8a8d5c1262&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:41.543587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36692d-20f3-4db3-a9a5-7d1257f98b58 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:41.544100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36692d-20f3-4db3-a9a5-7d1257f98b58 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:41.544205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36692d-20f3-4db3-a9a5-7d1257f98b58 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:41.545517 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 577/1147] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:41.550718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e65a7-9c1d-4fcd-896e-3bccd63fd5f5 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:41.551089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e65a7-9c1d-4fcd-896e-3bccd63fd5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:41.551275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e65a7-9c1d-4fcd-896e-3bccd63fd5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:41.570344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2e5e65a7-9c1d-4fcd-896e-3bccd63fd5f5 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:41.571533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2e5e65a7-9c1d-4fcd-896e-3bccd63fd5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:41.636491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 571/1148] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:41.658299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36692d-20f3-4db3-a9a5-7d1257f98b58 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:41.705125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:41.759487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36692d-20f3-4db3-a9a5-7d1257f98b58 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:41.793810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd779809-5476-4938-8c68-26cb06193d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:41.794383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd779809-5476-4938-8c68-26cb06193d30 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:41.794666 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd779809-5476-4938-8c68-26cb06193d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:41.794944 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd779809-5476-4938-8c68-26cb06193d30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:41.805513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd779809-5476-4938-8c68-26cb06193d30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:14:41.810411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-bd779809-5476-4938-8c68-26cb06193d30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:14:41.810411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:41.810411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:41.810411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:41.810411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:41.810411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:41.810411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:41.810411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:41.810411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:41.810411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:41.810411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:41.810411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:41.810411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:14:41.810411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:14:41.810411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:14:41.810411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:14:41.811513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:14:41.811513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:14:41.811513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:14:41.811513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:14:41.811513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:41.811513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:41.811513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:41.811513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:41.811513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:41.811513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:41.811513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:41.811513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:41.811513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:41.811513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:41.811513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:41.811513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:41.812822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:41.812822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:41.812822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:41.812822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:41.812822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:14:41.812822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:14:41.812822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:14:41.812822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:14:41.812822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:14:41.812822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:14:41.812822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:14:41.812822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:41.812822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 578/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:14:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:41.817890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e65a7-9c1d-4fcd-896e-3bccd63fd5f5 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:41.891668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:41.914118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e65a7-9c1d-4fcd-896e-3bccd63fd5f5 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:41.948581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118294b-d741-4bf9-8bf3-ef36929d2da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:41.949194 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118294b-d741-4bf9-8bf3-ef36929d2da6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:41.949498 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118294b-d741-4bf9-8bf3-ef36929d2da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:41.949782 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118294b-d741-4bf9-8bf3-ef36929d2da6 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:41.950494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118294b-d741-4bf9-8bf3-ef36929d2da6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:41.950801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118294b-d741-4bf9-8bf3-ef36929d2da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:41.952197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118294b-d741-4bf9-8bf3-ef36929d2da6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:41.960001 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 572/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:14:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:41.965785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd779809-5476-4938-8c68-26cb06193d30 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:42.063649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd779809-5476-4938-8c68-26cb06193d30 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:42.065885 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:42.096685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564f852-93bd-4f1b-abd2-de86bbe5ac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:42.097318 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564f852-93bd-4f1b-abd2-de86bbe5ac0d None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:42.097630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564f852-93bd-4f1b-abd2-de86bbe5ac0d None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:42.097907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564f852-93bd-4f1b-abd2-de86bbe5ac0d None admin] PATH_INFO: `/v3/users/f85c0832be5c457d9b1c6a1ab204e232` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:42.099655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564f852-93bd-4f1b-abd2-de86bbe5ac0d None admin] RBAC: Authorizing `identity:get_user(user_id=f85c0832be5c457d9b1c6a1ab204e232)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:42.101108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564f852-93bd-4f1b-abd2-de86bbe5ac0d None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:42.102738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 579/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:14:41 2022] GET /identity/v3/users/f85c0832be5c457d9b1c6a1ab204e232 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:42.108501 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118294b-d741-4bf9-8bf3-ef36929d2da6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:42.213234 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118294b-d741-4bf9-8bf3-ef36929d2da6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:42.248578 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509d77e-0602-42cd-b7f0-0cf0645f448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:42.249720 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509d77e-0602-42cd-b7f0-0cf0645f448d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:42.250002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509d77e-0602-42cd-b7f0-0cf0645f448d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:42.250276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509d77e-0602-42cd-b7f0-0cf0645f448d None admin] PATH_INFO: `/v3/projects/5331029f341e4ed6b0e07a8a8d5c1262` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:42.251441 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509d77e-0602-42cd-b7f0-0cf0645f448d None admin] RBAC: Authorizing `identity:get_project(project_id=5331029f341e4ed6b0e07a8a8d5c1262)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:42.252866 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509d77e-0602-42cd-b7f0-0cf0645f448d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:42.254558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 573/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:14:42 2022] GET /identity/v3/projects/5331029f341e4ed6b0e07a8a8d5c1262 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:42.261048 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564f852-93bd-4f1b-abd2-de86bbe5ac0d None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:42.361267 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564f852-93bd-4f1b-abd2-de86bbe5ac0d None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:42.394724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6211235-4611-4cc0-b557-a38115ec843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:42.395396 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6211235-4611-4cc0-b557-a38115ec843b None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:42.396210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6211235-4611-4cc0-b557-a38115ec843b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:42.396482 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6211235-4611-4cc0-b557-a38115ec843b None admin] PATH_INFO: `/v3/projects/5331029f341e4ed6b0e07a8a8d5c1262/users/f85c0832be5c457d9b1c6a1ab204e232/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:42.398425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6211235-4611-4cc0-b557-a38115ec843b None admin] RBAC: Authorizing `identity:create_grant(project_id=5331029f341e4ed6b0e07a8a8d5c1262, user_id=f85c0832be5c457d9b1c6a1ab204e232, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:42.399849 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6211235-4611-4cc0-b557-a38115ec843b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:42.510450 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 580/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:14:42 2022] PUT /identity/v3/projects/5331029f341e4ed6b0e07a8a8d5c1262/users/f85c0832be5c457d9b1c6a1ab204e232/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:14:44.588273 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6932eda-54c0-486b-a274-378cd852e88e None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:44.588823 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6932eda-54c0-486b-a274-378cd852e88e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:44.588823 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6932eda-54c0-486b-a274-378cd852e88e None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:44.590198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 574/1154] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:44.595242 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eeec67-07c7-44a9-9cd4-051d9e38f43d None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:44.595674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eeec67-07c7-44a9-9cd4-051d9e38f43d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:44.595808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eeec67-07c7-44a9-9cd4-051d9e38f43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:44.613556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-53eeec67-07c7-44a9-9cd4-051d9e38f43d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:44.615500 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-53eeec67-07c7-44a9-9cd4-051d9e38f43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:44.641281 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:44.682185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 581/1155] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:44.706266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6932eda-54c0-486b-a274-378cd852e88e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:44.715677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:44.806223 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6932eda-54c0-486b-a274-378cd852e88e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:44.839404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec755d-94bc-42de-a766-586ddc26a1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:44.839983 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec755d-94bc-42de-a766-586ddc26a1ec None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:44.840268 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec755d-94bc-42de-a766-586ddc26a1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:44.840570 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec755d-94bc-42de-a766-586ddc26a1ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:44.851999 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec755d-94bc-42de-a766-586ddc26a1ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:14:44.856971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-27ec755d-94bc-42de-a766-586ddc26a1ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:14:44.856971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:44.856971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:44.856971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:44.856971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:44.856971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:44.856971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:44.856971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:44.856971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:44.856971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:44.856971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:44.856971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:44.856971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:14:44.856971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:14:44.856971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:14:44.856971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:14:44.858086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:14:44.858086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:14:44.858086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:14:44.858086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:14:44.858086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:44.858086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:44.858086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:44.858086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:44.858086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:44.858086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:44.858086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:44.858086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:44.858086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:44.858086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:44.858086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:44.858086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:44.859275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:44.859275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:44.859275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:44.859275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:44.859275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:14:44.859275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:14:44.859275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:14:44.859275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:14:44.859275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:14:44.859275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:14:44.859275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:14:44.859275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:44.859275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 575/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:14:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:44.864857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eeec67-07c7-44a9-9cd4-051d9e38f43d None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:44.962977 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eeec67-07c7-44a9-9cd4-051d9e38f43d None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:44.996553 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2df51-a1bd-4cc1-b7f5-5e67d9a18bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:44.997163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2df51-a1bd-4cc1-b7f5-5e67d9a18bbb None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:44.997450 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2df51-a1bd-4cc1-b7f5-5e67d9a18bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:44.997756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2df51-a1bd-4cc1-b7f5-5e67d9a18bbb None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:44.998460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2df51-a1bd-4cc1-b7f5-5e67d9a18bbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:44.998764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2df51-a1bd-4cc1-b7f5-5e67d9a18bbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:45.000119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2df51-a1bd-4cc1-b7f5-5e67d9a18bbb None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:45.007947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 582/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:14:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:45.013676 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec755d-94bc-42de-a766-586ddc26a1ec None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:45.077912 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:45.112029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec755d-94bc-42de-a766-586ddc26a1ec None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:45.144745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c4846-c4e2-4e1b-8002-18bf671b7a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:45.145377 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c4846-c4e2-4e1b-8002-18bf671b7a5b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:45.146022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c4846-c4e2-4e1b-8002-18bf671b7a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:45.146304 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c4846-c4e2-4e1b-8002-18bf671b7a5b None admin] PATH_INFO: `/v3/users/f85c0832be5c457d9b1c6a1ab204e232` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:45.147468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c4846-c4e2-4e1b-8002-18bf671b7a5b None admin] RBAC: Authorizing `identity:get_user(user_id=f85c0832be5c457d9b1c6a1ab204e232)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:45.148891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c4846-c4e2-4e1b-8002-18bf671b7a5b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:45.150510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 576/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:14:45 2022] GET /identity/v3/users/f85c0832be5c457d9b1c6a1ab204e232 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:45.156321 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2df51-a1bd-4cc1-b7f5-5e67d9a18bbb None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:45.183099 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:45.256203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2df51-a1bd-4cc1-b7f5-5e67d9a18bbb None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:45.289167 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e92cc-194f-4333-8177-7e6f60380f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:45.289813 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e92cc-194f-4333-8177-7e6f60380f71 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:45.290097 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e92cc-194f-4333-8177-7e6f60380f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:45.290374 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e92cc-194f-4333-8177-7e6f60380f71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:45.355413 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e92cc-194f-4333-8177-7e6f60380f71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:45.356835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e92cc-194f-4333-8177-7e6f60380f71 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:45.381001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:45.453130 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 583/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:14:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:14:45.459327 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c4846-c4e2-4e1b-8002-18bf671b7a5b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:45.556311 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c4846-c4e2-4e1b-8002-18bf671b7a5b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:45.589481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc978275-c691-47f1-9120-7205f95a32b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:45.590125 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc978275-c691-47f1-9120-7205f95a32b9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:45.590405 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc978275-c691-47f1-9120-7205f95a32b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:45.590681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc978275-c691-47f1-9120-7205f95a32b9 None admin] PATH_INFO: `/v3/projects/5331029f341e4ed6b0e07a8a8d5c1262` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:45.591830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc978275-c691-47f1-9120-7205f95a32b9 None admin] RBAC: Authorizing `identity:get_project(project_id=5331029f341e4ed6b0e07a8a8d5c1262)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:45.593271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc978275-c691-47f1-9120-7205f95a32b9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:45.594946 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 577/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:14:45 2022] GET /identity/v3/projects/5331029f341e4ed6b0e07a8a8d5c1262 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:45.601579 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e92cc-194f-4333-8177-7e6f60380f71 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:45.698704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e92cc-194f-4333-8177-7e6f60380f71 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:45.721522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:45.731914 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da318260-0a39-407a-933d-3a578ddbfb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:45.738015 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da318260-0a39-407a-933d-3a578ddbfb9c None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:45.738015 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da318260-0a39-407a-933d-3a578ddbfb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:45.738015 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da318260-0a39-407a-933d-3a578ddbfb9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:45.738015 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da318260-0a39-407a-933d-3a578ddbfb9c None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=5331029f341e4ed6b0e07a8a8d5c1262, user.id=f85c0832be5c457d9b1c6a1ab204e232) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:45.738015 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da318260-0a39-407a-933d-3a578ddbfb9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:45.738015 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da318260-0a39-407a-933d-3a578ddbfb9c None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:45.741284 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 584/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:14:45 2022] GET /identity/v3/role_assignments?user.id=f85c0832be5c457d9b1c6a1ab204e232&scope.project.id=5331029f341e4ed6b0e07a8a8d5c1262&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:47.723219 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70269d94-6379-4e06-97db-b4547fd9f3f0 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:47.724380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70269d94-6379-4e06-97db-b4547fd9f3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:47.724475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70269d94-6379-4e06-97db-b4547fd9f3f0 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:47.725808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 578/1162] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:14:47.730828 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ad8f1-4d28-4ad4-8e73-b08c65c85eee None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:47.731228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ad8f1-4d28-4ad4-8e73-b08c65c85eee None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:47.731373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ad8f1-4d28-4ad4-8e73-b08c65c85eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:47.749607 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-1b6ad8f1-4d28-4ad4-8e73-b08c65c85eee None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:47.750775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-1b6ad8f1-4d28-4ad4-8e73-b08c65c85eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:47.815861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 585/1163] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:47.837932 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70269d94-6379-4e06-97db-b4547fd9f3f0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:47.840786 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:47.946029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70269d94-6379-4e06-97db-b4547fd9f3f0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:47.978608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec54ba-fc67-4870-b2db-8aff4c8c1e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:47.979163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec54ba-fc67-4870-b2db-8aff4c8c1e07 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:47.979442 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec54ba-fc67-4870-b2db-8aff4c8c1e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:47.979717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec54ba-fc67-4870-b2db-8aff4c8c1e07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:48.045149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec54ba-fc67-4870-b2db-8aff4c8c1e07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:48.046606 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec54ba-fc67-4870-b2db-8aff4c8c1e07 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:48.048339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:48.143331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 579/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:14:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:14:48.150677 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ad8f1-4d28-4ad4-8e73-b08c65c85eee None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:48.249157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ad8f1-4d28-4ad4-8e73-b08c65c85eee None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:48.266752 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:48.283034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706cf77-b6dc-4f89-804f-9704dade7451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:48.283675 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706cf77-b6dc-4f89-804f-9704dade7451 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:48.283952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706cf77-b6dc-4f89-804f-9704dade7451 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:48.284226 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706cf77-b6dc-4f89-804f-9704dade7451 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:48.290947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706cf77-b6dc-4f89-804f-9704dade7451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:48.292382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706cf77-b6dc-4f89-804f-9704dade7451 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-9706cf77-b6dc-4f89-804f-9704dade7451 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:48.304687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:48.305922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:48.305922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:48.305922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:48.305922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:48.305922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:48.305922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:48.305922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:14:48.305922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:14:48.305922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:14:48.305922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:14:48.305922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:48.305922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:48.305922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:48.305922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:48.305922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:48.305922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:48.306950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:48.306950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:48.306950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:48.306950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:48.306950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:48.306950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:48.306950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:48.306950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:48.306950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:48.306950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:48.306950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 05:14:48.306950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:14:48.306950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 05:14:48.306950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:14:48.306950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 586/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jul 28 05:14:48 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:48.312133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec54ba-fc67-4870-b2db-8aff4c8c1e07 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:48.406833 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec54ba-fc67-4870-b2db-8aff4c8c1e07 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:48.408298 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:48.440337 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f6cba-b76b-4095-9519-7c626396e0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:48.440949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f6cba-b76b-4095-9519-7c626396e0fd None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:48.441231 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f6cba-b76b-4095-9519-7c626396e0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:48.441532 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f6cba-b76b-4095-9519-7c626396e0fd None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:48.442896 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f6cba-b76b-4095-9519-7c626396e0fd None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:48.443256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f6cba-b76b-4095-9519-7c626396e0fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:48.444606 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f6cba-b76b-4095-9519-7c626396e0fd None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:48.451858 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 580/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jul 28 05:14:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:50.427253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956de5d-a30b-4a9d-aea3-7e83cc242e7d None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:50.427770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956de5d-a30b-4a9d-aea3-7e83cc242e7d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:50.427881 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956de5d-a30b-4a9d-aea3-7e83cc242e7d None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:50.429165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 587/1167] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:50.434411 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9c307-d580-4ac2-aa02-cdefe8a78b65 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:50.434795 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9c307-d580-4ac2-aa02-cdefe8a78b65 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:50.434973 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9c307-d580-4ac2-aa02-cdefe8a78b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:50.453374 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e6b9c307-d580-4ac2-aa02-cdefe8a78b65 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:50.454584 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e6b9c307-d580-4ac2-aa02-cdefe8a78b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:50.519152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 581/1168] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:50.541086 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956de5d-a30b-4a9d-aea3-7e83cc242e7d None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:50.639893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956de5d-a30b-4a9d-aea3-7e83cc242e7d None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:50.671636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f96d31-93f3-4a35-a48e-095dabac4238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:50.672233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f96d31-93f3-4a35-a48e-095dabac4238 None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:50.672513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f96d31-93f3-4a35-a48e-095dabac4238 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:50.672785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f96d31-93f3-4a35-a48e-095dabac4238 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:50.673509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f96d31-93f3-4a35-a48e-095dabac4238 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:50.674856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f96d31-93f3-4a35-a48e-095dabac4238 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:50.802538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 588/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Thu Jul 28 05:14:50 2022] POST /identity/v3/domains => generated 267 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:14:52.818629 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a5bb8-7074-4f0c-80a7-50e763053094 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:52.819158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a5bb8-7074-4f0c-80a7-50e763053094 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:52.819158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a5bb8-7074-4f0c-80a7-50e763053094 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:52.820539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 582/1170] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:52.825718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e98fa-f224-4486-bd71-74d9ce63b95e None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:52.826136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e98fa-f224-4486-bd71-74d9ce63b95e None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:52.826310 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e98fa-f224-4486-bd71-74d9ce63b95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:52.844174 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-443e98fa-f224-4486-bd71-74d9ce63b95e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:52.845342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-443e98fa-f224-4486-bd71-74d9ce63b95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:52.874028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:52.910132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 589/1171] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:52.933692 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a5bb8-7074-4f0c-80a7-50e763053094 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:53.027433 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:53.033866 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a5bb8-7074-4f0c-80a7-50e763053094 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:53.069518 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dd3f4-d651-4167-9c3b-155ecf77dc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:53.070100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dd3f4-d651-4167-9c3b-155ecf77dc7a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:53.070383 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dd3f4-d651-4167-9c3b-155ecf77dc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:53.070664 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dd3f4-d651-4167-9c3b-155ecf77dc7a None admin] PATH_INFO: `/v3/domains/d25ba04442624ff3b7303d17c481d357` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:53.080766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dd3f4-d651-4167-9c3b-155ecf77dc7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=d25ba04442624ff3b7303d17c481d357)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:53.082238 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dd3f4-d651-4167-9c3b-155ecf77dc7a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:53.084047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 583/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Thu Jul 28 05:14:52 2022] GET /identity/v3/domains/d25ba04442624ff3b7303d17c481d357 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:53.089872 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e98fa-f224-4486-bd71-74d9ce63b95e None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:53.187285 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e98fa-f224-4486-bd71-74d9ce63b95e None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:53.220765 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed4662-e1b0-4196-a4ba-8592fbd664cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:53.221369 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed4662-e1b0-4196-a4ba-8592fbd664cf None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:53.221897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed4662-e1b0-4196-a4ba-8592fbd664cf None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:53.222177 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed4662-e1b0-4196-a4ba-8592fbd664cf None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:53.222863 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed4662-e1b0-4196-a4ba-8592fbd664cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:53.224405 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed4662-e1b0-4196-a4ba-8592fbd664cf None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:53.310688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 590/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jul 28 05:14:53 2022] POST /identity/v3/projects => generated 361 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:14:55.331582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb3f2-6e30-4b5d-b7a7-9e09cd06b392 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:55.332111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb3f2-6e30-4b5d-b7a7-9e09cd06b392 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:55.332111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb3f2-6e30-4b5d-b7a7-9e09cd06b392 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:55.333573 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 584/1174] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:55.338884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aff57c-9937-447e-aa7e-af1cd86a8ad1 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:55.339323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aff57c-9937-447e-aa7e-af1cd86a8ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:55.339507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aff57c-9937-447e-aa7e-af1cd86a8ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:55.358187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-00aff57c-9937-447e-aa7e-af1cd86a8ad1 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:55.359355 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-00aff57c-9937-447e-aa7e-af1cd86a8ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:55.373435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:55.424121 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 591/1175] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:55.449223 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb3f2-6e30-4b5d-b7a7-9e09cd06b392 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:55.549690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb3f2-6e30-4b5d-b7a7-9e09cd06b392 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:55.582218 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d4dab-cdb2-4447-9475-449cc59f5130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:55.583452 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d4dab-cdb2-4447-9475-449cc59f5130 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:55.583813 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d4dab-cdb2-4447-9475-449cc59f5130 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:55.584092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d4dab-cdb2-4447-9475-449cc59f5130 None admin] PATH_INFO: `/v3/domains/d25ba04442624ff3b7303d17c481d357` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:55.585236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d4dab-cdb2-4447-9475-449cc59f5130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d25ba04442624ff3b7303d17c481d357)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:55.586680 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d4dab-cdb2-4447-9475-449cc59f5130 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:55.588256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 585/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Thu Jul 28 05:14:55 2022] GET /identity/v3/domains/d25ba04442624ff3b7303d17c481d357 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:55.593978 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aff57c-9937-447e-aa7e-af1cd86a8ad1 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:55.688322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aff57c-9937-447e-aa7e-af1cd86a8ad1 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:55.721209 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def38cd-3e6f-4f16-9f52-f119392eed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:55.721834 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def38cd-3e6f-4f16-9f52-f119392eed58 None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:55.722111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def38cd-3e6f-4f16-9f52-f119392eed58 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:55.722402 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def38cd-3e6f-4f16-9f52-f119392eed58 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:55.723078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def38cd-3e6f-4f16-9f52-f119392eed58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:55.724632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def38cd-3e6f-4f16-9f52-f119392eed58 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:55.800658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 592/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:14:55 2022] POST /identity/v3/users => generated 311 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:14:57.832367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89959d-5fa2-48f7-a70a-fc29ffd5a093 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:57.832934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89959d-5fa2-48f7-a70a-fc29ffd5a093 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:57.832934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89959d-5fa2-48f7-a70a-fc29ffd5a093 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:57.834310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 586/1178] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:14:57.839887 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae613fd3-5de1-413c-882c-cd83edbcb5fb None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:57.840300 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae613fd3-5de1-413c-882c-cd83edbcb5fb None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:57.840438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae613fd3-5de1-413c-882c-cd83edbcb5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:57.853017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:57.858239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-ae613fd3-5de1-413c-882c-cd83edbcb5fb None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:14:57.859418 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ae613fd3-5de1-413c-882c-cd83edbcb5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:14:57.925773 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 593/1179] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:14:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:14:57.949375 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89959d-5fa2-48f7-a70a-fc29ffd5a093 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:57.975111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:58.048989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89959d-5fa2-48f7-a70a-fc29ffd5a093 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:58.081806 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b39b91-74ee-46a3-95d4-e700830a8fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:58.082483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b39b91-74ee-46a3-95d4-e700830a8fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:58.082709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b39b91-74ee-46a3-95d4-e700830a8fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:58.083008 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b39b91-74ee-46a3-95d4-e700830a8fc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:58.093037 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b39b91-74ee-46a3-95d4-e700830a8fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:14:58.097883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-36b39b91-74ee-46a3-95d4-e700830a8fc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:14:58.097883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:14:58.097883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:14:58.097883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:14:58.097883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:14:58.097883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:14:58.097883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:14:58.097883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:14:58.097883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:14:58.097883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:14:58.097883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:14:58.097883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:14:58.097883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:14:58.097883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:14:58.097883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:14:58.097883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:14:58.099153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:14:58.099153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:14:58.099153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:14:58.099153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:14:58.099153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:14:58.099153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:14:58.099153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:14:58.099153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:14:58.099153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:14:58.099153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:14:58.099153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:14:58.099153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:14:58.099153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:14:58.099153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:14:58.099153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:14:58.099153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:14:58.099978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:14:58.099978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:14:58.099978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:14:58.099978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:14:58.099978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:14:58.099978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:14:58.099978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:14:58.099978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:14:58.099978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:14:58.099978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:14:58.099978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:14:58.099978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:14:58.099978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 587/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:14:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:14:58.105075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae613fd3-5de1-413c-882c-cd83edbcb5fb None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:58.202332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae613fd3-5de1-413c-882c-cd83edbcb5fb None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:58.234510 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620431a2-98c5-4710-8de0-d0f522e0ae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:58.235115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620431a2-98c5-4710-8de0-d0f522e0ae43 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:58.235393 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620431a2-98c5-4710-8de0-d0f522e0ae43 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:58.235663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620431a2-98c5-4710-8de0-d0f522e0ae43 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:58.236360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620431a2-98c5-4710-8de0-d0f522e0ae43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:58.236661 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620431a2-98c5-4710-8de0-d0f522e0ae43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:58.238044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620431a2-98c5-4710-8de0-d0f522e0ae43 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:58.240687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:58.247849 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 594/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:14:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:58.262680 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b39b91-74ee-46a3-95d4-e700830a8fc1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:58.337906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:58.353256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b39b91-74ee-46a3-95d4-e700830a8fc1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:58.385403 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8002e0-aa96-4678-b7be-664d1175a2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:58.386066 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8002e0-aa96-4678-b7be-664d1175a2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:58.386346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8002e0-aa96-4678-b7be-664d1175a2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:58.386617 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8002e0-aa96-4678-b7be-664d1175a2d5 None admin] PATH_INFO: `/v3/users/e6866fcc433e4759b7fb92cf6fc0e573` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:58.399065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8002e0-aa96-4678-b7be-664d1175a2d5 None admin] RBAC: Authorizing `identity:get_user(user_id=e6866fcc433e4759b7fb92cf6fc0e573)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:58.400479 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8002e0-aa96-4678-b7be-664d1175a2d5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:58.402096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 588/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:14:58 2022] GET /identity/v3/users/e6866fcc433e4759b7fb92cf6fc0e573 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:58.407825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620431a2-98c5-4710-8de0-d0f522e0ae43 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:58.503880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620431a2-98c5-4710-8de0-d0f522e0ae43 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:58.535250 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e88cb-2681-43d7-a85a-cf8a23394351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:58.536382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e88cb-2681-43d7-a85a-cf8a23394351 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:58.536666 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e88cb-2681-43d7-a85a-cf8a23394351 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:58.536935 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e88cb-2681-43d7-a85a-cf8a23394351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:58.599001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:58.602300 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e88cb-2681-43d7-a85a-cf8a23394351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:58.603740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e88cb-2681-43d7-a85a-cf8a23394351 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:58.699948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 595/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:14:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:14:58.705802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8002e0-aa96-4678-b7be-664d1175a2d5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:58.803710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8002e0-aa96-4678-b7be-664d1175a2d5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:58.838002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca399dc-0c49-40de-9397-b35b2b52275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:58.838625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca399dc-0c49-40de-9397-b35b2b52275f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:58.838898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca399dc-0c49-40de-9397-b35b2b52275f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:58.839175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca399dc-0c49-40de-9397-b35b2b52275f None admin] PATH_INFO: `/v3/projects/5dcd7808c86d45e8a698b1e2dfe90bd6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:58.840318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca399dc-0c49-40de-9397-b35b2b52275f None admin] RBAC: Authorizing `identity:get_project(project_id=5dcd7808c86d45e8a698b1e2dfe90bd6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:58.841766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca399dc-0c49-40de-9397-b35b2b52275f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:58.843408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 589/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:14:58 2022] GET /identity/v3/projects/5dcd7808c86d45e8a698b1e2dfe90bd6 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:14:58.850145 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e88cb-2681-43d7-a85a-cf8a23394351 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:14:58.942097 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:14:58.945807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e88cb-2681-43d7-a85a-cf8a23394351 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:14:58.979661 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6631c29-757b-4621-be6f-50182e51af95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:14:58.980275 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6631c29-757b-4621-be6f-50182e51af95 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:14:58.980558 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6631c29-757b-4621-be6f-50182e51af95 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:14:58.980837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6631c29-757b-4621-be6f-50182e51af95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:14:58.981650 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6631c29-757b-4621-be6f-50182e51af95 None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=5dcd7808c86d45e8a698b1e2dfe90bd6, user.id=e6866fcc433e4759b7fb92cf6fc0e573) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:14:58.981969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6631c29-757b-4621-be6f-50182e51af95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:14:58.983388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6631c29-757b-4621-be6f-50182e51af95 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:14:58.988695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 596/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:14:58 2022] GET /identity/v3/role_assignments?user.id=e6866fcc433e4759b7fb92cf6fc0e573&scope.project.id=5dcd7808c86d45e8a698b1e2dfe90bd6&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:15:00.941693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdabcb-39b1-4a4e-8c4e-3a0e3f8a9c33 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:15:00.942445 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdabcb-39b1-4a4e-8c4e-3a0e3f8a9c33 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:15:00.942445 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdabcb-39b1-4a4e-8c4e-3a0e3f8a9c33 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:15:00.943600 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 590/1186] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:15:00.948624 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e50c1-60f4-46dc-b3e9-369406b6e84e None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:15:00.949041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e50c1-60f4-46dc-b3e9-369406b6e84e None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:15:00.949178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e50c1-60f4-46dc-b3e9-369406b6e84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:15:00.967489 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-5a7e50c1-60f4-46dc-b3e9-369406b6e84e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:15:00.968715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5a7e50c1-60f4-46dc-b3e9-369406b6e84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:15:01.033475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 597/1187] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:15:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:15:01.056463 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdabcb-39b1-4a4e-8c4e-3a0e3f8a9c33 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:15:01.068945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:15:01.155579 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdabcb-39b1-4a4e-8c4e-3a0e3f8a9c33 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:15:01.188423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84bf01-4db1-4c9e-8dcf-31f728bb171b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:15:01.189052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84bf01-4db1-4c9e-8dcf-31f728bb171b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:15:01.189329 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84bf01-4db1-4c9e-8dcf-31f728bb171b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:15:01.189633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84bf01-4db1-4c9e-8dcf-31f728bb171b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:15:01.199648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84bf01-4db1-4c9e-8dcf-31f728bb171b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:15:01.204506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-dd84bf01-4db1-4c9e-8dcf-31f728bb171b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:15:01.204506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:15:01.204506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:15:01.204506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:15:01.204506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:15:01.204506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:15:01.204506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:15:01.204506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:15:01.204506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:15:01.204506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:15:01.204506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:15:01.204506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:15:01.204506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:15:01.204506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:15:01.204506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:15:01.204506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:15:01.205712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:15:01.205712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:15:01.205712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:15:01.205712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:15:01.205712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:15:01.205712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:15:01.205712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:15:01.205712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:15:01.205712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:15:01.205712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:15:01.205712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:15:01.205712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:15:01.205712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:15:01.205712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:15:01.205712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:15:01.205712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:15:01.206827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:15:01.206827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:15:01.206827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:15:01.206827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:15:01.206827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:15:01.206827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:15:01.206827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:15:01.206827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:15:01.206827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:15:01.206827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:15:01.206827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:15:01.206827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:15:01.206827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 591/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:15:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:15:01.212496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e50c1-60f4-46dc-b3e9-369406b6e84e None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:15:01.300960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:15:01.309563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e50c1-60f4-46dc-b3e9-369406b6e84e None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:15:01.343202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b22e57-459b-42f8-bdcd-71fc50258f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:15:01.343817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b22e57-459b-42f8-bdcd-71fc50258f9a None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:15:01.344098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b22e57-459b-42f8-bdcd-71fc50258f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:15:01.344373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b22e57-459b-42f8-bdcd-71fc50258f9a None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:15:01.345080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b22e57-459b-42f8-bdcd-71fc50258f9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:15:01.345387 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b22e57-459b-42f8-bdcd-71fc50258f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:15:01.346775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b22e57-459b-42f8-bdcd-71fc50258f9a None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:15:01.355310 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 598/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:15:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:15:01.361052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84bf01-4db1-4c9e-8dcf-31f728bb171b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:15:01.428288 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:15:01.458856 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84bf01-4db1-4c9e-8dcf-31f728bb171b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:15:01.491319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eb57c-f058-43ba-9ca3-f535891397ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:15:01.491951 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eb57c-f058-43ba-9ca3-f535891397ec None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:15:01.492232 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eb57c-f058-43ba-9ca3-f535891397ec None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:15:01.492508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eb57c-f058-43ba-9ca3-f535891397ec None admin] PATH_INFO: `/v3/users/e6866fcc433e4759b7fb92cf6fc0e573` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:15:01.493683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2eb57c-f058-43ba-9ca3-f535891397ec None admin] RBAC: Authorizing `identity:get_user(user_id=e6866fcc433e4759b7fb92cf6fc0e573)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:15:01.495101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2eb57c-f058-43ba-9ca3-f535891397ec None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:15:01.496676 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 592/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:15:01 2022] GET /identity/v3/users/e6866fcc433e4759b7fb92cf6fc0e573 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:15:01.502335 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b22e57-459b-42f8-bdcd-71fc50258f9a None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:15:01.601065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b22e57-459b-42f8-bdcd-71fc50258f9a None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:15:01.633955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b506c4a-3175-4953-96bd-908d2f9c4e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:15:01.634799 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b506c4a-3175-4953-96bd-908d2f9c4e64 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:15:01.635083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b506c4a-3175-4953-96bd-908d2f9c4e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:15:01.635358 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b506c4a-3175-4953-96bd-908d2f9c4e64 None admin] PATH_INFO: `/v3/projects/5dcd7808c86d45e8a698b1e2dfe90bd6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:15:01.636518 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b506c4a-3175-4953-96bd-908d2f9c4e64 None admin] RBAC: Authorizing `identity:get_project(project_id=5dcd7808c86d45e8a698b1e2dfe90bd6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:15:01.638408 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b506c4a-3175-4953-96bd-908d2f9c4e64 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:15:01.640036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 599/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:15:01 2022] GET /identity/v3/projects/5dcd7808c86d45e8a698b1e2dfe90bd6 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:15:01.646508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eb57c-f058-43ba-9ca3-f535891397ec None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:15:01.743496 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eb57c-f058-43ba-9ca3-f535891397ec None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:15:01.775868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370760c1-eb1c-4602-a475-43a7715c6a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:15:01.776533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370760c1-eb1c-4602-a475-43a7715c6a75 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:15:01.776811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370760c1-eb1c-4602-a475-43a7715c6a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:15:01.777085 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370760c1-eb1c-4602-a475-43a7715c6a75 None admin] PATH_INFO: `/v3/projects/5dcd7808c86d45e8a698b1e2dfe90bd6/users/e6866fcc433e4759b7fb92cf6fc0e573/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:15:01.779363 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370760c1-eb1c-4602-a475-43a7715c6a75 None admin] RBAC: Authorizing `identity:create_grant(project_id=5dcd7808c86d45e8a698b1e2dfe90bd6, user_id=e6866fcc433e4759b7fb92cf6fc0e573, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:15:01.784215 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370760c1-eb1c-4602-a475-43a7715c6a75 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:15:01.852832 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:15:01.858074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 593/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:15:01 2022] PUT /identity/v3/projects/5dcd7808c86d45e8a698b1e2dfe90bd6/users/e6866fcc433e4759b7fb92cf6fc0e573/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:15:03.833228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8480b-ab6c-4dfd-a5f0-ff63dfabec19 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:15:03.833839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8480b-ab6c-4dfd-a5f0-ff63dfabec19 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:15:03.833839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8480b-ab6c-4dfd-a5f0-ff63dfabec19 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:15:03.835154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 600/1193] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:15:03.840214 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d052e3d-f63a-481c-ac27-68c2f7cdace0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:15:03.840591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d052e3d-f63a-481c-ac27-68c2f7cdace0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:15:03.840770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d052e3d-f63a-481c-ac27-68c2f7cdace0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:15:03.858580 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6d052e3d-f63a-481c-ac27-68c2f7cdace0 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:15:03.859766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6d052e3d-f63a-481c-ac27-68c2f7cdace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:15:03.924785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 594/1194] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:15:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:15:03.950108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8480b-ab6c-4dfd-a5f0-ff63dfabec19 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:15:03.975259 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:15:04.052125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8480b-ab6c-4dfd-a5f0-ff63dfabec19 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:15:04.085005 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446da046-7ed1-4434-88fb-0006b624f3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:15:04.085608 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446da046-7ed1-4434-88fb-0006b624f3be None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:15:04.085897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446da046-7ed1-4434-88fb-0006b624f3be None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:15:04.086176 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446da046-7ed1-4434-88fb-0006b624f3be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:15:04.096416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446da046-7ed1-4434-88fb-0006b624f3be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:15:04.101360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-446da046-7ed1-4434-88fb-0006b624f3be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:15:04.101360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:15:04.101360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:15:04.101360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:15:04.101360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:15:04.101360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:15:04.101360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:15:04.101360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:15:04.101360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:15:04.101360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:15:04.101360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:15:04.101360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:15:04.101360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:15:04.101360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:15:04.101360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:15:04.101360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:15:04.102475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:15:04.102475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:15:04.102475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:15:04.102475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:15:04.102475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:15:04.102475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:15:04.102475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:15:04.102475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:15:04.102475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:15:04.102475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:15:04.102475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:15:04.102475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:15:04.102475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:15:04.102475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:15:04.102475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:15:04.102475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:15:04.103526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:15:04.103526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:15:04.103526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:15:04.103526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:15:04.103526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:15:04.103526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:15:04.103526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:15:04.103526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:15:04.103526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:15:04.103526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:15:04.103526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:15:04.103526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:15:04.103526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 601/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:15:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:15:04.108474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d052e3d-f63a-481c-ac27-68c2f7cdace0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:15:04.204224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d052e3d-f63a-481c-ac27-68c2f7cdace0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:15:04.229206 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:15:04.236537 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1a52b-24a7-4448-857f-439e2538f4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:15:04.237147 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1a52b-24a7-4448-857f-439e2538f4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:15:04.237425 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1a52b-24a7-4448-857f-439e2538f4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:15:04.237723 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1a52b-24a7-4448-857f-439e2538f4c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:15:04.238960 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1a52b-24a7-4448-857f-439e2538f4c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:15:04.239285 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1a52b-24a7-4448-857f-439e2538f4c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:15:04.240731 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1a52b-24a7-4448-857f-439e2538f4c0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:15:04.248685 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 595/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:15:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:15:04.255030 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446da046-7ed1-4434-88fb-0006b624f3be None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:15:04.336986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:15:04.355000 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446da046-7ed1-4434-88fb-0006b624f3be None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:15:04.388085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370d9de-400e-46d8-9aaf-52384bd85254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:15:04.388717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370d9de-400e-46d8-9aaf-52384bd85254 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:15:04.388998 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370d9de-400e-46d8-9aaf-52384bd85254 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:15:04.389276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370d9de-400e-46d8-9aaf-52384bd85254 None admin] PATH_INFO: `/v3/users/e6866fcc433e4759b7fb92cf6fc0e573` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:15:04.390465 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370d9de-400e-46d8-9aaf-52384bd85254 None admin] RBAC: Authorizing `identity:get_user(user_id=e6866fcc433e4759b7fb92cf6fc0e573)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:15:04.391891 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370d9de-400e-46d8-9aaf-52384bd85254 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:15:04.393485 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 602/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jul 28 05:15:04 2022] GET /identity/v3/users/e6866fcc433e4759b7fb92cf6fc0e573 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:15:04.399978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1a52b-24a7-4448-857f-439e2538f4c0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:15:04.495835 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1a52b-24a7-4448-857f-439e2538f4c0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:15:04.528672 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ccf14-8b0e-4a0e-bac5-4dcd26591280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:15:04.529282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ccf14-8b0e-4a0e-bac5-4dcd26591280 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:15:04.529590 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ccf14-8b0e-4a0e-bac5-4dcd26591280 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:15:04.529869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ccf14-8b0e-4a0e-bac5-4dcd26591280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:15:04.585741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:15:04.595558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ccf14-8b0e-4a0e-bac5-4dcd26591280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:15:04.596928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ccf14-8b0e-4a0e-bac5-4dcd26591280 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:15:04.692508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 596/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:15:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:15:04.698433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370d9de-400e-46d8-9aaf-52384bd85254 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:15:04.795078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370d9de-400e-46d8-9aaf-52384bd85254 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:15:04.828639 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a7c99-6128-406b-9cce-f3913b295f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:15:04.829272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a7c99-6128-406b-9cce-f3913b295f18 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:15:04.829583 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a7c99-6128-406b-9cce-f3913b295f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:15:04.829865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a7c99-6128-406b-9cce-f3913b295f18 None admin] PATH_INFO: `/v3/projects/5dcd7808c86d45e8a698b1e2dfe90bd6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:15:04.831011 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a7c99-6128-406b-9cce-f3913b295f18 None admin] RBAC: Authorizing `identity:get_project(project_id=5dcd7808c86d45e8a698b1e2dfe90bd6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:15:04.832585 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a7c99-6128-406b-9cce-f3913b295f18 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:15:04.834770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 603/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jul 28 05:15:04 2022] GET /identity/v3/projects/5dcd7808c86d45e8a698b1e2dfe90bd6 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:15:04.840793 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ccf14-8b0e-4a0e-bac5-4dcd26591280 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:15:04.928421 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:15:04.937777 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ccf14-8b0e-4a0e-bac5-4dcd26591280 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:15:04.971972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b76d1f-2b96-4f9e-92ed-df9410952007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:15:04.972581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b76d1f-2b96-4f9e-92ed-df9410952007 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:15:04.972913 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b76d1f-2b96-4f9e-92ed-df9410952007 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:15:04.973174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b76d1f-2b96-4f9e-92ed-df9410952007 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:15:04.973959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b76d1f-2b96-4f9e-92ed-df9410952007 None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=5dcd7808c86d45e8a698b1e2dfe90bd6, user.id=e6866fcc433e4759b7fb92cf6fc0e573) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:15:04.974266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b76d1f-2b96-4f9e-92ed-df9410952007 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:15:04.975674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b76d1f-2b96-4f9e-92ed-df9410952007 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:15:04.981291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 597/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:15:04 2022] GET /identity/v3/role_assignments?user.id=e6866fcc433e4759b7fb92cf6fc0e573&scope.project.id=5dcd7808c86d45e8a698b1e2dfe90bd6&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:15:14.824495 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=91 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:15:14.978741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=23 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:13.587546 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6030b16-e9a2-4269-8a5c-d433b94e66d5 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:13.588132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6030b16-e9a2-4269-8a5c-d433b94e66d5 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:13.588132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6030b16-e9a2-4269-8a5c-d433b94e66d5 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:13.589458 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 604/1201] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:16:13.594650 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d83f08-64cc-4558-918b-76100c781350 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:13.607748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d83f08-64cc-4558-918b-76100c781350 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:13.607748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d83f08-64cc-4558-918b-76100c781350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:13.613391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-36d83f08-64cc-4558-918b-76100c781350 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:16:13.615189 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-36d83f08-64cc-4558-918b-76100c781350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:16:13.680310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 598/1202] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:16:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:16:13.704702 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6030b16-e9a2-4269-8a5c-d433b94e66d5 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:13.806625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6030b16-e9a2-4269-8a5c-d433b94e66d5 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:13.840180 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8364b37-2843-4f09-8edd-faef97fe260f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:13.840761 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8364b37-2843-4f09-8edd-faef97fe260f None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:13.841043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8364b37-2843-4f09-8edd-faef97fe260f None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:13.841320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8364b37-2843-4f09-8edd-faef97fe260f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:13.852563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8364b37-2843-4f09-8edd-faef97fe260f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:13.854039 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8364b37-2843-4f09-8edd-faef97fe260f None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:13.868710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-d8364b37-2843-4f09-8edd-faef97fe260f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:13.868710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:13.868710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:13.868710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:13.868710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:13.868710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:13.868710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:13.868710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:13.868710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:13.868710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:13.868710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:13.868710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:13.868710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:16:13.868710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:16:13.868710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:13.869844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:13.870839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:16:13.870839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:16:13.870839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:13.870839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:16:13.870839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 605/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:13.875968 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d83f08-64cc-4558-918b-76100c781350 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:13.974236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d83f08-64cc-4558-918b-76100c781350 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:14.002194 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:14.008041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89588a2c-9019-4f05-a573-03e045ee9e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:14.010938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89588a2c-9019-4f05-a573-03e045ee9e90 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:14.010938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89588a2c-9019-4f05-a573-03e045ee9e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:14.010938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89588a2c-9019-4f05-a573-03e045ee9e90 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:14.010938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89588a2c-9019-4f05-a573-03e045ee9e90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:14.010938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89588a2c-9019-4f05-a573-03e045ee9e90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:14.011661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89588a2c-9019-4f05-a573-03e045ee9e90 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:14.022671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 599/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:14.028732 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8364b37-2843-4f09-8edd-faef97fe260f None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:14.083861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:14.128234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8364b37-2843-4f09-8edd-faef97fe260f None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:14.160515 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b666f4-3ad3-48d3-9ab0-fd15086150dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:14.161809 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b666f4-3ad3-48d3-9ab0-fd15086150dc None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:14.162060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b666f4-3ad3-48d3-9ab0-fd15086150dc None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:14.162329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b666f4-3ad3-48d3-9ab0-fd15086150dc None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:14.162990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b666f4-3ad3-48d3-9ab0-fd15086150dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:14.164404 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b666f4-3ad3-48d3-9ab0-fd15086150dc None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:14.250346 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 606/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jul 28 05:16:14 2022] POST /identity/v3/users => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:16:16.317583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf48ba-5989-475b-b777-f27cd414f3ea None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:16.318211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf48ba-5989-475b-b777-f27cd414f3ea None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:16.318359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf48ba-5989-475b-b777-f27cd414f3ea None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:16.319718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 600/1206] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:16:16.324841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf47c38-2ef6-4dda-9461-586c78e55b68 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:16.325266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf47c38-2ef6-4dda-9461-586c78e55b68 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:16.325400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf47c38-2ef6-4dda-9461-586c78e55b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:16.343262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-fbf47c38-2ef6-4dda-9461-586c78e55b68 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:16:16.344444 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-fbf47c38-2ef6-4dda-9461-586c78e55b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:16:16.411292 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 607/1207] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:16:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:16:16.435044 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf48ba-5989-475b-b777-f27cd414f3ea None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:16.534950 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf48ba-5989-475b-b777-f27cd414f3ea None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:16.569292 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf2c91-04d8-4581-a4a9-d8a9c3fa5a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:16.569956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf2c91-04d8-4581-a4a9-d8a9c3fa5a40 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:16.570362 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf2c91-04d8-4581-a4a9-d8a9c3fa5a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:16.570640 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf2c91-04d8-4581-a4a9-d8a9c3fa5a40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:16.581118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf2c91-04d8-4581-a4a9-d8a9c3fa5a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:16:16.586249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-3ecf2c91-04d8-4581-a4a9-d8a9c3fa5a40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:16:16.586249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:16.586249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:16.586249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:16.586249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:16.586249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:16.586249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:16.586249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:16.586249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:16.586249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:16.586249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:16.586249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:16.586249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:16:16.586249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:16:16.586249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:16:16.586249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:16:16.588448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:16:16.588448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:16:16.588448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:16:16.588448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:16:16.588448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:16.588448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:16.588448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:16.588448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:16.588448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:16.588448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:16.588448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:16.588448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:16.588448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:16.588448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:16.588448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:16.588448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:16.589500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:16.589500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:16.589500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:16.589500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:16.589500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:16:16.589500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:16:16.589500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:16:16.589500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:16:16.589500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:16:16.589500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:16:16.589500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:16:16.589500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:16.589500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 601/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:16:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:16.593635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf47c38-2ef6-4dda-9461-586c78e55b68 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:16.632599 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:16.692131 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf47c38-2ef6-4dda-9461-586c78e55b68 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:16.726990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a314aa-c721-4b12-b859-5f2e89826901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:16.727652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a314aa-c721-4b12-b859-5f2e89826901 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:16.727944 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a314aa-c721-4b12-b859-5f2e89826901 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:16.728218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a314aa-c721-4b12-b859-5f2e89826901 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:16.728931 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a314aa-c721-4b12-b859-5f2e89826901 None admin] RBAC: Adding query filter params (name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:16.729240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a314aa-c721-4b12-b859-5f2e89826901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:16.730718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a314aa-c721-4b12-b859-5f2e89826901 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:16.738720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 608/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:16:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:16.745334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf2c91-04d8-4581-a4a9-d8a9c3fa5a40 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:16.795787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:16.848058 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf2c91-04d8-4581-a4a9-d8a9c3fa5a40 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:16.882335 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045e362-2344-415f-b8a1-a6c586d2a760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:16.882971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045e362-2344-415f-b8a1-a6c586d2a760 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:16.883253 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045e362-2344-415f-b8a1-a6c586d2a760 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:16.883529 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045e362-2344-415f-b8a1-a6c586d2a760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:16.893835 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045e362-2344-415f-b8a1-a6c586d2a760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:16.895280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045e362-2344-415f-b8a1-a6c586d2a760 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:16.909413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-0045e362-2344-415f-b8a1-a6c586d2a760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:16.909413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:16.909413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:16.909413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:16.909413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:16.909413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:16.909413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:16.909413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:16.909413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:16.909413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:16.909413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:16.909413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:16.909413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:16:16.909413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:16:16.909413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:16.910480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:16.916226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:16:16.916226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:16:16.916226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:16.916226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:16.916226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 602/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:16.917372 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a314aa-c721-4b12-b859-5f2e89826901 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:17.014519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:17.017336 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a314aa-c721-4b12-b859-5f2e89826901 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:17.051189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfd328-89e1-4a7b-b94e-c1f834ff6533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:17.051743 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfd328-89e1-4a7b-b94e-c1f834ff6533 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:17.052020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfd328-89e1-4a7b-b94e-c1f834ff6533 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:17.052291 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfd328-89e1-4a7b-b94e-c1f834ff6533 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:17.053030 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfd328-89e1-4a7b-b94e-c1f834ff6533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:17.053329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfd328-89e1-4a7b-b94e-c1f834ff6533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:17.054757 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfd328-89e1-4a7b-b94e-c1f834ff6533 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:17.066547 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 609/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:17.072773 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045e362-2344-415f-b8a1-a6c586d2a760 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:17.176291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045e362-2344-415f-b8a1-a6c586d2a760 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:17.177902 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:17.210882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64288bd9-2be7-4e88-98a1-83c774f0ed72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:17.211719 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64288bd9-2be7-4e88-98a1-83c774f0ed72 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:17.212318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64288bd9-2be7-4e88-98a1-83c774f0ed72 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:17.212598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64288bd9-2be7-4e88-98a1-83c774f0ed72 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:17.220264 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64288bd9-2be7-4e88-98a1-83c774f0ed72 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:17.221745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64288bd9-2be7-4e88-98a1-83c774f0ed72 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:17.233993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-64288bd9-2be7-4e88-98a1-83c774f0ed72 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:16:17.233993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:17.233993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:17.233993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:17.233993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:17.233993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:17.233993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:17.233993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:17.233993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:17.233993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:17.233993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:17.233993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:17.233993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:16:17.233993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:16:17.233993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:16:17.233993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:17.235502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:17.236476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:17.236476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:17.236476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:16:17.236476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:16:17.236476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:16:17.236476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:16:17.236476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:16:17.236476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:16:17.236476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:16:17.236476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:17.236476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 603/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:17.241135 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfd328-89e1-4a7b-b94e-c1f834ff6533 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:17.342256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfd328-89e1-4a7b-b94e-c1f834ff6533 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:17.376518 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14f94d-6f21-436c-86b2-21fe560daee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:17.377134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14f94d-6f21-436c-86b2-21fe560daee0 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:17.377419 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14f94d-6f21-436c-86b2-21fe560daee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:17.377793 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14f94d-6f21-436c-86b2-21fe560daee0 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:17.378613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14f94d-6f21-436c-86b2-21fe560daee0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:17.378921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14f94d-6f21-436c-86b2-21fe560daee0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:17.380433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14f94d-6f21-436c-86b2-21fe560daee0 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:17.398913 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 610/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jul 28 05:16:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:16:17.404758 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64288bd9-2be7-4e88-98a1-83c774f0ed72 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:17.503979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64288bd9-2be7-4e88-98a1-83c774f0ed72 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:17.537612 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cce0b1-add9-4d94-bc41-255a73a4bd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:17.538234 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cce0b1-add9-4d94-bc41-255a73a4bd6b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:17.538517 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cce0b1-add9-4d94-bc41-255a73a4bd6b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:17.538792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cce0b1-add9-4d94-bc41-255a73a4bd6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:17.568058 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:17.605915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cce0b1-add9-4d94-bc41-255a73a4bd6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:17.607325 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cce0b1-add9-4d94-bc41-255a73a4bd6b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:17.704102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 604/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:16:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:16:17.710661 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14f94d-6f21-436c-86b2-21fe560daee0 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:17.729724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:17.810383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14f94d-6f21-436c-86b2-21fe560daee0 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:17.843543 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e751f34-7f72-4d06-8592-1cc84ac0d9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:17.844180 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e751f34-7f72-4d06-8592-1cc84ac0d9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:17.844501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e751f34-7f72-4d06-8592-1cc84ac0d9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:17.844778 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e751f34-7f72-4d06-8592-1cc84ac0d9d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:17.854810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e751f34-7f72-4d06-8592-1cc84ac0d9d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:17.856280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e751f34-7f72-4d06-8592-1cc84ac0d9d5 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:17.871171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-5e751f34-7f72-4d06-8592-1cc84ac0d9d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:17.871171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:17.871171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:17.871171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:17.871171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:17.871171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:17.871171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:17.871171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:17.871171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:17.871171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:17.871171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:17.871171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:17.871171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:16:17.871171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:16:17.871171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:17.872190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:17.873619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:16:17.873619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:16:17.873619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:17.873619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:16:17.873619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 611/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:17.878269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cce0b1-add9-4d94-bc41-255a73a4bd6b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:17.937686 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:17.976675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cce0b1-add9-4d94-bc41-255a73a4bd6b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:18.011428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75956800-a296-423b-af63-b5e04805dfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:18.012031 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75956800-a296-423b-af63-b5e04805dfd8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:18.012312 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75956800-a296-423b-af63-b5e04805dfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:18.012587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75956800-a296-423b-af63-b5e04805dfd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:18.013306 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75956800-a296-423b-af63-b5e04805dfd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:18.013646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75956800-a296-423b-af63-b5e04805dfd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:18.015043 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75956800-a296-423b-af63-b5e04805dfd8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:18.026370 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 605/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:18.032036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e751f34-7f72-4d06-8592-1cc84ac0d9d5 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:18.100038 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:18.129702 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e751f34-7f72-4d06-8592-1cc84ac0d9d5 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:18.162973 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915650c7-e436-4f31-a8fa-4d0a85fb92ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:18.163607 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915650c7-e436-4f31-a8fa-4d0a85fb92ba None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:18.163879 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915650c7-e436-4f31-a8fa-4d0a85fb92ba None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:18.164175 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915650c7-e436-4f31-a8fa-4d0a85fb92ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:18.170574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915650c7-e436-4f31-a8fa-4d0a85fb92ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:18.172003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915650c7-e436-4f31-a8fa-4d0a85fb92ba None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:18.183968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-915650c7-e436-4f31-a8fa-4d0a85fb92ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:16:18.183968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:18.183968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:18.183968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:18.183968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:18.183968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:18.183968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:18.183968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:18.183968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:18.183968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:18.183968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:18.183968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:18.183968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:16:18.183968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:16:18.183968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:18.185367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:18.186337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:16:18.186337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:16:18.186337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:16:18.186337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:16:18.186337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:16:18.186337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:16:18.186337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:16:18.186337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:16:18.186337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 612/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:16:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:18.191408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75956800-a296-423b-af63-b5e04805dfd8 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:18.292348 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75956800-a296-423b-af63-b5e04805dfd8 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:18.315867 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:18.327221 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131a42f-b9e6-4755-ba35-970760fabda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:18.327843 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131a42f-b9e6-4755-ba35-970760fabda0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:18.328123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131a42f-b9e6-4755-ba35-970760fabda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:18.328440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131a42f-b9e6-4755-ba35-970760fabda0 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:18.329288 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131a42f-b9e6-4755-ba35-970760fabda0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:18.329670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131a42f-b9e6-4755-ba35-970760fabda0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:18.331093 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131a42f-b9e6-4755-ba35-970760fabda0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:18.342744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 606/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:16:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:18.348964 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915650c7-e436-4f31-a8fa-4d0a85fb92ba None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:18.449758 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915650c7-e436-4f31-a8fa-4d0a85fb92ba None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:18.478265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:18.484206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5c2ec-0389-4d97-b4a5-511929d40120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:18.484829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5c2ec-0389-4d97-b4a5-511929d40120 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:18.485109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5c2ec-0389-4d97-b4a5-511929d40120 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:18.485386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5c2ec-0389-4d97-b4a5-511929d40120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:18.486209 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5c2ec-0389-4d97-b4a5-511929d40120 None admin] RBAC: Adding query filter params (role.id=04fcac2c505f40a89923fa2f26cf548c, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=3aae5b2e7bf74805b04d01df47693ded) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:18.486521 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5c2ec-0389-4d97-b4a5-511929d40120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:18.487996 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5c2ec-0389-4d97-b4a5-511929d40120 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:18.494024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 613/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:16:18 2022] GET /identity/v3/role_assignments?user.id=3aae5b2e7bf74805b04d01df47693ded&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=04fcac2c505f40a89923fa2f26cf548c => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:16:20.471648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f8365-b291-4021-8f12-382fce82d33d None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:20.472254 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f8365-b291-4021-8f12-382fce82d33d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:20.472254 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f8365-b291-4021-8f12-382fce82d33d None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:20.473610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 607/1220] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:16:20.478885 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d851f1-65a2-4da6-9d1c-0c7ffcd69a7f None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:20.479308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d851f1-65a2-4da6-9d1c-0c7ffcd69a7f None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:20.479461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d851f1-65a2-4da6-9d1c-0c7ffcd69a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:20.497194 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-10d851f1-65a2-4da6-9d1c-0c7ffcd69a7f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:16:20.498407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-10d851f1-65a2-4da6-9d1c-0c7ffcd69a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:16:20.566843 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 614/1221] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:16:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:16:20.590345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f8365-b291-4021-8f12-382fce82d33d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:20.691809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f8365-b291-4021-8f12-382fce82d33d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:20.725989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777ed0d-fd1d-4d5a-a12b-e1c305c7842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:20.726631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777ed0d-fd1d-4d5a-a12b-e1c305c7842e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:20.726914 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777ed0d-fd1d-4d5a-a12b-e1c305c7842e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:20.727187 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777ed0d-fd1d-4d5a-a12b-e1c305c7842e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:20.738343 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777ed0d-fd1d-4d5a-a12b-e1c305c7842e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:16:20.743525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-8777ed0d-fd1d-4d5a-a12b-e1c305c7842e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:16:20.743525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:20.743525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:20.743525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:20.743525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:20.743525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:20.743525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:20.743525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:20.743525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:20.743525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:20.743525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:20.743525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:20.743525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:16:20.743525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:16:20.743525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:16:20.743525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:16:20.744658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:16:20.744658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:16:20.744658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:16:20.744658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:16:20.744658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:20.744658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:20.744658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:20.744658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:20.744658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:20.744658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:20.744658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:20.744658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:20.744658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:20.744658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:20.744658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:20.744658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:20.745744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:20.745744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:20.745744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:20.745744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:20.745744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:16:20.745744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:16:20.745744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:16:20.745744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:16:20.745744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:16:20.745744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:16:20.745744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:16:20.745744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:20.745744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 608/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:16:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:20.750808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d851f1-65a2-4da6-9d1c-0c7ffcd69a7f None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:20.851867 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d851f1-65a2-4da6-9d1c-0c7ffcd69a7f None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:20.875040 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:20.886072 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad6953-3d30-4504-bc6a-397a949084be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:20.886692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad6953-3d30-4504-bc6a-397a949084be None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:20.886974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad6953-3d30-4504-bc6a-397a949084be None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:20.887252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad6953-3d30-4504-bc6a-397a949084be None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:20.887962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad6953-3d30-4504-bc6a-397a949084be None admin] RBAC: Adding query filter params (name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:20.888271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad6953-3d30-4504-bc6a-397a949084be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:20.889735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad6953-3d30-4504-bc6a-397a949084be None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:20.897494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 615/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:16:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:20.903274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777ed0d-fd1d-4d5a-a12b-e1c305c7842e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:20.947718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:21.002289 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777ed0d-fd1d-4d5a-a12b-e1c305c7842e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:21.035932 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56a65d-5f31-480d-aba1-8e8e0294055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:21.036564 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56a65d-5f31-480d-aba1-8e8e0294055b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:21.037020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56a65d-5f31-480d-aba1-8e8e0294055b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:21.037333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56a65d-5f31-480d-aba1-8e8e0294055b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:21.047168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56a65d-5f31-480d-aba1-8e8e0294055b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:21.048600 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56a65d-5f31-480d-aba1-8e8e0294055b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:21.064123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-2f56a65d-5f31-480d-aba1-8e8e0294055b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:21.064123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:21.064123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:21.064123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:21.064123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:21.064123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:21.064123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:21.064123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:21.064123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:21.064123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:21.064123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:21.064123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:21.064123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:16:21.064123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:16:21.064123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:21.067243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:21.068539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:16:21.068539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:16:21.068539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:21.068539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:21.068539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 609/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:21.071624 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad6953-3d30-4504-bc6a-397a949084be None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:21.170952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad6953-3d30-4504-bc6a-397a949084be None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:21.204227 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a88842-2837-4aae-ac33-42b30b944160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:21.204851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a88842-2837-4aae-ac33-42b30b944160 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:21.205136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a88842-2837-4aae-ac33-42b30b944160 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:21.205419 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a88842-2837-4aae-ac33-42b30b944160 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:21.206219 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a88842-2837-4aae-ac33-42b30b944160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:21.206532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a88842-2837-4aae-ac33-42b30b944160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:21.207897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a88842-2837-4aae-ac33-42b30b944160 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:21.219759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 616/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:16:21.226029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56a65d-5f31-480d-aba1-8e8e0294055b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:21.321419 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:21.328122 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56a65d-5f31-480d-aba1-8e8e0294055b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:21.360953 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba6d44-eddf-49b3-88f1-5bc3d8e44d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:21.361626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba6d44-eddf-49b3-88f1-5bc3d8e44d9d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:21.361909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba6d44-eddf-49b3-88f1-5bc3d8e44d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:21.362186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba6d44-eddf-49b3-88f1-5bc3d8e44d9d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:21.370758 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba6d44-eddf-49b3-88f1-5bc3d8e44d9d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:21.372277 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba6d44-eddf-49b3-88f1-5bc3d8e44d9d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:21.383588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-77ba6d44-eddf-49b3-88f1-5bc3d8e44d9d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:16:21.383588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:21.383588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:21.383588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:21.383588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:21.383588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:21.383588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:21.383588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:21.383588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:21.383588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:21.383588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:21.383588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:21.383588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:16:21.383588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:16:21.383588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:16:21.383588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:21.384725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:21.386130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:21.386130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:21.386130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:16:21.386130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:16:21.386130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:16:21.386130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:16:21.386130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:16:21.386130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:16:21.386130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:16:21.386130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:21.386130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 610/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:21.390672 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a88842-2837-4aae-ac33-42b30b944160 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:21.439278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:21.492130 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a88842-2837-4aae-ac33-42b30b944160 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:21.526097 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f123708-6f73-4ffb-b35e-631cc292a6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:21.526719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f123708-6f73-4ffb-b35e-631cc292a6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:21.526999 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f123708-6f73-4ffb-b35e-631cc292a6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:21.527275 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f123708-6f73-4ffb-b35e-631cc292a6b2 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:21.528069 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f123708-6f73-4ffb-b35e-631cc292a6b2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:21.528381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f123708-6f73-4ffb-b35e-631cc292a6b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:21.529865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f123708-6f73-4ffb-b35e-631cc292a6b2 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:21.547523 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 617/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jul 28 05:16:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:21.553777 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba6d44-eddf-49b3-88f1-5bc3d8e44d9d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:21.651557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba6d44-eddf-49b3-88f1-5bc3d8e44d9d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:21.684677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874e938-9154-4ea6-870c-d7b1c9568ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:21.685301 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874e938-9154-4ea6-870c-d7b1c9568ddc None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:21.685612 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874e938-9154-4ea6-870c-d7b1c9568ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:21.685883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874e938-9154-4ea6-870c-d7b1c9568ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:21.696436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874e938-9154-4ea6-870c-d7b1c9568ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:21.697863 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874e938-9154-4ea6-870c-d7b1c9568ddc None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:21.712551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-6874e938-9154-4ea6-870c-d7b1c9568ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:21.712551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:21.712551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:21.712551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:21.712551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:21.712551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:21.712551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:21.712551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:21.712551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:21.712551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:21.712551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:21.712551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:21.712551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:16:21.712551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:16:21.712551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:21.713711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:21.714693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:16:21.714693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:16:21.714693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:21.714693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:21.714693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 611/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:21.719855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f123708-6f73-4ffb-b35e-631cc292a6b2 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:21.821591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f123708-6f73-4ffb-b35e-631cc292a6b2 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:21.823845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:21.855711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460dc97-f00f-4c1f-a665-8f9f763e7096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:21.856332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460dc97-f00f-4c1f-a665-8f9f763e7096 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:21.856613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460dc97-f00f-4c1f-a665-8f9f763e7096 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:21.856889 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460dc97-f00f-4c1f-a665-8f9f763e7096 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:21.857604 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460dc97-f00f-4c1f-a665-8f9f763e7096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:21.857914 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460dc97-f00f-4c1f-a665-8f9f763e7096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:21.859280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460dc97-f00f-4c1f-a665-8f9f763e7096 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:21.870544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 618/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:21.876354 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874e938-9154-4ea6-870c-d7b1c9568ddc None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:21.887130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:21.978202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874e938-9154-4ea6-870c-d7b1c9568ddc None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:22.010894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245367aa-dd36-4f56-a297-01cec64facbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:22.011530 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245367aa-dd36-4f56-a297-01cec64facbe None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:22.011811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245367aa-dd36-4f56-a297-01cec64facbe None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:22.012086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245367aa-dd36-4f56-a297-01cec64facbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:22.018558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245367aa-dd36-4f56-a297-01cec64facbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:22.019976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245367aa-dd36-4f56-a297-01cec64facbe None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:22.031868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-245367aa-dd36-4f56-a297-01cec64facbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:16:22.031868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:22.031868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:22.031868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:22.031868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:22.031868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:22.031868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:22.031868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:22.031868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:22.031868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:22.031868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:22.031868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:22.031868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:16:22.031868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:16:22.031868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:22.037949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:22.039086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:16:22.039086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:16:22.039086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:16:22.039086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:16:22.039086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:16:22.039086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:16:22.039086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:16:22.039086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:22.039086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 612/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:16:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:22.039688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460dc97-f00f-4c1f-a665-8f9f763e7096 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:22.136968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460dc97-f00f-4c1f-a665-8f9f763e7096 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:22.170131 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e336d-c3a9-4dc5-bc32-f4839499ba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:22.170744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e336d-c3a9-4dc5-bc32-f4839499ba29 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:22.171025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e336d-c3a9-4dc5-bc32-f4839499ba29 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:22.171299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e336d-c3a9-4dc5-bc32-f4839499ba29 None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:22.172039 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e336d-c3a9-4dc5-bc32-f4839499ba29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:22.172348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e336d-c3a9-4dc5-bc32-f4839499ba29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:22.173792 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e336d-c3a9-4dc5-bc32-f4839499ba29 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:22.185898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 619/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:22.191823 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245367aa-dd36-4f56-a297-01cec64facbe None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:22.256879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:22.292117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245367aa-dd36-4f56-a297-01cec64facbe None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:22.326173 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2844bb-0bd5-4c9a-b96f-edff7bdf3d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:22.327309 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2844bb-0bd5-4c9a-b96f-edff7bdf3d57 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:22.327614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2844bb-0bd5-4c9a-b96f-edff7bdf3d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:22.327913 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2844bb-0bd5-4c9a-b96f-edff7bdf3d57 None admin] PATH_INFO: `/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/3aae5b2e7bf74805b04d01df47693ded/roles/04fcac2c505f40a89923fa2f26cf548c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:22.342421 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2844bb-0bd5-4c9a-b96f-edff7bdf3d57 None admin] RBAC: Authorizing `identity:create_grant(project_id=089d8f58fc104484b617ec4a1317dbeb, user_id=3aae5b2e7bf74805b04d01df47693ded, role_id=04fcac2c505f40a89923fa2f26cf548c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:22.343862 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2844bb-0bd5-4c9a-b96f-edff7bdf3d57 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:22.439593 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 613/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:16:22 2022] PUT /identity/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/3aae5b2e7bf74805b04d01df47693ded/roles/04fcac2c505f40a89923fa2f26cf548c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:16:24.407385 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c5f36-55f3-429b-8344-019ff282743a None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:24.407954 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c5f36-55f3-429b-8344-019ff282743a None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:24.407954 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c5f36-55f3-429b-8344-019ff282743a None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:24.409359 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 620/1233] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:16:24.415210 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae323e8-557c-4de9-8424-0eceb7e0f0a1 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:24.415619 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae323e8-557c-4de9-8424-0eceb7e0f0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:24.415773 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae323e8-557c-4de9-8424-0eceb7e0f0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:24.434397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-5ae323e8-557c-4de9-8424-0eceb7e0f0a1 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:16:24.435581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5ae323e8-557c-4de9-8424-0eceb7e0f0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:16:24.501282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 614/1234] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:16:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:16:24.524612 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c5f36-55f3-429b-8344-019ff282743a None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:24.550343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:24.627745 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c5f36-55f3-429b-8344-019ff282743a None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:24.660700 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a8d45-9152-4774-a3b4-45d75ee377dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:24.661350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a8d45-9152-4774-a3b4-45d75ee377dc None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:24.662218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a8d45-9152-4774-a3b4-45d75ee377dc None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:24.662491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a8d45-9152-4774-a3b4-45d75ee377dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:24.672682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a8d45-9152-4774-a3b4-45d75ee377dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:16:24.677759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-f80a8d45-9152-4774-a3b4-45d75ee377dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:16:24.677759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:24.677759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:24.677759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:24.677759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:24.677759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:24.677759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:24.677759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:24.677759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:24.677759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:24.677759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:24.677759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:24.677759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:16:24.677759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:16:24.677759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:16:24.677759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:16:24.678899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:16:24.678899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:16:24.678899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:16:24.678899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:16:24.678899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:24.678899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:24.678899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:24.678899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:24.678899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:24.678899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:24.678899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:24.678899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:24.678899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:24.678899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:24.678899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:24.678899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:24.680109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:24.680109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:24.680109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:24.680109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:24.680109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:16:24.680109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:16:24.680109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:16:24.680109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:16:24.680109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:16:24.680109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:16:24.680109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:16:24.680109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:16:24.680109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 621/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jul 28 05:16:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:24.685266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae323e8-557c-4de9-8424-0eceb7e0f0a1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:24.732193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:24.783899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae323e8-557c-4de9-8424-0eceb7e0f0a1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:24.817138 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034a6fc-ff1f-40d7-af51-a3023e7f3601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:24.817825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034a6fc-ff1f-40d7-af51-a3023e7f3601 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:24.818172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034a6fc-ff1f-40d7-af51-a3023e7f3601 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:24.818529 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034a6fc-ff1f-40d7-af51-a3023e7f3601 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:24.819266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034a6fc-ff1f-40d7-af51-a3023e7f3601 None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:24.819570 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034a6fc-ff1f-40d7-af51-a3023e7f3601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:24.820999 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034a6fc-ff1f-40d7-af51-a3023e7f3601 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:24.828720 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 615/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jul 28 05:16:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:24.834985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a8d45-9152-4774-a3b4-45d75ee377dc None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:24.921424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:24.937558 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a8d45-9152-4774-a3b4-45d75ee377dc None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:24.972774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50585cb-2ca7-430a-9c2a-d5309cccd811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:24.973568 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50585cb-2ca7-430a-9c2a-d5309cccd811 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:24.973854 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50585cb-2ca7-430a-9c2a-d5309cccd811 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:24.974301 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50585cb-2ca7-430a-9c2a-d5309cccd811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:24.984403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50585cb-2ca7-430a-9c2a-d5309cccd811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:24.985913 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50585cb-2ca7-430a-9c2a-d5309cccd811 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:25.000463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-e50585cb-2ca7-430a-9c2a-d5309cccd811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:25.000463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:25.000463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:25.000463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:25.000463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:25.000463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:25.000463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:25.000463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:25.000463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:25.000463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:25.000463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:25.000463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:25.000463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:16:25.000463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:16:25.000463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:25.001522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:25.002625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:16:25.002625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:16:25.002625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:25.002625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:16:25.002625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 622/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:25.007933 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034a6fc-ff1f-40d7-af51-a3023e7f3601 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:25.106543 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034a6fc-ff1f-40d7-af51-a3023e7f3601 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:25.115787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:25.139974 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1509915-590d-4ef4-933f-12d8ebbea5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:25.140586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1509915-590d-4ef4-933f-12d8ebbea5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:25.140863 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1509915-590d-4ef4-933f-12d8ebbea5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:25.141133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1509915-590d-4ef4-933f-12d8ebbea5c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:25.141849 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1509915-590d-4ef4-933f-12d8ebbea5c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:25.142153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1509915-590d-4ef4-933f-12d8ebbea5c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:25.143506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1509915-590d-4ef4-933f-12d8ebbea5c2 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:25.155530 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 616/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:25.161201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50585cb-2ca7-430a-9c2a-d5309cccd811 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:25.264634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50585cb-2ca7-430a-9c2a-d5309cccd811 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:25.300674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9efcdf-6d43-4c3a-898d-61a919cb3a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:25.301313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9efcdf-6d43-4c3a-898d-61a919cb3a82 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:25.301627 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9efcdf-6d43-4c3a-898d-61a919cb3a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:25.301905 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9efcdf-6d43-4c3a-898d-61a919cb3a82 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:25.304756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:25.310097 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9efcdf-6d43-4c3a-898d-61a919cb3a82 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:25.311710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9efcdf-6d43-4c3a-898d-61a919cb3a82 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:25.323276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-7b9efcdf-6d43-4c3a-898d-61a919cb3a82 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:16:25.323276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:25.323276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:25.323276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:25.323276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:25.323276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:25.323276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:25.323276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:25.323276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:25.323276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:25.323276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:25.323276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:25.323276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:16:25.323276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:16:25.323276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:16:25.323276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:25.326527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:25.327784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:25.327784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:25.327784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:16:25.327784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:16:25.327784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:16:25.327784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:16:25.327784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:16:25.327784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:16:25.327784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:16:25.327784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:16:25.327784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 623/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:25.330371 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1509915-590d-4ef4-933f-12d8ebbea5c2 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:25.431897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1509915-590d-4ef4-933f-12d8ebbea5c2 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:25.465594 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfb78d-009a-4ee1-b87c-14822f7eb1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:25.466240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfb78d-009a-4ee1-b87c-14822f7eb1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:25.466525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfb78d-009a-4ee1-b87c-14822f7eb1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:25.466802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfb78d-009a-4ee1-b87c-14822f7eb1a6 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:25.467586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfb78d-009a-4ee1-b87c-14822f7eb1a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:25.467894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfb78d-009a-4ee1-b87c-14822f7eb1a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:25.469305 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfb78d-009a-4ee1-b87c-14822f7eb1a6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:25.486862 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 617/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jul 28 05:16:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:25.492761 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9efcdf-6d43-4c3a-898d-61a919cb3a82 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:25.593278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9efcdf-6d43-4c3a-898d-61a919cb3a82 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:25.626260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a0233-faf0-49e2-9663-9319fedb6867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:25.626868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a0233-faf0-49e2-9663-9319fedb6867 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:25.627146 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a0233-faf0-49e2-9663-9319fedb6867 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:25.627418 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a0233-faf0-49e2-9663-9319fedb6867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:25.687480 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:25.694498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a0233-faf0-49e2-9663-9319fedb6867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:25.695938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a0233-faf0-49e2-9663-9319fedb6867 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:25.792704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 624/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:16:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:16:25.798618 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfb78d-009a-4ee1-b87c-14822f7eb1a6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:25.827086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:25.900439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfb78d-009a-4ee1-b87c-14822f7eb1a6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:25.933614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac487af4-835d-4d40-83cc-a83cecd20a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:25.934512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac487af4-835d-4d40-83cc-a83cecd20a72 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:25.934793 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac487af4-835d-4d40-83cc-a83cecd20a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:25.935127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac487af4-835d-4d40-83cc-a83cecd20a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:25.948477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac487af4-835d-4d40-83cc-a83cecd20a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:25.948477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac487af4-835d-4d40-83cc-a83cecd20a72 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:25.962727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-ac487af4-835d-4d40-83cc-a83cecd20a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:25.962727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:25.962727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:25.962727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:25.962727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:25.962727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:25.962727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:25.962727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:25.962727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:25.962727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:25.962727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:25.962727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:25.962727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:16:25.962727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:16:25.962727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:25.963775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:25.965105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:16:25.965105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:16:25.965105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:25.965105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:25.965105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 618/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:25.969736 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a0233-faf0-49e2-9663-9319fedb6867 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:26.061383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:26.067114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a0233-faf0-49e2-9663-9319fedb6867 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:26.100245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04d333-ea23-43e7-8670-186b3ed0132f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:26.100858 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04d333-ea23-43e7-8670-186b3ed0132f None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:26.101138 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04d333-ea23-43e7-8670-186b3ed0132f None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:26.101412 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04d333-ea23-43e7-8670-186b3ed0132f None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:26.102127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04d333-ea23-43e7-8670-186b3ed0132f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:26.102433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04d333-ea23-43e7-8670-186b3ed0132f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:26.103790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04d333-ea23-43e7-8670-186b3ed0132f None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:26.115560 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 625/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:26.121259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac487af4-835d-4d40-83cc-a83cecd20a72 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:26.200098 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:26.221197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac487af4-835d-4d40-83cc-a83cecd20a72 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:26.254722 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8517be7-c87f-4897-93d1-3109e36f532f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:26.255960 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8517be7-c87f-4897-93d1-3109e36f532f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:26.256270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8517be7-c87f-4897-93d1-3109e36f532f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:26.256603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8517be7-c87f-4897-93d1-3109e36f532f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:26.263563 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8517be7-c87f-4897-93d1-3109e36f532f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:26.265021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8517be7-c87f-4897-93d1-3109e36f532f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:26.276716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-d8517be7-c87f-4897-93d1-3109e36f532f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:16:26.276716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:26.276716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:26.276716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:26.276716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:26.276716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:26.276716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:26.276716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:26.276716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:26.276716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:26.276716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:26.276716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:26.276716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:16:26.276716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:16:26.276716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:26.277841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:26.279199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:16:26.279199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:16:26.279199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:16:26.279199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:16:26.279199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:16:26.279199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:16:26.279199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:16:26.279199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:26.279199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 619/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:16:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:26.283721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04d333-ea23-43e7-8670-186b3ed0132f None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:26.383928 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04d333-ea23-43e7-8670-186b3ed0132f None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:26.417334 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36413f0c-53c9-4b31-826f-e90fc0f6b31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:26.417979 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36413f0c-53c9-4b31-826f-e90fc0f6b31b None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:26.418262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36413f0c-53c9-4b31-826f-e90fc0f6b31b None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:26.418538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36413f0c-53c9-4b31-826f-e90fc0f6b31b None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:26.419278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36413f0c-53c9-4b31-826f-e90fc0f6b31b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:26.419588 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36413f0c-53c9-4b31-826f-e90fc0f6b31b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:26.421061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36413f0c-53c9-4b31-826f-e90fc0f6b31b None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:26.433737 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 626/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:16:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:26.439959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8517be7-c87f-4897-93d1-3109e36f532f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:26.539746 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8517be7-c87f-4897-93d1-3109e36f532f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:26.573326 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80bad42-d974-4283-bbe5-948dcf928039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:26.573983 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bad42-d974-4283-bbe5-948dcf928039 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:26.574269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bad42-d974-4283-bbe5-948dcf928039 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:26.574543 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bad42-d974-4283-bbe5-948dcf928039 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:26.575323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80bad42-d974-4283-bbe5-948dcf928039 None admin] RBAC: Adding query filter params (role.id=04fcac2c505f40a89923fa2f26cf548c, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=3aae5b2e7bf74805b04d01df47693ded) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:26.575636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80bad42-d974-4283-bbe5-948dcf928039 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:26.577063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80bad42-d974-4283-bbe5-948dcf928039 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:26.582782 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 620/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:16:26 2022] GET /identity/v3/role_assignments?user.id=3aae5b2e7bf74805b04d01df47693ded&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=04fcac2c505f40a89923fa2f26cf548c => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:28.675187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb431d-55de-4cdf-851d-764a8e6b11c8 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:28.675732 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb431d-55de-4cdf-851d-764a8e6b11c8 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:28.675732 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb431d-55de-4cdf-851d-764a8e6b11c8 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:28.677412 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 627/1247] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:16:28.682747 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660a664-54b0-4896-aa25-354cdd2c8688 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:28.683146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660a664-54b0-4896-aa25-354cdd2c8688 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:28.683297 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660a664-54b0-4896-aa25-354cdd2c8688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:28.689830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:28.703235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b660a664-54b0-4896-aa25-354cdd2c8688 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:16:28.704416 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b660a664-54b0-4896-aa25-354cdd2c8688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:16:28.775794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 621/1248] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:16:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:16:28.798634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb431d-55de-4cdf-851d-764a8e6b11c8 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:28.816867 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:28.901261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb431d-55de-4cdf-851d-764a8e6b11c8 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:28.934825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9e7e9-d2e3-4350-beea-593cc1f82bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:28.935405 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9e7e9-d2e3-4350-beea-593cc1f82bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:28.935688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9e7e9-d2e3-4350-beea-593cc1f82bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:28.935966 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9e7e9-d2e3-4350-beea-593cc1f82bd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:28.946727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9e7e9-d2e3-4350-beea-593cc1f82bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:16:28.951713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-afd9e7e9-d2e3-4350-beea-593cc1f82bd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:16:28.951713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:28.951713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:28.951713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:28.951713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:28.951713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:28.951713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:28.951713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:28.951713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:28.951713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:28.951713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:28.951713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:28.951713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:16:28.951713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:16:28.951713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:16:28.951713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:16:28.952851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:16:28.952851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:16:28.952851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:16:28.952851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:16:28.952851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:28.952851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:28.952851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:28.952851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:28.952851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:28.952851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:28.952851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:28.952851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:28.952851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:28.952851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:28.952851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:28.952851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:28.953904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:28.953904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:28.953904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:28.953904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:28.953904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:16:28.953904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:16:28.953904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:16:28.953904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:16:28.953904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:16:28.953904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:16:28.953904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:16:28.953904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:16:28.953904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 628/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:16:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:28.959731 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660a664-54b0-4896-aa25-354cdd2c8688 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:29.056858 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660a664-54b0-4896-aa25-354cdd2c8688 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:29.086790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:29.091898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee240f-7cd4-4821-a111-78e8ab93665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:29.092531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee240f-7cd4-4821-a111-78e8ab93665a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:29.092815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee240f-7cd4-4821-a111-78e8ab93665a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:29.093094 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee240f-7cd4-4821-a111-78e8ab93665a None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:29.093847 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee240f-7cd4-4821-a111-78e8ab93665a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:29.094159 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee240f-7cd4-4821-a111-78e8ab93665a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:29.095610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee240f-7cd4-4821-a111-78e8ab93665a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:29.103691 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 622/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:16:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:29.109514 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9e7e9-d2e3-4350-beea-593cc1f82bd6 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:29.186619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:29.209318 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9e7e9-d2e3-4350-beea-593cc1f82bd6 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:29.242032 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8867da-2500-4afc-8196-c94972668e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:29.242692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8867da-2500-4afc-8196-c94972668e2d None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:29.242934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8867da-2500-4afc-8196-c94972668e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:29.243206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8867da-2500-4afc-8196-c94972668e2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:29.252798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8867da-2500-4afc-8196-c94972668e2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:29.254192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8867da-2500-4afc-8196-c94972668e2d None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:29.269388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-eb8867da-2500-4afc-8196-c94972668e2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:29.269388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:29.269388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:29.269388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:29.269388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:29.269388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:29.269388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:29.269388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:29.269388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:29.269388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:29.269388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:29.269388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:29.269388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:16:29.269388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:16:29.269388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:29.271513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:29.272711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:16:29.272711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:16:29.272711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:29.272711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:16:29.272711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 629/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:29.276885 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee240f-7cd4-4821-a111-78e8ab93665a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:29.376704 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee240f-7cd4-4821-a111-78e8ab93665a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:29.409982 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0feb5-f134-4dc0-b986-c305953f3674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:29.410601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0feb5-f134-4dc0-b986-c305953f3674 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:29.410882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0feb5-f134-4dc0-b986-c305953f3674 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:29.411179 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0feb5-f134-4dc0-b986-c305953f3674 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:29.412998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0feb5-f134-4dc0-b986-c305953f3674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:29.413307 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0feb5-f134-4dc0-b986-c305953f3674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:29.414694 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0feb5-f134-4dc0-b986-c305953f3674 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:29.426021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 623/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:29.432437 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8867da-2500-4afc-8196-c94972668e2d None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:29.530017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8867da-2500-4afc-8196-c94972668e2d None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:29.556156 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:29.564024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89b4ec-932a-4562-81d0-752c6bbc177f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:29.564657 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89b4ec-932a-4562-81d0-752c6bbc177f None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:29.564937 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89b4ec-932a-4562-81d0-752c6bbc177f None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:29.565213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89b4ec-932a-4562-81d0-752c6bbc177f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:29.572644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89b4ec-932a-4562-81d0-752c6bbc177f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:29.574092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89b4ec-932a-4562-81d0-752c6bbc177f None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:29.585051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-dc89b4ec-932a-4562-81d0-752c6bbc177f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:16:29.585051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:29.585051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:29.585051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:29.585051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:29.585051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:29.585051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:29.585051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:29.585051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:29.585051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:29.585051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:29.585051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:29.585051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:16:29.585051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:16:29.585051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:16:29.585051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:29.591764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:29.592727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:29.592727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:29.592727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:16:29.592727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:16:29.592727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:16:29.592727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:16:29.592727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:16:29.592727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:16:29.592727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:16:29.592727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:16:29.592727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 630/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:29.593381 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0feb5-f134-4dc0-b986-c305953f3674 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:29.647650 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:29.691420 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0feb5-f134-4dc0-b986-c305953f3674 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:29.724601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ca8a2-df88-432a-bd3c-0d6cd22b8711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:29.725262 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ca8a2-df88-432a-bd3c-0d6cd22b8711 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:29.725573 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ca8a2-df88-432a-bd3c-0d6cd22b8711 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:29.725856 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ca8a2-df88-432a-bd3c-0d6cd22b8711 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:29.726653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ca8a2-df88-432a-bd3c-0d6cd22b8711 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:29.726964 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ca8a2-df88-432a-bd3c-0d6cd22b8711 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:29.728389 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ca8a2-df88-432a-bd3c-0d6cd22b8711 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:29.745585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 624/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jul 28 05:16:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:29.751343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89b4ec-932a-4562-81d0-752c6bbc177f None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:29.852293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89b4ec-932a-4562-81d0-752c6bbc177f None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:29.884673 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ff7cf-8064-4c63-8e9c-c4ad6a37bfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:29.885287 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ff7cf-8064-4c63-8e9c-c4ad6a37bfe1 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:29.885593 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ff7cf-8064-4c63-8e9c-c4ad6a37bfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:29.885882 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ff7cf-8064-4c63-8e9c-c4ad6a37bfe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:29.941065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:29.954121 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ff7cf-8064-4c63-8e9c-c4ad6a37bfe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:29.955583 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ff7cf-8064-4c63-8e9c-c4ad6a37bfe1 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:30.052963 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 631/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:16:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:16:30.059274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ca8a2-df88-432a-bd3c-0d6cd22b8711 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:30.159735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ca8a2-df88-432a-bd3c-0d6cd22b8711 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:30.172886 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:30.194692 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fdbe3-e696-40f8-a25f-cd94a1d989f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:30.195336 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fdbe3-e696-40f8-a25f-cd94a1d989f0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:30.195617 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fdbe3-e696-40f8-a25f-cd94a1d989f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:30.195890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fdbe3-e696-40f8-a25f-cd94a1d989f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:30.205787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fdbe3-e696-40f8-a25f-cd94a1d989f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:30.207238 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fdbe3-e696-40f8-a25f-cd94a1d989f0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:30.222882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-a58fdbe3-e696-40f8-a25f-cd94a1d989f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:30.222882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:30.222882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:30.222882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:30.222882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:30.222882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:30.222882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:30.222882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:30.222882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:30.222882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:30.222882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:30.222882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:30.222882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:16:30.222882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:16:30.222882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:30.223958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:30.225196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:16:30.225196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:16:30.225196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:30.225196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:30.228876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 625/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:30.229960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ff7cf-8064-4c63-8e9c-c4ad6a37bfe1 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:30.321833 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:30.334453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ff7cf-8064-4c63-8e9c-c4ad6a37bfe1 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:30.368038 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493f32a-013b-4cf5-bf8f-2fe1c097b7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:30.368651 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f32a-013b-4cf5-bf8f-2fe1c097b7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:30.368927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f32a-013b-4cf5-bf8f-2fe1c097b7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:30.369198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f32a-013b-4cf5-bf8f-2fe1c097b7c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:30.369911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493f32a-013b-4cf5-bf8f-2fe1c097b7c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:30.370212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493f32a-013b-4cf5-bf8f-2fe1c097b7c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:30.371576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493f32a-013b-4cf5-bf8f-2fe1c097b7c0 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:30.383568 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 632/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:30.389341 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fdbe3-e696-40f8-a25f-cd94a1d989f0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:30.490632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fdbe3-e696-40f8-a25f-cd94a1d989f0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:30.523959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e65aa-3952-46d0-91f5-4e2adfea67f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:30.524597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e65aa-3952-46d0-91f5-4e2adfea67f7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:30.524880 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e65aa-3952-46d0-91f5-4e2adfea67f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:30.525157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e65aa-3952-46d0-91f5-4e2adfea67f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:30.531816 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e65aa-3952-46d0-91f5-4e2adfea67f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:30.533243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e65aa-3952-46d0-91f5-4e2adfea67f7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:30.544805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-990e65aa-3952-46d0-91f5-4e2adfea67f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:16:30.544805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:30.544805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:30.544805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:30.544805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:30.544805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:30.544805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:30.544805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:30.544805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:30.544805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:30.544805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:30.544805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:30.544805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:16:30.544805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:16:30.544805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:30.546020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:30.547193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:16:30.547193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:16:30.547193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:16:30.547193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:16:30.547193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:16:30.547193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:16:30.547193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:16:30.547193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:30.547193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 626/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:16:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:30.552374 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493f32a-013b-4cf5-bf8f-2fe1c097b7c0 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:30.653017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493f32a-013b-4cf5-bf8f-2fe1c097b7c0 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:30.685885 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4337efb-b1a5-496f-9020-d93089c5afb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:30.686497 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4337efb-b1a5-496f-9020-d93089c5afb2 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:30.686784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4337efb-b1a5-496f-9020-d93089c5afb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:30.687046 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4337efb-b1a5-496f-9020-d93089c5afb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:30.687784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4337efb-b1a5-496f-9020-d93089c5afb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:30.688093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4337efb-b1a5-496f-9020-d93089c5afb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:30.689515 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4337efb-b1a5-496f-9020-d93089c5afb2 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:30.701663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 633/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:16:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:30.707830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e65aa-3952-46d0-91f5-4e2adfea67f7 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:30.733439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:30.806923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e65aa-3952-46d0-91f5-4e2adfea67f7 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:30.840005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641ef65-ef0e-40ad-8efe-a717ab18066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:30.840618 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641ef65-ef0e-40ad-8efe-a717ab18066d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:30.840896 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641ef65-ef0e-40ad-8efe-a717ab18066d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:30.841169 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641ef65-ef0e-40ad-8efe-a717ab18066d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:30.841979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641ef65-ef0e-40ad-8efe-a717ab18066d None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=3aae5b2e7bf74805b04d01df47693ded) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:30.842287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641ef65-ef0e-40ad-8efe-a717ab18066d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:30.843682 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641ef65-ef0e-40ad-8efe-a717ab18066d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:30.849203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 627/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:16:30 2022] GET /identity/v3/role_assignments?user.id=3aae5b2e7bf74805b04d01df47693ded&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:32.798353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d2a82-2c4f-48f8-9bec-08cbb7276a20 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:32.798907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d2a82-2c4f-48f8-9bec-08cbb7276a20 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:32.798907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d2a82-2c4f-48f8-9bec-08cbb7276a20 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:32.800251 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 634/1261] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:16:32.805289 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096e6b3-44c0-43c0-826c-aea71d947f83 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:32.805693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096e6b3-44c0-43c0-826c-aea71d947f83 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:32.805870 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096e6b3-44c0-43c0-826c-aea71d947f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:32.823650 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-5096e6b3-44c0-43c0-826c-aea71d947f83 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:16:32.824816 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5096e6b3-44c0-43c0-826c-aea71d947f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:16:32.891393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 628/1262] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:16:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:16:32.913379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d2a82-2c4f-48f8-9bec-08cbb7276a20 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:32.924416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:33.014603 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d2a82-2c4f-48f8-9bec-08cbb7276a20 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:33.048745 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4010cc-a50f-4e90-a106-d0837105d189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:33.049318 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4010cc-a50f-4e90-a106-d0837105d189 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:33.049686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4010cc-a50f-4e90-a106-d0837105d189 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:33.049969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4010cc-a50f-4e90-a106-d0837105d189 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:33.062344 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4010cc-a50f-4e90-a106-d0837105d189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:16:33.067378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-0a4010cc-a50f-4e90-a106-d0837105d189 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:16:33.067378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:33.067378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:33.067378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:33.067378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:33.067378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:33.067378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:33.067378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:33.067378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:33.067378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:33.067378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:33.067378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:33.067378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:16:33.067378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:16:33.067378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:16:33.067378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:16:33.069164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:16:33.069164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:16:33.069164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:16:33.069164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:16:33.069164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:33.069164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:33.069164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:33.069164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:33.069164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:33.069164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:33.069164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:33.069164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:33.069164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:33.069164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:33.069164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:33.069164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:33.070304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:33.070304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:33.070304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:33.070304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:33.070304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:16:33.070304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:16:33.070304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:16:33.070304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:16:33.070304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:16:33.070304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:16:33.070304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:16:33.070304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:16:33.070304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 635/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:33.077387 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096e6b3-44c0-43c0-826c-aea71d947f83 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:33.096132 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:33.176787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096e6b3-44c0-43c0-826c-aea71d947f83 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:33.211033 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e8e8d-d023-4402-ab4b-a951ae841fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:33.211654 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e8e8d-d023-4402-ab4b-a951ae841fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:33.211936 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e8e8d-d023-4402-ab4b-a951ae841fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:33.212209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e8e8d-d023-4402-ab4b-a951ae841fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:33.212923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e8e8d-d023-4402-ab4b-a951ae841fa4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:33.213230 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e8e8d-d023-4402-ab4b-a951ae841fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:33.214669 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e8e8d-d023-4402-ab4b-a951ae841fa4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:33.222508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 629/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:16:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:33.229082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4010cc-a50f-4e90-a106-d0837105d189 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:33.298583 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:33.331752 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4010cc-a50f-4e90-a106-d0837105d189 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:33.365869 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699076f-dd9e-4ee1-abfa-6608544aa6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:33.366514 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699076f-dd9e-4ee1-abfa-6608544aa6ac None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:33.367747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699076f-dd9e-4ee1-abfa-6608544aa6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:33.367747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699076f-dd9e-4ee1-abfa-6608544aa6ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:33.377191 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699076f-dd9e-4ee1-abfa-6608544aa6ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:33.378657 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699076f-dd9e-4ee1-abfa-6608544aa6ac None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:33.394545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-3699076f-dd9e-4ee1-abfa-6608544aa6ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:33.394545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:33.394545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:33.394545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:33.394545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:33.394545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:33.394545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:33.394545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:33.394545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:33.394545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:33.394545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:33.394545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:33.394545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:16:33.394545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:16:33.394545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:33.396169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:33.397313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:16:33.397313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:16:33.397313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:33.397313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:16:33.397313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 636/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:33.402193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e8e8d-d023-4402-ab4b-a951ae841fa4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:33.484885 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:33.503362 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e8e8d-d023-4402-ab4b-a951ae841fa4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:33.537123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5070b9-d359-4d9d-8498-776a3ca4df40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:33.537794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5070b9-d359-4d9d-8498-776a3ca4df40 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:33.538098 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5070b9-d359-4d9d-8498-776a3ca4df40 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:33.538360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5070b9-d359-4d9d-8498-776a3ca4df40 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:33.539052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5070b9-d359-4d9d-8498-776a3ca4df40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:33.539387 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5070b9-d359-4d9d-8498-776a3ca4df40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:33.540961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5070b9-d359-4d9d-8498-776a3ca4df40 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:33.555191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 630/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:33.562394 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699076f-dd9e-4ee1-abfa-6608544aa6ac None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:33.664050 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699076f-dd9e-4ee1-abfa-6608544aa6ac None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:33.684229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:33.698862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f3823-cf4f-480a-a580-a91976e651fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:33.699510 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f3823-cf4f-480a-a580-a91976e651fa None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:33.699837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f3823-cf4f-480a-a580-a91976e651fa None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:33.700124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f3823-cf4f-480a-a580-a91976e651fa None admin] PATH_INFO: `/v3/users/placement` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:33.707686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f3823-cf4f-480a-a580-a91976e651fa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:33.709335 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f3823-cf4f-480a-a580-a91976e651fa None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:33.720552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-800f3823-cf4f-480a-a580-a91976e651fa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:16:33.720552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:33.720552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:33.720552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:33.720552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:33.720552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:33.720552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:33.720552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:33.720552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:33.720552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:33.720552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:33.720552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:33.720552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:16:33.720552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:16:33.720552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:16:33.720552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:33.721613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:33.722864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:33.722864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:33.722864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:16:33.722864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:16:33.722864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:16:33.722864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:16:33.722864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:16:33.722864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:16:33.722864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:16:33.722864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:16:33.722864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 637/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:33.727726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5070b9-d359-4d9d-8498-776a3ca4df40 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:33.828483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5070b9-d359-4d9d-8498-776a3ca4df40 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:33.862267 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f956b46-db82-43af-b7b2-98e2cf218be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:33.862891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956b46-db82-43af-b7b2-98e2cf218be3 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:33.863201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956b46-db82-43af-b7b2-98e2cf218be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:33.863474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956b46-db82-43af-b7b2-98e2cf218be3 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:33.864771 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f956b46-db82-43af-b7b2-98e2cf218be3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:33.865054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f956b46-db82-43af-b7b2-98e2cf218be3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:33.866585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f956b46-db82-43af-b7b2-98e2cf218be3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:33.875388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:33.884241 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 631/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jul 28 05:16:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:33.890143 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f3823-cf4f-480a-a580-a91976e651fa None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:33.991040 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f3823-cf4f-480a-a580-a91976e651fa None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:34.023887 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96bbda-b068-41f2-a8b4-80c50bf1baaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:34.024529 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96bbda-b068-41f2-a8b4-80c50bf1baaf None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:34.024812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96bbda-b068-41f2-a8b4-80c50bf1baaf None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:34.025093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96bbda-b068-41f2-a8b4-80c50bf1baaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:34.035371 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96bbda-b068-41f2-a8b4-80c50bf1baaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:34.037346 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96bbda-b068-41f2-a8b4-80c50bf1baaf None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:34.051253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-7a96bbda-b068-41f2-a8b4-80c50bf1baaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:34.051253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:34.051253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:34.051253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:34.051253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:34.051253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:34.051253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:34.051253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:34.051253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:34.051253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:34.051253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:34.051253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:34.051253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:16:34.051253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:16:34.051253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:34.052934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:34.056108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:16:34.056108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:16:34.056108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:34.056108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:16:34.056108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 638/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:16:34.059041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f956b46-db82-43af-b7b2-98e2cf218be3 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:34.157759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f956b46-db82-43af-b7b2-98e2cf218be3 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:34.195525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832dc2b-17ee-4b0f-bf67-41b8f3af6a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:34.196145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832dc2b-17ee-4b0f-bf67-41b8f3af6a1e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:34.196472 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832dc2b-17ee-4b0f-bf67-41b8f3af6a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:34.196746 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832dc2b-17ee-4b0f-bf67-41b8f3af6a1e None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:34.197428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832dc2b-17ee-4b0f-bf67-41b8f3af6a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:34.197763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832dc2b-17ee-4b0f-bf67-41b8f3af6a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:34.199120 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832dc2b-17ee-4b0f-bf67-41b8f3af6a1e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:34.210427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 632/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:34.216218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96bbda-b068-41f2-a8b4-80c50bf1baaf None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:34.250509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:34.321119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96bbda-b068-41f2-a8b4-80c50bf1baaf None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:34.355150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcd1b0-dc74-4a0a-81dd-550ae04d4aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:34.355790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcd1b0-dc74-4a0a-81dd-550ae04d4aaa None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:34.356072 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcd1b0-dc74-4a0a-81dd-550ae04d4aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:34.356379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcd1b0-dc74-4a0a-81dd-550ae04d4aaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:34.363119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcd1b0-dc74-4a0a-81dd-550ae04d4aaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:34.364643 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcd1b0-dc74-4a0a-81dd-550ae04d4aaa None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:34.375897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-2ddcd1b0-dc74-4a0a-81dd-550ae04d4aaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:16:34.375897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:34.375897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:34.375897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:34.375897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:34.375897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:34.375897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:34.375897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:34.375897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:34.375897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:34.375897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:34.375897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:34.375897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:16:34.375897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:16:34.375897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:34.382969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:34.384108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:16:34.384108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:16:34.384108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:16:34.384108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:16:34.384108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:16:34.384108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:16:34.384108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:16:34.384108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:16:34.384108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 639/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:16:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:34.384722 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832dc2b-17ee-4b0f-bf67-41b8f3af6a1e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:34.442538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:34.484864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832dc2b-17ee-4b0f-bf67-41b8f3af6a1e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:34.519043 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873092f6-6f51-4bc0-82b5-dc7cbbebbd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:34.519668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873092f6-6f51-4bc0-82b5-dc7cbbebbd15 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:34.519951 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873092f6-6f51-4bc0-82b5-dc7cbbebbd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:34.520226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873092f6-6f51-4bc0-82b5-dc7cbbebbd15 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:34.521739 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873092f6-6f51-4bc0-82b5-dc7cbbebbd15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:34.522053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873092f6-6f51-4bc0-82b5-dc7cbbebbd15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:34.523506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873092f6-6f51-4bc0-82b5-dc7cbbebbd15 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:34.535319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 633/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:16:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:34.542103 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcd1b0-dc74-4a0a-81dd-550ae04d4aaa None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:34.636693 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:34.645091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcd1b0-dc74-4a0a-81dd-550ae04d4aaa None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:34.679116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6d515-7571-42ce-b255-71312913eabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:34.679789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6d515-7571-42ce-b255-71312913eabe None admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:34.680074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6d515-7571-42ce-b255-71312913eabe None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:34.680351 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6d515-7571-42ce-b255-71312913eabe None admin] PATH_INFO: `/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/3aae5b2e7bf74805b04d01df47693ded/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:34.682385 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6d515-7571-42ce-b255-71312913eabe None admin] RBAC: Authorizing `identity:create_grant(project_id=089d8f58fc104484b617ec4a1317dbeb, user_id=3aae5b2e7bf74805b04d01df47693ded, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:34.684118 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6d515-7571-42ce-b255-71312913eabe None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:34.783279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 640/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jul 28 05:16:34 2022] PUT /identity/v3/projects/089d8f58fc104484b617ec4a1317dbeb/users/3aae5b2e7bf74805b04d01df47693ded/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:16:36.773908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb28caf-ecaf-432a-ba26-73c726200e46 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:36.774478 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb28caf-ecaf-432a-ba26-73c726200e46 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:36.774478 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb28caf-ecaf-432a-ba26-73c726200e46 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:36.775818 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 634/1274] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:16:36.781153 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038eaeb5-a412-4c48-a6e4-1448a7272421 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:36.781576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038eaeb5-a412-4c48-a6e4-1448a7272421 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:36.781762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038eaeb5-a412-4c48-a6e4-1448a7272421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:36.800343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-038eaeb5-a412-4c48-a6e4-1448a7272421 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:16:36.801625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-038eaeb5-a412-4c48-a6e4-1448a7272421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:16:36.867832 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 641/1275] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:16:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:16:36.891474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb28caf-ecaf-432a-ba26-73c726200e46 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:36.993804 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb28caf-ecaf-432a-ba26-73c726200e46 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:37.011516 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:37.027629 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4a65b-97c8-4037-bc52-575aba16edd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:37.028211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4a65b-97c8-4037-bc52-575aba16edd7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:37.028492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4a65b-97c8-4037-bc52-575aba16edd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:37.028764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4a65b-97c8-4037-bc52-575aba16edd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:37.038560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4a65b-97c8-4037-bc52-575aba16edd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:16:37.043475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-56e4a65b-97c8-4037-bc52-575aba16edd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:16:37.043475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:37.043475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:37.043475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:37.043475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:37.043475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:37.043475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:37.043475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:37.043475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:37.043475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:37.043475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:37.043475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:37.043475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:16:37.043475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:16:37.043475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:16:37.043475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:16:37.044623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:16:37.044623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:16:37.044623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:16:37.044623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:16:37.044623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:37.044623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:37.044623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:37.044623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:37.044623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:37.044623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:37.044623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:37.044623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:37.044623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:37.044623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:37.044623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:37.044623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:37.045542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:37.045542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:37.045542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:37.045542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:37.045542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:16:37.045542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:16:37.045542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:16:37.045542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:16:37.045542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:16:37.045542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:16:37.045542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:16:37.045542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:37.045542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 635/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jul 28 05:16:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:37.051043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038eaeb5-a412-4c48-a6e4-1448a7272421 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:37.134052 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:37.151715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038eaeb5-a412-4c48-a6e4-1448a7272421 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:37.185379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c06919-f4e8-46f8-b5b9-bc77bfb2c9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:37.186095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c06919-f4e8-46f8-b5b9-bc77bfb2c9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:37.186350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c06919-f4e8-46f8-b5b9-bc77bfb2c9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:37.186627 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c06919-f4e8-46f8-b5b9-bc77bfb2c9b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:37.187349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c06919-f4e8-46f8-b5b9-bc77bfb2c9b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:37.187658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c06919-f4e8-46f8-b5b9-bc77bfb2c9b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:37.189033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c06919-f4e8-46f8-b5b9-bc77bfb2c9b8 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:37.198245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 642/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jul 28 05:16:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:16:37.203976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4a65b-97c8-4037-bc52-575aba16edd7 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:37.309061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4a65b-97c8-4037-bc52-575aba16edd7 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:37.342630 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7495d3-36b9-4527-bbc8-d13416e84637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:37.343277 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7495d3-36b9-4527-bbc8-d13416e84637 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:37.343607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7495d3-36b9-4527-bbc8-d13416e84637 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:37.343884 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7495d3-36b9-4527-bbc8-d13416e84637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:37.354783 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7495d3-36b9-4527-bbc8-d13416e84637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:37.356243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7495d3-36b9-4527-bbc8-d13416e84637 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:37.371927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-6a7495d3-36b9-4527-bbc8-d13416e84637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:37.371927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:37.371927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:37.371927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:37.371927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:37.371927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:37.371927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:37.371927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:37.371927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:37.371927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:37.371927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:37.371927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:37.371927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:16:37.371927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:16:37.371927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:37.373017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:37.374005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:16:37.374005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:16:37.374005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:37.374005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:37.374005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 636/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:37.378985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c06919-f4e8-46f8-b5b9-bc77bfb2c9b8 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:37.478463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c06919-f4e8-46f8-b5b9-bc77bfb2c9b8 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:37.511762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce6a6b-862e-459f-8512-9989cc3fb5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:37.512376 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce6a6b-862e-459f-8512-9989cc3fb5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:37.512659 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce6a6b-862e-459f-8512-9989cc3fb5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:37.512936 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce6a6b-862e-459f-8512-9989cc3fb5d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:37.513656 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce6a6b-862e-459f-8512-9989cc3fb5d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:37.513968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce6a6b-862e-459f-8512-9989cc3fb5d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:37.515335 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce6a6b-862e-459f-8512-9989cc3fb5d9 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:37.527061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 643/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:37.532835 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7495d3-36b9-4527-bbc8-d13416e84637 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:37.565359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:37.634146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7495d3-36b9-4527-bbc8-d13416e84637 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:37.673161 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c6a47-64a1-43ea-ac40-d4d6c65d7e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:37.673864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c6a47-64a1-43ea-ac40-d4d6c65d7e43 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:37.674146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c6a47-64a1-43ea-ac40-d4d6c65d7e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:37.674493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c6a47-64a1-43ea-ac40-d4d6c65d7e43 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:37.684308 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c6a47-64a1-43ea-ac40-d4d6c65d7e43 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:37.685804 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c6a47-64a1-43ea-ac40-d4d6c65d7e43 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:37.698907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-bb1c6a47-64a1-43ea-ac40-d4d6c65d7e43 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:16:37.698907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:37.698907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:37.698907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:37.698907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:37.698907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:37.698907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:37.698907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:37.698907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:37.698907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:37.698907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:37.698907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:37.698907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:16:37.698907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:16:37.698907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:16:37.698907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:37.700174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:37.701365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:37.701365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:37.701365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:16:37.701365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:16:37.701365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:16:37.701365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:16:37.701365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:16:37.701365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:16:37.701365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:16:37.701365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:37.705425 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 637/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:37.706581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce6a6b-862e-459f-8512-9989cc3fb5d9 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:37.711112 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:37.814589 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce6a6b-862e-459f-8512-9989cc3fb5d9 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:37.850896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5bcc2-b08a-4c88-90e9-6270fd5de200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:37.851446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5bcc2-b08a-4c88-90e9-6270fd5de200 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:37.851726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5bcc2-b08a-4c88-90e9-6270fd5de200 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:37.852003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5bcc2-b08a-4c88-90e9-6270fd5de200 None admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:37.852822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5bcc2-b08a-4c88-90e9-6270fd5de200 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:37.853133 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5bcc2-b08a-4c88-90e9-6270fd5de200 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:37.854631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5bcc2-b08a-4c88-90e9-6270fd5de200 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:37.874376 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 644/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jul 28 05:16:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:16:37.881023 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c6a47-64a1-43ea-ac40-d4d6c65d7e43 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:37.979920 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:37.990579 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c6a47-64a1-43ea-ac40-d4d6c65d7e43 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:38.024802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfce2d-ce0a-4bb1-a603-68b06eb82dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:38.025428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfce2d-ce0a-4bb1-a603-68b06eb82dcd None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:38.025740 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfce2d-ce0a-4bb1-a603-68b06eb82dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:38.026018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfce2d-ce0a-4bb1-a603-68b06eb82dcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:38.102197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfce2d-ce0a-4bb1-a603-68b06eb82dcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:38.103567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfce2d-ce0a-4bb1-a603-68b06eb82dcd None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:38.192088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:38.202506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 638/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jul 28 05:16:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:16:38.208334 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5bcc2-b08a-4c88-90e9-6270fd5de200 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:38.270988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:38.309804 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5bcc2-b08a-4c88-90e9-6270fd5de200 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:38.342985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251a5ec-0b5a-4f3f-b912-99776e46dabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:38.343625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251a5ec-0b5a-4f3f-b912-99776e46dabd None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:38.343906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251a5ec-0b5a-4f3f-b912-99776e46dabd None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:38.344179 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251a5ec-0b5a-4f3f-b912-99776e46dabd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:38.354563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251a5ec-0b5a-4f3f-b912-99776e46dabd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:38.355949 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251a5ec-0b5a-4f3f-b912-99776e46dabd None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:38.371738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-a251a5ec-0b5a-4f3f-b912-99776e46dabd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:38.371738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:38.371738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:38.371738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:38.371738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:38.371738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:38.371738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:38.371738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:38.371738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:38.371738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:38.371738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:38.371738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:38.371738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:16:38.371738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:16:38.371738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:38.372924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:38.374075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:16:38.374075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:16:38.374075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:16:38.374075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:16:38.374075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 645/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:38.378695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfce2d-ce0a-4bb1-a603-68b06eb82dcd None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:38.478596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfce2d-ce0a-4bb1-a603-68b06eb82dcd None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:38.512328 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e248706-a558-4a62-a392-c4769473642c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:38.512937 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e248706-a558-4a62-a392-c4769473642c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:38.513226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e248706-a558-4a62-a392-c4769473642c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:38.513525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e248706-a558-4a62-a392-c4769473642c None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:38.514213 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e248706-a558-4a62-a392-c4769473642c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:38.514521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e248706-a558-4a62-a392-c4769473642c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:38.515955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e248706-a558-4a62-a392-c4769473642c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:38.527586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 639/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jul 28 05:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:38.533277 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251a5ec-0b5a-4f3f-b912-99776e46dabd None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:38.633496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251a5ec-0b5a-4f3f-b912-99776e46dabd None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:38.647615 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:38.667870 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a943c-78e0-4213-b714-4688df366e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:38.668505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a943c-78e0-4213-b714-4688df366e5d None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:38.668783 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a943c-78e0-4213-b714-4688df366e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:38.669090 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a943c-78e0-4213-b714-4688df366e5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:38.675707 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a943c-78e0-4213-b714-4688df366e5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:38.677453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a943c-78e0-4213-b714-4688df366e5d None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:38.688856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application [None req-e33a943c-78e0-4213-b714-4688df366e5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:16:38.688856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:38.688856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:38.688856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:38.688856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:38.688856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:38.688856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:38.688856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:38.688856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:38.688856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:38.688856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:38.688856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:38.688856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:16:38.688856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:16:38.688856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:38.689952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:38.691051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:16:38.691051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:16:38.691051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:16:38.691051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:16:38.691051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:16:38.691051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:16:38.691051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:16:38.691051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: ERROR keystone.server.flask.application Jul 28 05:16:38.691051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 646/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jul 28 05:16:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:38.696899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e248706-a558-4a62-a392-c4769473642c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:38.746290 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:38.795889 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e248706-a558-4a62-a392-c4769473642c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:38.829433 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc5b59-f578-4975-9084-e85eb1637ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:38.830078 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc5b59-f578-4975-9084-e85eb1637ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:38.830359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc5b59-f578-4975-9084-e85eb1637ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:38.830629 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc5b59-f578-4975-9084-e85eb1637ca3 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:38.831375 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc5b59-f578-4975-9084-e85eb1637ca3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:38.831683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc5b59-f578-4975-9084-e85eb1637ca3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:38.834003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc5b59-f578-4975-9084-e85eb1637ca3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:38.845648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 640/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jul 28 05:16:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:38.851904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a943c-78e0-4213-b714-4688df366e5d None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:38.951294 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a943c-78e0-4213-b714-4688df366e5d None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:38.984854 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79153228-cdb0-4f10-b51d-17befbaf28eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:38.985460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153228-cdb0-4f10-b51d-17befbaf28eb None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:38.985763 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153228-cdb0-4f10-b51d-17befbaf28eb None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:38.986034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153228-cdb0-4f10-b51d-17befbaf28eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:38.986808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79153228-cdb0-4f10-b51d-17befbaf28eb None admin] RBAC: Adding query filter params (role.id=34617b6ad5f84a929307dfce82d9aecd, scope.project.id=089d8f58fc104484b617ec4a1317dbeb, user.id=3aae5b2e7bf74805b04d01df47693ded) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:38.987117 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79153228-cdb0-4f10-b51d-17befbaf28eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:38.988575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79153228-cdb0-4f10-b51d-17befbaf28eb None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:38.994400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 647/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jul 28 05:16:38 2022] GET /identity/v3/role_assignments?user.id=3aae5b2e7bf74805b04d01df47693ded&scope.project.id=089d8f58fc104484b617ec4a1317dbeb&role.id=34617b6ad5f84a929307dfce82d9aecd => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:41.007059 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326680c2-30d1-4d12-81fd-bedbb8d22805 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:41.007619 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326680c2-30d1-4d12-81fd-bedbb8d22805 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:41.007619 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326680c2-30d1-4d12-81fd-bedbb8d22805 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:41.008958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 641/1288] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:16:41.014068 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cd2e3-c3cc-4ae9-8b9c-d5b8db6a3b65 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:41.014485 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cd2e3-c3cc-4ae9-8b9c-d5b8db6a3b65 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:41.014632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cd2e3-c3cc-4ae9-8b9c-d5b8db6a3b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:41.032740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-837cd2e3-c3cc-4ae9-8b9c-d5b8db6a3b65 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:16:41.033970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-837cd2e3-c3cc-4ae9-8b9c-d5b8db6a3b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:16:41.064662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:41.101388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 648/1289] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:16:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:16:41.125555 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326680c2-30d1-4d12-81fd-bedbb8d22805 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:41.225132 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326680c2-30d1-4d12-81fd-bedbb8d22805 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:41.235497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:41.258527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e661fc8-a3b0-426c-8835-53c71d127f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:41.259108 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e661fc8-a3b0-426c-8835-53c71d127f19 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:41.259384 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e661fc8-a3b0-426c-8835-53c71d127f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:41.259655 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e661fc8-a3b0-426c-8835-53c71d127f19 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:41.260274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e661fc8-a3b0-426c-8835-53c71d127f19 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:41.261652 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e661fc8-a3b0-426c-8835-53c71d127f19 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-0e661fc8-a3b0-426c-8835-53c71d127f19 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:41.270586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:41.271947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:41.271947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:41.271947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:41.271947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:41.271947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:41.271947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:41.271947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:16:41.271947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:16:41.271947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:16:41.271947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:16:41.271947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:41.271947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:41.271947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:41.271947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:41.271947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:41.271947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:41.272811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:41.272811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:41.272811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:41.272811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:41.272811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:41.272811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:41.272811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:41.272811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:41.272811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:41.272811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:41.272811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:16:41.272811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:16:41.272811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:16:41.272811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:41.272811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 642/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jul 28 05:16:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:41.277929 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cd2e3-c3cc-4ae9-8b9c-d5b8db6a3b65 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:41.379565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cd2e3-c3cc-4ae9-8b9c-d5b8db6a3b65 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:41.413424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7a1f1-372e-4810-b4f1-2cc3bbc65b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:41.414105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7a1f1-372e-4810-b4f1-2cc3bbc65b69 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:41.414381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7a1f1-372e-4810-b4f1-2cc3bbc65b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:41.414650 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7a1f1-372e-4810-b4f1-2cc3bbc65b69 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:41.415316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7a1f1-372e-4810-b4f1-2cc3bbc65b69 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:41.415620 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7a1f1-372e-4810-b4f1-2cc3bbc65b69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:41.416973 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7a1f1-372e-4810-b4f1-2cc3bbc65b69 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:41.421761 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 649/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Thu Jul 28 05:16:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:41.428333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e661fc8-a3b0-426c-8835-53c71d127f19 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:41.527213 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e661fc8-a3b0-426c-8835-53c71d127f19 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:41.561940 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e1690-8eab-4244-8118-dd913817c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:41.562558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e1690-8eab-4244-8118-dd913817c487 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:41.562839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e1690-8eab-4244-8118-dd913817c487 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:41.563114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e1690-8eab-4244-8118-dd913817c487 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:41.563783 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e1690-8eab-4244-8118-dd913817c487 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:41.564086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e1690-8eab-4244-8118-dd913817c487 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:41.565451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e1690-8eab-4244-8118-dd913817c487 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:41.569886 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 643/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Thu Jul 28 05:16:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:43.683899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb182-efef-4ec1-8053-5541256aeb88 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:43.684452 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb182-efef-4ec1-8053-5541256aeb88 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:43.684609 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb182-efef-4ec1-8053-5541256aeb88 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:43.686129 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 650/1293] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:16:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:16:43.691322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bbb11-5005-44ab-a99a-7c6ebbb51a31 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:43.691740 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bbb11-5005-44ab-a99a-7c6ebbb51a31 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:43.691898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bbb11-5005-44ab-a99a-7c6ebbb51a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:43.710362 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-314bbb11-5005-44ab-a99a-7c6ebbb51a31 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:16:43.711582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-314bbb11-5005-44ab-a99a-7c6ebbb51a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:16:43.740733 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:43.777379 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 644/1294] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:16:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:16:43.799570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bb182-efef-4ec1-8053-5541256aeb88 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:43.831897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:43.902174 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bb182-efef-4ec1-8053-5541256aeb88 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:43.936251 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589948d5-e217-40d8-82cc-ed5765337b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:43.936804 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589948d5-e217-40d8-82cc-ed5765337b76 None admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:43.937079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589948d5-e217-40d8-82cc-ed5765337b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:43.937351 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589948d5-e217-40d8-82cc-ed5765337b76 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:43.938068 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589948d5-e217-40d8-82cc-ed5765337b76 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:43.939418 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589948d5-e217-40d8-82cc-ed5765337b76 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:44.015310 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 651/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jul 28 05:16:43 2022] POST /identity/v3/services => generated 246 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:16:46.037501 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c397ab-e4c4-4ab6-a051-45c530985ad1 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:46.038033 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c397ab-e4c4-4ab6-a051-45c530985ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:46.038148 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c397ab-e4c4-4ab6-a051-45c530985ad1 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:46.039469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 645/1296] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:16:46.044626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ddfaa-92bf-4ab7-81d1-b6b4a0727496 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:46.045050 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ddfaa-92bf-4ab7-81d1-b6b4a0727496 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:46.045183 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ddfaa-92bf-4ab7-81d1-b6b4a0727496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:46.064395 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-ab0ddfaa-92bf-4ab7-81d1-b6b4a0727496 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:16:46.065613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ab0ddfaa-92bf-4ab7-81d1-b6b4a0727496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:16:46.137058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 652/1297] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:16:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:16:46.160020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c397ab-e4c4-4ab6-a051-45c530985ad1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:46.265807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c397ab-e4c4-4ab6-a051-45c530985ad1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:46.300789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afe9d3-bbb5-4122-a54b-91d867387716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:46.302063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afe9d3-bbb5-4122-a54b-91d867387716 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:46.302439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afe9d3-bbb5-4122-a54b-91d867387716 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:46.302724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afe9d3-bbb5-4122-a54b-91d867387716 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:46.303358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afe9d3-bbb5-4122-a54b-91d867387716 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:46.304718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afe9d3-bbb5-4122-a54b-91d867387716 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-f8afe9d3-bbb5-4122-a54b-91d867387716 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:46.313895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:46.315084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:46.315084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:46.315084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:46.315084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:46.315084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:46.315084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:46.315084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:16:46.315084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:16:46.315084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:16:46.315084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:16:46.315084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:46.315084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:46.315084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:46.315084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:46.315084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:46.315084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:46.316112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:46.316112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:46.316112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:46.316112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:46.316112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:46.316112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:46.316112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:46.316112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:46.316112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:46.316112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:46.316112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:16:46.316112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:16:46.316112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:16:46.316112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:46.316112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 646/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jul 28 05:16:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:46.321303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ddfaa-92bf-4ab7-81d1-b6b4a0727496 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:46.339302 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:46.417763 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ddfaa-92bf-4ab7-81d1-b6b4a0727496 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:46.451989 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf0cd0-11f5-484d-bf17-30e18b661c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:46.452606 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf0cd0-11f5-484d-bf17-30e18b661c76 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:46.452895 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf0cd0-11f5-484d-bf17-30e18b661c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:46.453171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf0cd0-11f5-484d-bf17-30e18b661c76 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:46.453880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf0cd0-11f5-484d-bf17-30e18b661c76 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:46.454188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf0cd0-11f5-484d-bf17-30e18b661c76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:46.455546 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf0cd0-11f5-484d-bf17-30e18b661c76 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:46.460624 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 653/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Thu Jul 28 05:16:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:46.466661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afe9d3-bbb5-4122-a54b-91d867387716 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:46.499435 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:46.567260 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afe9d3-bbb5-4122-a54b-91d867387716 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:46.600646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae6137-30b2-4e0a-af38-bf236373627d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:46.601258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae6137-30b2-4e0a-af38-bf236373627d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:46.601567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae6137-30b2-4e0a-af38-bf236373627d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:46.601843 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae6137-30b2-4e0a-af38-bf236373627d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:46.602628 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae6137-30b2-4e0a-af38-bf236373627d None admin] RBAC: Adding query filter params (interface=public, service_id=2b54f82fbdbb47d881b201152a408846, region_id=RegionOne) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:46.602941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae6137-30b2-4e0a-af38-bf236373627d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:46.604293 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae6137-30b2-4e0a-af38-bf236373627d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:46.609192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 647/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jul 28 05:16:46 2022] GET /identity/v3/endpoints?service_id=2b54f82fbdbb47d881b201152a408846&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:46.615652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf0cd0-11f5-484d-bf17-30e18b661c76 None admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:46.694803 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:46.713052 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf0cd0-11f5-484d-bf17-30e18b661c76 None admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:46.747206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba4475-b9e6-4e70-8071-e4f8a54aec86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:46.751179 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba4475-b9e6-4e70-8071-e4f8a54aec86 None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:46.751179 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba4475-b9e6-4e70-8071-e4f8a54aec86 None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:46.751179 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba4475-b9e6-4e70-8071-e4f8a54aec86 None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:46.751179 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba4475-b9e6-4e70-8071-e4f8a54aec86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:46.751179 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba4475-b9e6-4e70-8071-e4f8a54aec86 None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:46.757084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 654/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jul 28 05:16:46 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:16:48.727425 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aec8fa-20dc-4062-8340-cb6766dae2c0 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:48.728009 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aec8fa-20dc-4062-8340-cb6766dae2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:48.728127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aec8fa-20dc-4062-8340-cb6766dae2c0 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:48.729453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 648/1302] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:16:48.734538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3edc3e-213d-4768-8c27-a0b86a821899 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:48.734971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3edc3e-213d-4768-8c27-a0b86a821899 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:48.735106 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3edc3e-213d-4768-8c27-a0b86a821899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:48.752918 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-4b3edc3e-213d-4768-8c27-a0b86a821899 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:16:48.754649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4b3edc3e-213d-4768-8c27-a0b86a821899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:16:48.820780 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 655/1303] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:16:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:16:48.843572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aec8fa-20dc-4062-8340-cb6766dae2c0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:48.938371 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:48.945674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aec8fa-20dc-4062-8340-cb6766dae2c0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:48.978956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b083cc-f8d9-4d4f-a55f-d86a89075422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:48.979536 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b083cc-f8d9-4d4f-a55f-d86a89075422 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:48.979816 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b083cc-f8d9-4d4f-a55f-d86a89075422 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:48.980091 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b083cc-f8d9-4d4f-a55f-d86a89075422 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:48.980742 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b083cc-f8d9-4d4f-a55f-d86a89075422 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:48.982131 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b083cc-f8d9-4d4f-a55f-d86a89075422 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-f8b083cc-f8d9-4d4f-a55f-d86a89075422 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:16:48.991646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:16:48.992828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:16:48.992828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:16:48.992828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:16:48.992828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:16:48.992828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:16:48.992828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:16:48.992828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:16:48.992828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:16:48.992828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:16:48.992828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:16:48.992828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:16:48.992828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:16:48.992828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:16:48.992828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:16:48.992828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:16:48.992828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:16:48.994096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:16:48.994096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jul 28 05:16:48.994096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:16:48.994096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:16:48.994096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:16:48.994096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:16:48.994096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:16:48.994096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:16:48.994096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:16:48.994096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:16:48.994096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:16:48.994096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:16:48.994096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:16:48.994096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jul 28 05:16:48.994096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 649/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jul 28 05:16:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:16:48.998990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3edc3e-213d-4768-8c27-a0b86a821899 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:49.075690 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:49.097492 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3edc3e-213d-4768-8c27-a0b86a821899 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:49.131539 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a5e12-bd9f-4640-a55e-b45521c6809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:49.132148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a5e12-bd9f-4640-a55e-b45521c6809f None admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:49.132425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a5e12-bd9f-4640-a55e-b45521c6809f None admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:49.132692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a5e12-bd9f-4640-a55e-b45521c6809f None admin] PATH_INFO: `/v3/services` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:49.133351 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a5e12-bd9f-4640-a55e-b45521c6809f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:16:49.133723 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a5e12-bd9f-4640-a55e-b45521c6809f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:49.135067 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a5e12-bd9f-4640-a55e-b45521c6809f None admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:49.140061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 656/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Thu Jul 28 05:16:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:16:49.146157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b083cc-f8d9-4d4f-a55f-d86a89075422 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:16:49.245590 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b083cc-f8d9-4d4f-a55f-d86a89075422 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:16:49.279090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa632a-f742-4b09-b868-65cac347127a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:16:49.279710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa632a-f742-4b09-b868-65cac347127a None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:16:49.279992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa632a-f742-4b09-b868-65cac347127a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:16:49.280268 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa632a-f742-4b09-b868-65cac347127a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:16:49.280979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa632a-f742-4b09-b868-65cac347127a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:16:49.282468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa632a-f742-4b09-b868-65cac347127a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:16:49.352945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 650/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:16:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:16:59.137062 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=30 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:16:59.347688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:22:38.220933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efefc8-0992-4f7c-bb92-01e31755f0ee None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:38.221429 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efefc8-0992-4f7c-bb92-01e31755f0ee None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:38.221551 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efefc8-0992-4f7c-bb92-01e31755f0ee None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:38.223021 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 657/1307] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:22:38.233102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9939c19-fa16-4daf-babe-54486669c97a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:38.234762 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9939c19-fa16-4daf-babe-54486669c97a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:38.235910 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9939c19-fa16-4daf-babe-54486669c97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:38.418093 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b9939c19-fa16-4daf-babe-54486669c97a None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:22:38.419884 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b9939c19-fa16-4daf-babe-54486669c97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:38.546783 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 651/1308] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:22:38.598123 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b68228-d400-4d2f-91b2-e0ae602f79c4 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:38.598485 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b68228-d400-4d2f-91b2-e0ae602f79c4 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:38.598843 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b68228-d400-4d2f-91b2-e0ae602f79c4 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:38.600991 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 658/1309] 10.222.0.33 () {54 vars in 965 bytes} [Thu Jul 28 05:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:22:38.612056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0384ba-ba65-4133-983d-5c3ffec794fe None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:38.612395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0384ba-ba65-4133-983d-5c3ffec794fe None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:38.612603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0384ba-ba65-4133-983d-5c3ffec794fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:38.708354 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-fb0384ba-ba65-4133-983d-5c3ffec794fe None None] MFA Rules not processed for user `6907d8a429404b1c92805b364900ba60`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:22:38.710150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fb0384ba-ba65-4133-983d-5c3ffec794fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:38.737079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:22:38.811396 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 652/1310] 10.222.0.33 () {58 vars in 1062 bytes} [Thu Jul 28 05:22:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:22:38.820273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b68228-d400-4d2f-91b2-e0ae602f79c4 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:22:38.822044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-36b68228-d400-4d2f-91b2-e0ae602f79c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:38.940638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b68228-d400-4d2f-91b2-e0ae602f79c4 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:22:39.021699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e189f8-de1b-40a7-b494-15643aaac8f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:22:39.022455 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e189f8-de1b-40a7-b494-15643aaac8f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:39.022733 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e189f8-de1b-40a7-b494-15643aaac8f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:39.023006 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e189f8-de1b-40a7-b494-15643aaac8f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:39.024766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-a5e189f8-de1b-40a7-b494-15643aaac8f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:39.088927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:22:39.152154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e189f8-de1b-40a7-b494-15643aaac8f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:22:39.154543 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e189f8-de1b-40a7-b494-15643aaac8f2 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:22:39.179580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 659/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:22:41.537024 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd81756-45ee-431f-9679-9f24b4246c15 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:41.537670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd81756-45ee-431f-9679-9f24b4246c15 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:41.537670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd81756-45ee-431f-9679-9f24b4246c15 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:41.538986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 653/1312] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:22:41.545334 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe538e-689e-4f84-9169-4679664dacc1 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:41.546043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe538e-689e-4f84-9169-4679664dacc1 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:41.546311 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe538e-689e-4f84-9169-4679664dacc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:41.618540 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-76fe538e-689e-4f84-9169-4679664dacc1 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:22:41.619921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-76fe538e-689e-4f84-9169-4679664dacc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:41.720474 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 660/1313] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:22:41.759430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd81756-45ee-431f-9679-9f24b4246c15 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:22:41.761004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fdd81756-45ee-431f-9679-9f24b4246c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:41.871732 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd81756-45ee-431f-9679-9f24b4246c15 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:22:41.951769 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:22:41.954355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67b1a6-b296-43e5-b2f1-46af5f1233a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:22:41.955000 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67b1a6-b296-43e5-b2f1-46af5f1233a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:41.955282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67b1a6-b296-43e5-b2f1-46af5f1233a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:41.955561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67b1a6-b296-43e5-b2f1-46af5f1233a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:41.957272 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3e67b1a6-b296-43e5-b2f1-46af5f1233a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:42.075193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67b1a6-b296-43e5-b2f1-46af5f1233a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:22:42.076723 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67b1a6-b296-43e5-b2f1-46af5f1233a2 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:22:42.096795 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 654/1314] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:22:44.633146 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3eb31-ae1b-4dc3-b270-7f8c4bafc17e None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:44.633754 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3eb31-ae1b-4dc3-b270-7f8c4bafc17e None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:44.633754 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3eb31-ae1b-4dc3-b270-7f8c4bafc17e None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:44.635093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 661/1315] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:22:44.640434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc882fcc-40b3-4865-982a-051325aa012c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:44.640834 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc882fcc-40b3-4865-982a-051325aa012c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:44.640998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc882fcc-40b3-4865-982a-051325aa012c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:44.706326 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-bc882fcc-40b3-4865-982a-051325aa012c None None] MFA Rules not processed for user `dcb0c8567f0646d2836a2ca21b79e432`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:22:44.707538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bc882fcc-40b3-4865-982a-051325aa012c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:44.758509 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:22:44.802358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 655/1316] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:22:44 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:22:44.842495 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3eb31-ae1b-4dc3-b270-7f8c4bafc17e None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:22:44.844036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-8ca3eb31-ae1b-4dc3-b270-7f8c4bafc17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:44.853677 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:22:44.947476 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3eb31-ae1b-4dc3-b270-7f8c4bafc17e None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:22:45.020160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fd26b-053f-4d91-a302-0a08dc4941c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:22:45.020778 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fd26b-053f-4d91-a302-0a08dc4941c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:45.021054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fd26b-053f-4d91-a302-0a08dc4941c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:45.021322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fd26b-053f-4d91-a302-0a08dc4941c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:45.022960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-765fd26b-053f-4d91-a302-0a08dc4941c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:45.084220 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:22:45.130777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fd26b-053f-4d91-a302-0a08dc4941c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:22:45.132193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fd26b-053f-4d91-a302-0a08dc4941c1 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:22:45.149774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 662/1317] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:22:44 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:22:48.036645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be091a6d-6a81-4967-bcc9-1ae856b1d412 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:48.037245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be091a6d-6a81-4967-bcc9-1ae856b1d412 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:48.037245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be091a6d-6a81-4967-bcc9-1ae856b1d412 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:48.038621 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 656/1318] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:22:48.044255 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c2f07-8979-4d3f-9d3a-ed4d34f7b123 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:48.044716 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c2f07-8979-4d3f-9d3a-ed4d34f7b123 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:48.044835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c2f07-8979-4d3f-9d3a-ed4d34f7b123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:48.109568 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-051c2f07-8979-4d3f-9d3a-ed4d34f7b123 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:22:48.110778 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-051c2f07-8979-4d3f-9d3a-ed4d34f7b123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:48.205538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 663/1319] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:22:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:22:48.244280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be091a6d-6a81-4967-bcc9-1ae856b1d412 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:22:48.245893 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-be091a6d-6a81-4967-bcc9-1ae856b1d412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:48.347735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be091a6d-6a81-4967-bcc9-1ae856b1d412 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:22:48.420232 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1cc96-dab3-4c0f-b97b-03dfaddfd033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:22:48.421112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1cc96-dab3-4c0f-b97b-03dfaddfd033 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:48.421393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1cc96-dab3-4c0f-b97b-03dfaddfd033 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:48.421698 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1cc96-dab3-4c0f-b97b-03dfaddfd033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:48.423313 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9ba1cc96-dab3-4c0f-b97b-03dfaddfd033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:48.430681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:22:48.530709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1cc96-dab3-4c0f-b97b-03dfaddfd033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:22:48.532130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1cc96-dab3-4c0f-b97b-03dfaddfd033 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:22:48.550602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 657/1320] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:22:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:22:51.664321 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ea1f1-ac34-43f3-9223-31c0300c12e3 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:51.664892 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ea1f1-ac34-43f3-9223-31c0300c12e3 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:51.664892 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ea1f1-ac34-43f3-9223-31c0300c12e3 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:51.666272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 664/1321] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:22:51.672361 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e634d-a26a-425a-8234-70ddb32dd3ba None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:51.672757 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e634d-a26a-425a-8234-70ddb32dd3ba None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:51.672908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e634d-a26a-425a-8234-70ddb32dd3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:51.739264 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-254e634d-a26a-425a-8234-70ddb32dd3ba None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:22:51.740481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-254e634d-a26a-425a-8234-70ddb32dd3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:51.798915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:22:51.838589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 658/1322] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:22:51.890134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb836e-98a5-48f0-9e9f-7416518b6f26 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:51.890423 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb836e-98a5-48f0-9e9f-7416518b6f26 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:51.890705 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb836e-98a5-48f0-9e9f-7416518b6f26 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:51.892075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 665/1323] 10.222.0.33 () {54 vars in 965 bytes} [Thu Jul 28 05:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:22:51.898202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09218fd-4d64-4408-b800-f91592330a36 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:51.898495 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09218fd-4d64-4408-b800-f91592330a36 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:51.898778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09218fd-4d64-4408-b800-f91592330a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:51.982833 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d09218fd-4d64-4408-b800-f91592330a36 None None] MFA Rules not processed for user `6907d8a429404b1c92805b364900ba60`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:22:51.984184 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d09218fd-4d64-4408-b800-f91592330a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:52.072567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 659/1324] 10.222.0.33 () {58 vars in 1062 bytes} [Thu Jul 28 05:22:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:22:52.082850 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb836e-98a5-48f0-9e9f-7416518b6f26 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:22:52.084403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-1beb836e-98a5-48f0-9e9f-7416518b6f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:52.104741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:22:52.198382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb836e-98a5-48f0-9e9f-7416518b6f26 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:22:52.281545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfebfc-de1a-47cd-a84f-111852136e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:22:52.282174 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfebfc-de1a-47cd-a84f-111852136e6c service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:52.282454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfebfc-de1a-47cd-a84f-111852136e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:52.282725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfebfc-de1a-47cd-a84f-111852136e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:52.284381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c7cfebfc-de1a-47cd-a84f-111852136e6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:52.369527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:22:52.411927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfebfc-de1a-47cd-a84f-111852136e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:22:52.413371 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfebfc-de1a-47cd-a84f-111852136e6c service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:22:52.434157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 666/1325] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:22:54.768492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27203c9c-efbd-4d98-9af1-d3c7eb8cf0f0 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:54.769015 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27203c9c-efbd-4d98-9af1-d3c7eb8cf0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:54.769124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27203c9c-efbd-4d98-9af1-d3c7eb8cf0f0 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:54.770436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 660/1326] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:22:54.775580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92684ecb-6b40-48ec-982c-f5e49c9060dd None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:54.776013 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92684ecb-6b40-48ec-982c-f5e49c9060dd None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:54.776159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92684ecb-6b40-48ec-982c-f5e49c9060dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:54.842537 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-92684ecb-6b40-48ec-982c-f5e49c9060dd None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:22:54.843738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-92684ecb-6b40-48ec-982c-f5e49c9060dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:54.948310 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 667/1327] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:22:54.986790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27203c9c-efbd-4d98-9af1-d3c7eb8cf0f0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:22:54.988386 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-27203c9c-efbd-4d98-9af1-d3c7eb8cf0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:55.050846 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:22:55.094816 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27203c9c-efbd-4d98-9af1-d3c7eb8cf0f0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:22:55.176561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edf9c0-b8b2-475c-abca-a7f4867753f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:22:55.177189 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edf9c0-b8b2-475c-abca-a7f4867753f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:55.177501 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edf9c0-b8b2-475c-abca-a7f4867753f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:55.177781 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edf9c0-b8b2-475c-abca-a7f4867753f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:55.179410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c6edf9c0-b8b2-475c-abca-a7f4867753f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:55.288772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:22:55.291288 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edf9c0-b8b2-475c-abca-a7f4867753f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:22:55.293405 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edf9c0-b8b2-475c-abca-a7f4867753f7 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:22:55.312320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 661/1328] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:22:57.396736 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14704c1f-2c33-4677-868b-aafcfc678ddd None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:57.397289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14704c1f-2c33-4677-868b-aafcfc678ddd None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:57.397289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14704c1f-2c33-4677-868b-aafcfc678ddd None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:57.398687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 668/1329] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:22:57.404041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f91d7e-6879-4842-91a7-7bf99fe97e3f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:57.404459 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f91d7e-6879-4842-91a7-7bf99fe97e3f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:57.404599 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f91d7e-6879-4842-91a7-7bf99fe97e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:57.470431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e4f91d7e-6879-4842-91a7-7bf99fe97e3f None None] MFA Rules not processed for user `dcb0c8567f0646d2836a2ca21b79e432`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:22:57.471661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e4f91d7e-6879-4842-91a7-7bf99fe97e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:57.570969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 662/1330] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:22:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:22:57.608306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14704c1f-2c33-4677-868b-aafcfc678ddd None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:22:57.609957 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-14704c1f-2c33-4677-868b-aafcfc678ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:57.641274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:22:57.714878 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14704c1f-2c33-4677-868b-aafcfc678ddd None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:22:57.806730 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db7640-958a-4a96-a30a-cd6296ec3459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:22:57.807448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db7640-958a-4a96-a30a-cd6296ec3459 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:22:57.807821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db7640-958a-4a96-a30a-cd6296ec3459 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:22:57.808275 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db7640-958a-4a96-a30a-cd6296ec3459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:22:57.810930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f7db7640-958a-4a96-a30a-cd6296ec3459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:22:57.891568 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:22:57.924038 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db7640-958a-4a96-a30a-cd6296ec3459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:22:57.925488 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db7640-958a-4a96-a30a-cd6296ec3459 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:22:57.944057 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 669/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:22:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:23:00.689983 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d987c4-df23-4cfe-b749-822e889e2ac8 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:00.690518 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d987c4-df23-4cfe-b749-822e889e2ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:00.690615 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d987c4-df23-4cfe-b749-822e889e2ac8 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:00.691931 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 663/1332] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:00.697104 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7083bf-de9b-4a04-896f-e184dfbf0a90 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:00.697573 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7083bf-de9b-4a04-896f-e184dfbf0a90 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:00.697710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7083bf-de9b-4a04-896f-e184dfbf0a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:00.764801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-bb7083bf-de9b-4a04-896f-e184dfbf0a90 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:00.766052 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-bb7083bf-de9b-4a04-896f-e184dfbf0a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:00.862079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 670/1333] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:00.898700 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d987c4-df23-4cfe-b749-822e889e2ac8 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:00.900246 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-93d987c4-df23-4cfe-b749-822e889e2ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:00.969398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:01.003208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d987c4-df23-4cfe-b749-822e889e2ac8 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:01.076288 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfb1c8-66d7-4aa7-8a15-6fe05cf00adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:01.076908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfb1c8-66d7-4aa7-8a15-6fe05cf00adc service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:01.077199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfb1c8-66d7-4aa7-8a15-6fe05cf00adc service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:01.077493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfb1c8-66d7-4aa7-8a15-6fe05cf00adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:01.079125 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0fcfb1c8-66d7-4aa7-8a15-6fe05cf00adc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:01.185891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfb1c8-66d7-4aa7-8a15-6fe05cf00adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:01.187323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfb1c8-66d7-4aa7-8a15-6fe05cf00adc service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:01.197252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:01.207287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 664/1334] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:23:03.252981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a277d-04cb-4916-9d1a-3ba074f71b06 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:03.253572 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a277d-04cb-4916-9d1a-3ba074f71b06 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:03.253572 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a277d-04cb-4916-9d1a-3ba074f71b06 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:03.254948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 671/1335] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:03.260024 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baed8a-9eb0-4a16-8fc5-3464405953b2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:03.260438 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baed8a-9eb0-4a16-8fc5-3464405953b2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:03.260587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baed8a-9eb0-4a16-8fc5-3464405953b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:03.325862 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-00baed8a-9eb0-4a16-8fc5-3464405953b2 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:03.327050 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-00baed8a-9eb0-4a16-8fc5-3464405953b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:03.422698 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 665/1336] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:03.461924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a277d-04cb-4916-9d1a-3ba074f71b06 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:03.463467 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9b3a277d-04cb-4916-9d1a-3ba074f71b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:03.504476 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:03.568060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a277d-04cb-4916-9d1a-3ba074f71b06 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:03.639939 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384668d-9835-40de-9a64-63b06b59196b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:03.640550 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384668d-9835-40de-9a64-63b06b59196b service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:03.640822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384668d-9835-40de-9a64-63b06b59196b service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:03.641088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384668d-9835-40de-9a64-63b06b59196b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:03.642785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f384668d-9835-40de-9a64-63b06b59196b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:03.725416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:03.754165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384668d-9835-40de-9a64-63b06b59196b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:03.756018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384668d-9835-40de-9a64-63b06b59196b service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:03.773883 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 672/1337] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:23:06.370064 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481eb407-bd25-4071-af49-263fd43ad08e None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:06.370581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481eb407-bd25-4071-af49-263fd43ad08e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:06.370831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481eb407-bd25-4071-af49-263fd43ad08e None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:06.372265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 666/1338] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:06.377521 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f8327-09ce-4bb9-9fb7-f2882e8ff4d3 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:06.377922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f8327-09ce-4bb9-9fb7-f2882e8ff4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:06.378079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f8327-09ce-4bb9-9fb7-f2882e8ff4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:06.443548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-4f7f8327-09ce-4bb9-9fb7-f2882e8ff4d3 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:06.444751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4f7f8327-09ce-4bb9-9fb7-f2882e8ff4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:06.541408 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 673/1339] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:06.578548 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481eb407-bd25-4071-af49-263fd43ad08e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:06.580155 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-481eb407-bd25-4071-af49-263fd43ad08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:06.656396 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:06.685872 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481eb407-bd25-4071-af49-263fd43ad08e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:06.759153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd6784-45cb-4d0d-993b-f1d3c68fcebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:06.759756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd6784-45cb-4d0d-993b-f1d3c68fcebf service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:06.760041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd6784-45cb-4d0d-993b-f1d3c68fcebf service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:06.760319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd6784-45cb-4d0d-993b-f1d3c68fcebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:06.762241 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9bbd6784-45cb-4d0d-993b-f1d3c68fcebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:06.869971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd6784-45cb-4d0d-993b-f1d3c68fcebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:06.872060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd6784-45cb-4d0d-993b-f1d3c68fcebf service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:06.889897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 667/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:23:11.117711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab306-7d46-4e87-a939-501b573f6f67 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:11.118301 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab306-7d46-4e87-a939-501b573f6f67 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:11.118301 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab306-7d46-4e87-a939-501b573f6f67 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:11.119829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 674/1341] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:11.126084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d272a1-8f4c-4f85-a412-aba508d4504d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:11.126606 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d272a1-8f4c-4f85-a412-aba508d4504d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:11.126939 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d272a1-8f4c-4f85-a412-aba508d4504d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:11.132438 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:11.208052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-f5d272a1-8f4c-4f85-a412-aba508d4504d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:11.209089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f5d272a1-8f4c-4f85-a412-aba508d4504d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:11.324345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 668/1342] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:11.363231 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbab306-7d46-4e87-a939-501b573f6f67 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:11.364779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2dbab306-7d46-4e87-a939-501b573f6f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:11.414900 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:11.476760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbab306-7d46-4e87-a939-501b573f6f67 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:11.554551 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44604729-d69e-4664-abd4-9090e1af19b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:11.555177 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44604729-d69e-4664-abd4-9090e1af19b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:11.555457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44604729-d69e-4664-abd4-9090e1af19b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:11.555729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44604729-d69e-4664-abd4-9090e1af19b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:11.557408 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-44604729-d69e-4664-abd4-9090e1af19b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:11.651815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:11.668862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44604729-d69e-4664-abd4-9090e1af19b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:11.670577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44604729-d69e-4664-abd4-9090e1af19b5 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:11.689269 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 675/1343] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:23:14.689500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bab83-a53f-461f-a0da-8519601903e4 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:14.690086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bab83-a53f-461f-a0da-8519601903e4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:14.690187 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bab83-a53f-461f-a0da-8519601903e4 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:14.691498 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 669/1344] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:14.697100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20db42-ac8a-4d34-98c5-f0484ef79cd2 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:14.697627 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20db42-ac8a-4d34-98c5-f0484ef79cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:14.697736 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20db42-ac8a-4d34-98c5-f0484ef79cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:14.770780 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-5c20db42-ac8a-4d34-98c5-f0484ef79cd2 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:14.772059 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5c20db42-ac8a-4d34-98c5-f0484ef79cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:14.875607 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 676/1345] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:14.912539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bab83-a53f-461f-a0da-8519601903e4 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:14.914116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-808bab83-a53f-461f-a0da-8519601903e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:15.003537 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:15.020104 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bab83-a53f-461f-a0da-8519601903e4 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:15.094035 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd417bb0-75ba-47b1-9f5c-adef8cd3ba50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:15.094586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd417bb0-75ba-47b1-9f5c-adef8cd3ba50 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:15.094863 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd417bb0-75ba-47b1-9f5c-adef8cd3ba50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:15.095133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd417bb0-75ba-47b1-9f5c-adef8cd3ba50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:15.096749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cd417bb0-75ba-47b1-9f5c-adef8cd3ba50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:15.206049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd417bb0-75ba-47b1-9f5c-adef8cd3ba50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:15.207491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd417bb0-75ba-47b1-9f5c-adef8cd3ba50 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:15.226595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 670/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:23:19.782890 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae699e-926c-4c13-860f-ee1764a95e61 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:19.783403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae699e-926c-4c13-860f-ee1764a95e61 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:19.783577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae699e-926c-4c13-860f-ee1764a95e61 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:19.785075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 677/1347] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:19.790584 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce05b6-bd55-444e-90f1-ade84ea60896 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:19.791070 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce05b6-bd55-444e-90f1-ade84ea60896 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:19.791167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce05b6-bd55-444e-90f1-ade84ea60896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:19.808023 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:19.861635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-29ce05b6-bd55-444e-90f1-ade84ea60896 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:19.862847 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-29ce05b6-bd55-444e-90f1-ade84ea60896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:19.967337 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 671/1348] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:20.005659 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae699e-926c-4c13-860f-ee1764a95e61 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:20.007248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-3dae699e-926c-4c13-860f-ee1764a95e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:20.069971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:20.118796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae699e-926c-4c13-860f-ee1764a95e61 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:20.195742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaac6dd-3009-4a6f-ad30-6701c64b25e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:20.196370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaac6dd-3009-4a6f-ad30-6701c64b25e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:20.196648 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaac6dd-3009-4a6f-ad30-6701c64b25e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:20.196920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaac6dd-3009-4a6f-ad30-6701c64b25e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:20.199404 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4aaac6dd-3009-4a6f-ad30-6701c64b25e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:20.313570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:20.316762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaac6dd-3009-4a6f-ad30-6701c64b25e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:20.318218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaac6dd-3009-4a6f-ad30-6701c64b25e0 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:20.336970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 678/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:23:25.281041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92109174-def3-4875-a711-27957011f0d0 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:25.286851 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92109174-def3-4875-a711-27957011f0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:25.287163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92109174-def3-4875-a711-27957011f0d0 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:25.288635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 672/1350] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jul 28 05:23:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:25.299187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc53d5-c2de-4f72-b611-ac65ddf79de0 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:25.299686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc53d5-c2de-4f72-b611-ac65ddf79de0 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:25.299766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc53d5-c2de-4f72-b611-ac65ddf79de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:25.394239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-49dc53d5-c2de-4f72-b611-ac65ddf79de0 None None] MFA Rules not processed for user `3aae5b2e7bf74805b04d01df47693ded`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:25.395428 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-49dc53d5-c2de-4f72-b611-ac65ddf79de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:25.515320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 679/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jul 28 05:23:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:29.705943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941843a-b0b4-44fc-badc-ee28013fca95 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:29.706488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941843a-b0b4-44fc-badc-ee28013fca95 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:29.706488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941843a-b0b4-44fc-badc-ee28013fca95 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:29.708089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 673/1352] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jul 28 05:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:29.713717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8421310-f97a-4e31-9974-7e990292c95c None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:29.714177 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8421310-f97a-4e31-9974-7e990292c95c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:29.714260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8421310-f97a-4e31-9974-7e990292c95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:29.770892 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:29.794445 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-f8421310-f97a-4e31-9974-7e990292c95c None None] MFA Rules not processed for user `3aae5b2e7bf74805b04d01df47693ded`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:29.795654 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f8421310-f97a-4e31-9974-7e990292c95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:29.909538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 680/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jul 28 05:23:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:29.965502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=59 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:31.217151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488dcba-a4d0-46f1-9009-064b643b0972 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:31.217848 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488dcba-a4d0-46f1-9009-064b643b0972 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:31.217848 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488dcba-a4d0-46f1-9009-064b643b0972 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:31.219092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 674/1354] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jul 28 05:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:31.224175 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a5791-cf88-4ee8-9f48-1b2814fb4844 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:31.224592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a5791-cf88-4ee8-9f48-1b2814fb4844 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:31.224735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a5791-cf88-4ee8-9f48-1b2814fb4844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:31.307454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-0b5a5791-cf88-4ee8-9f48-1b2814fb4844 None None] MFA Rules not processed for user `3aae5b2e7bf74805b04d01df47693ded`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:31.308671 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-0b5a5791-cf88-4ee8-9f48-1b2814fb4844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:31.351896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:31.420449 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 681/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jul 28 05:23:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:34.726972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edc485-347f-4bd2-9bd1-7145767a5bc6 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:34.727515 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edc485-347f-4bd2-9bd1-7145767a5bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:34.727515 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edc485-347f-4bd2-9bd1-7145767a5bc6 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:34.729729 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 675/1356] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:34.735791 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4587578-7acc-41d8-81bc-763ee101a9b6 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:34.736246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4587578-7acc-41d8-81bc-763ee101a9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:34.736427 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4587578-7acc-41d8-81bc-763ee101a9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:34.824162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e4587578-7acc-41d8-81bc-763ee101a9b6 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:34.825388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e4587578-7acc-41d8-81bc-763ee101a9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:34.937609 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 682/1357] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:35.002153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a4835-3b14-48bd-8d71-2a8912a9add8 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:35.004957 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a4835-3b14-48bd-8d71-2a8912a9add8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:35.004957 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a4835-3b14-48bd-8d71-2a8912a9add8 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:35.005454 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 676/1358] 10.222.0.33 () {54 vars in 962 bytes} [Thu Jul 28 05:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:35.014830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4adb46-197f-49ba-a6bc-42f1ed3f8eaa None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:35.015346 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4adb46-197f-49ba-a6bc-42f1ed3f8eaa None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:35.015622 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4adb46-197f-49ba-a6bc-42f1ed3f8eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:35.033264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:35.095377 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-ff4adb46-197f-49ba-a6bc-42f1ed3f8eaa None None] MFA Rules not processed for user `99d8c709e6f4462c98c055cb03eebf42`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:35.096574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ff4adb46-197f-49ba-a6bc-42f1ed3f8eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:35.220588 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 683/1359] 10.222.0.33 () {58 vars in 1059 bytes} [Thu Jul 28 05:23:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:35.229157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a4835-3b14-48bd-8d71-2a8912a9add8 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:35.230703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-403a4835-3b14-48bd-8d71-2a8912a9add8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:35.391140 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a4835-3b14-48bd-8d71-2a8912a9add8 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:35.468300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:35.515016 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c969ff6-5843-47f8-83a3-1ea803229b7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:35.515658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c969ff6-5843-47f8-83a3-1ea803229b7d service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:35.516061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c969ff6-5843-47f8-83a3-1ea803229b7d service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:35.516351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c969ff6-5843-47f8-83a3-1ea803229b7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:35.518012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0c969ff6-5843-47f8-83a3-1ea803229b7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:35.633399 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c969ff6-5843-47f8-83a3-1ea803229b7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:35.636070 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c969ff6-5843-47f8-83a3-1ea803229b7d service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:35.655881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 677/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:23:37.889068 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad284adc-372a-499f-a2ec-b373f6415e1c None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:37.889518 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad284adc-372a-499f-a2ec-b373f6415e1c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:37.890009 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad284adc-372a-499f-a2ec-b373f6415e1c None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:37.892674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 684/1361] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:37.897977 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba51a5-cf2a-4773-8833-d7283da8641c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:37.898405 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba51a5-cf2a-4773-8833-d7283da8641c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:37.898733 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba51a5-cf2a-4773-8833-d7283da8641c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:37.970534 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2cba51a5-cf2a-4773-8833-d7283da8641c None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:37.971885 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2cba51a5-cf2a-4773-8833-d7283da8641c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:38.012224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:38.079017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 678/1362] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:38.124234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad284adc-372a-499f-a2ec-b373f6415e1c None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:38.125781 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ad284adc-372a-499f-a2ec-b373f6415e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:38.200957 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:38.312271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad284adc-372a-499f-a2ec-b373f6415e1c None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:38.454471 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3216d-c549-4bc0-b413-10ddbf27d1a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:38.455101 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3216d-c549-4bc0-b413-10ddbf27d1a8 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:38.455447 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3216d-c549-4bc0-b413-10ddbf27d1a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:38.455728 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3216d-c549-4bc0-b413-10ddbf27d1a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:38.457589 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4ab3216d-c549-4bc0-b413-10ddbf27d1a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:38.485370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:38.561246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3216d-c549-4bc0-b413-10ddbf27d1a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:38.562956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3216d-c549-4bc0-b413-10ddbf27d1a8 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:38.581529 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 685/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:23:41.073103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c919198-3476-4c51-b8ea-d839f610f7b1 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:41.073708 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c919198-3476-4c51-b8ea-d839f610f7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:41.073708 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c919198-3476-4c51-b8ea-d839f610f7b1 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:41.075384 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 679/1364] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:41.080781 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914349a-86f6-40d2-90e6-5553faf21a31 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:41.141668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914349a-86f6-40d2-90e6-5553faf21a31 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:41.141668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914349a-86f6-40d2-90e6-5553faf21a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:41.157373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-b914349a-86f6-40d2-90e6-5553faf21a31 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:41.158672 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-b914349a-86f6-40d2-90e6-5553faf21a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:41.293418 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:41.301617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 686/1365] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:41.343852 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077e8ab-d699-43ef-b4eb-485ab92fb1cf None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:41.344500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077e8ab-d699-43ef-b4eb-485ab92fb1cf None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:41.344867 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077e8ab-d699-43ef-b4eb-485ab92fb1cf None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:41.346431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 680/1366] 10.222.0.33 () {54 vars in 962 bytes} [Thu Jul 28 05:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:41.352278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be22db-ef1e-42c4-b0d5-4b6ed6efa2f5 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:41.352575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be22db-ef1e-42c4-b0d5-4b6ed6efa2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:41.353445 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be22db-ef1e-42c4-b0d5-4b6ed6efa2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:41.435843 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-40be22db-ef1e-42c4-b0d5-4b6ed6efa2f5 None None] MFA Rules not processed for user `99d8c709e6f4462c98c055cb03eebf42`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:41.437142 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-40be22db-ef1e-42c4-b0d5-4b6ed6efa2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:41.577174 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 687/1367] 10.222.0.33 () {58 vars in 1059 bytes} [Thu Jul 28 05:23:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:41.585319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077e8ab-d699-43ef-b4eb-485ab92fb1cf None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:41.586951 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9077e8ab-d699-43ef-b4eb-485ab92fb1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:41.742630 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077e8ab-d699-43ef-b4eb-485ab92fb1cf None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:41.763512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:41.858295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48dbbc-3870-4a39-aa0b-b3673d8ac6d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:41.858932 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48dbbc-3870-4a39-aa0b-b3673d8ac6d6 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:41.859281 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48dbbc-3870-4a39-aa0b-b3673d8ac6d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:41.859625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48dbbc-3870-4a39-aa0b-b3673d8ac6d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:41.861319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-da48dbbc-3870-4a39-aa0b-b3673d8ac6d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:41.957516 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48dbbc-3870-4a39-aa0b-b3673d8ac6d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:41.957516 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48dbbc-3870-4a39-aa0b-b3673d8ac6d6 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:41.976400 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 681/1368] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:23:42.947986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c80ad6-5023-4af1-a30a-506850085853 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:42.948661 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c80ad6-5023-4af1-a30a-506850085853 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:42.949286 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c80ad6-5023-4af1-a30a-506850085853 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:42.951763 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 688/1369] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:42.957294 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de22ad-f93f-4401-b07e-e3362dd75150 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:42.957756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de22ad-f93f-4401-b07e-e3362dd75150 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:42.957938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de22ad-f93f-4401-b07e-e3362dd75150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:42.995841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:43.032567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-49de22ad-f93f-4401-b07e-e3362dd75150 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:43.033767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-49de22ad-f93f-4401-b07e-e3362dd75150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:43.141460 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 682/1370] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:43.494091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0cc09-4126-4008-b803-e923e3b193e2 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:43.494091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0cc09-4126-4008-b803-e923e3b193e2 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:43.494091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0cc09-4126-4008-b803-e923e3b193e2 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:43.496299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 689/1371] 10.222.0.33 () {54 vars in 964 bytes} [Thu Jul 28 05:23:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:43.500474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a92da-9a5d-4661-8fde-8c2c918a9a39 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:43.500764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a92da-9a5d-4661-8fde-8c2c918a9a39 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:43.501043 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a92da-9a5d-4661-8fde-8c2c918a9a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:43.582528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b57a92da-9a5d-4661-8fde-8c2c918a9a39 None None] MFA Rules not processed for user `bae981c7273843d4ac734dd876bebe5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:43.583663 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b57a92da-9a5d-4661-8fde-8c2c918a9a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:43.635477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:43.669631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 683/1372] 10.222.0.33 () {58 vars in 1061 bytes} [Thu Jul 28 05:23:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:43.676878 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0cc09-4126-4008-b803-e923e3b193e2 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:43.678425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-3af0cc09-4126-4008-b803-e923e3b193e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:43.731759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:43.791727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0cc09-4126-4008-b803-e923e3b193e2 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:43.869629 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4ee34-8f9b-443f-8f9f-dae233890cbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:43.870338 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ee34-8f9b-443f-8f9f-dae233890cbd service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:43.870717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ee34-8f9b-443f-8f9f-dae233890cbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:43.871091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ee34-8f9b-443f-8f9f-dae233890cbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:43.872813 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-19d4ee34-8f9b-443f-8f9f-dae233890cbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:43.977792 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:43.991876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4ee34-8f9b-443f-8f9f-dae233890cbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:43.993402 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4ee34-8f9b-443f-8f9f-dae233890cbd service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:44.014162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 690/1373] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:23:44.268713 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052efa3-dbe2-409e-b6c7-3edb3f96f01f None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:44.269272 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052efa3-dbe2-409e-b6c7-3edb3f96f01f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:44.269272 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052efa3-dbe2-409e-b6c7-3edb3f96f01f None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:44.274137 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 684/1374] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:44.276339 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424127f-d352-49ba-b6d1-82fddbdd14ca None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:44.276689 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424127f-d352-49ba-b6d1-82fddbdd14ca None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:44.276838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424127f-d352-49ba-b6d1-82fddbdd14ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:44.358783 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-0424127f-d352-49ba-b6d1-82fddbdd14ca None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:44.360880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-0424127f-d352-49ba-b6d1-82fddbdd14ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:44.486621 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 691/1375] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:44.531813 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052efa3-dbe2-409e-b6c7-3edb3f96f01f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:44.533335 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e052efa3-dbe2-409e-b6c7-3edb3f96f01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:44.684899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052efa3-dbe2-409e-b6c7-3edb3f96f01f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:44.737764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:44.801235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b58321-be8b-484a-a5b6-af1775b99169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:44.801908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b58321-be8b-484a-a5b6-af1775b99169 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:44.802193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b58321-be8b-484a-a5b6-af1775b99169 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:44.802471 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b58321-be8b-484a-a5b6-af1775b99169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:44.804174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-79b58321-be8b-484a-a5b6-af1775b99169 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:44.895052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b58321-be8b-484a-a5b6-af1775b99169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:44.896647 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b58321-be8b-484a-a5b6-af1775b99169 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:44.915035 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 685/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:23:47.114153 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c91b0-fef9-48b8-a084-1a83a8a21641 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:47.114640 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c91b0-fef9-48b8-a084-1a83a8a21641 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:47.114739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c91b0-fef9-48b8-a084-1a83a8a21641 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:47.116082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 692/1377] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:47.122576 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573a5ef-43c1-4326-907c-fb4f32523d69 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:47.122576 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573a5ef-43c1-4326-907c-fb4f32523d69 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:47.123047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573a5ef-43c1-4326-907c-fb4f32523d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:47.219020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1573a5ef-43c1-4326-907c-fb4f32523d69 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:47.220535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1573a5ef-43c1-4326-907c-fb4f32523d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:47.228907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:47.325044 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 686/1378] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:47.369205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c91b0-fef9-48b8-a084-1a83a8a21641 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:47.370773 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-148c91b0-fef9-48b8-a084-1a83a8a21641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:47.433008 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:47.528257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c91b0-fef9-48b8-a084-1a83a8a21641 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:47.678587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4e5bf-fd98-4e14-9c09-26e02b67aa91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:47.679545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e5bf-fd98-4e14-9c09-26e02b67aa91 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:47.679933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e5bf-fd98-4e14-9c09-26e02b67aa91 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:47.680310 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e5bf-fd98-4e14-9c09-26e02b67aa91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:47.685525 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-b8b4e5bf-fd98-4e14-9c09-26e02b67aa91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:47.715566 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:47.803649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4e5bf-fd98-4e14-9c09-26e02b67aa91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:47.805185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4e5bf-fd98-4e14-9c09-26e02b67aa91 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:47.824223 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 693/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:23:50.002744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cd5e1-0e8d-4055-9447-349fc6450c51 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:50.003295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cd5e1-0e8d-4055-9447-349fc6450c51 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:50.003295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cd5e1-0e8d-4055-9447-349fc6450c51 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:50.005158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 687/1380] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:50.010132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fbd7c-efac-41b9-9a16-7767c320f8ca None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:50.010565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fbd7c-efac-41b9-9a16-7767c320f8ca None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:50.010743 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fbd7c-efac-41b9-9a16-7767c320f8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:50.086225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-238fbd7c-efac-41b9-9a16-7767c320f8ca None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:50.087582 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-238fbd7c-efac-41b9-9a16-7767c320f8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:50.186040 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:50.193509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 694/1381] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:23:50.237943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cd5e1-0e8d-4055-9447-349fc6450c51 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:50.239465 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-859cd5e1-0e8d-4055-9447-349fc6450c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:50.394683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:50.405622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cd5e1-0e8d-4055-9447-349fc6450c51 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:50.539901 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502318ab-21db-404c-9c74-6c8cc5113e21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:50.541113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502318ab-21db-404c-9c74-6c8cc5113e21 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:50.541803 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502318ab-21db-404c-9c74-6c8cc5113e21 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:50.542300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502318ab-21db-404c-9c74-6c8cc5113e21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:50.544990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-502318ab-21db-404c-9c74-6c8cc5113e21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:50.651933 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502318ab-21db-404c-9c74-6c8cc5113e21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:50.653796 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502318ab-21db-404c-9c74-6c8cc5113e21 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:50.668045 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:50.679419 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 688/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:23:53.234577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dd2a8-0f9a-4376-9f7d-cc4aefe33b06 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:53.235163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dd2a8-0f9a-4376-9f7d-cc4aefe33b06 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:53.235163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dd2a8-0f9a-4376-9f7d-cc4aefe33b06 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:53.236852 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 695/1383] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:53.244428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffef686-18f9-4794-ad73-2cf6c4325163 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:53.244879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffef686-18f9-4794-ad73-2cf6c4325163 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:53.244977 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffef686-18f9-4794-ad73-2cf6c4325163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:53.328917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-cffef686-18f9-4794-ad73-2cf6c4325163 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:53.330175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cffef686-18f9-4794-ad73-2cf6c4325163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:53.435699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 689/1384] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:53.483488 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dd2a8-0f9a-4376-9f7d-cc4aefe33b06 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:53.485332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f45dd2a8-0f9a-4376-9f7d-cc4aefe33b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:53.648163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dd2a8-0f9a-4376-9f7d-cc4aefe33b06 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:53.721323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:53.777328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4750f-4c42-49b5-b1a0-ebf8d55bb920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:53.777905 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4750f-4c42-49b5-b1a0-ebf8d55bb920 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:53.778184 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4750f-4c42-49b5-b1a0-ebf8d55bb920 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:53.778463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4750f-4c42-49b5-b1a0-ebf8d55bb920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:53.780267 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-95f4750f-4c42-49b5-b1a0-ebf8d55bb920 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:53.885270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4750f-4c42-49b5-b1a0-ebf8d55bb920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:53.886942 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4750f-4c42-49b5-b1a0-ebf8d55bb920 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:53.909225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 696/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:23:55.944879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6f1f1-2f3a-4245-a8e2-4e5b36c7d3fa None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:55.945561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6f1f1-2f3a-4245-a8e2-4e5b36c7d3fa None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:55.945561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6f1f1-2f3a-4245-a8e2-4e5b36c7d3fa None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:55.947830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 690/1386] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:55.954083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a8b87-cd96-45d3-80a6-55668eed3666 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:55.954507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a8b87-cd96-45d3-80a6-55668eed3666 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:55.954737 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a8b87-cd96-45d3-80a6-55668eed3666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:56.033292 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-9b6a8b87-cd96-45d3-80a6-55668eed3666 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:56.034832 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9b6a8b87-cd96-45d3-80a6-55668eed3666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:56.088794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:56.171928 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 697/1387] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:56.216678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6f1f1-2f3a-4245-a8e2-4e5b36c7d3fa None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:56.218829 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d1f6f1f1-2f3a-4245-a8e2-4e5b36c7d3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:56.312275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:56.385073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6f1f1-2f3a-4245-a8e2-4e5b36c7d3fa None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:56.510919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c6944-c40e-4495-8952-b699a1120e52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:56.511480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c6944-c40e-4495-8952-b699a1120e52 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:56.511760 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c6944-c40e-4495-8952-b699a1120e52 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:56.512038 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c6944-c40e-4495-8952-b699a1120e52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:56.513697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-684c6944-c40e-4495-8952-b699a1120e52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:56.554168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:56.608186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c6944-c40e-4495-8952-b699a1120e52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:56.609853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c6944-c40e-4495-8952-b699a1120e52 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:56.628382 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 691/1388] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:23:58.915926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40346105-48c3-47e1-8985-45d1196942b3 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:58.916435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40346105-48c3-47e1-8985-45d1196942b3 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:58.916435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40346105-48c3-47e1-8985-45d1196942b3 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:58.918131 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 698/1389] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:58.923406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c53d4b-3f0e-4187-a0e1-8aacae3af817 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:58.923818 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c53d4b-3f0e-4187-a0e1-8aacae3af817 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:58.923985 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c53d4b-3f0e-4187-a0e1-8aacae3af817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:58.989937 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-18c53d4b-3f0e-4187-a0e1-8aacae3af817 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:58.991143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-18c53d4b-3f0e-4187-a0e1-8aacae3af817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:59.090735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 692/1390] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:59.134695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40346105-48c3-47e1-8985-45d1196942b3 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:59.136351 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-40346105-48c3-47e1-8985-45d1196942b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:59.285122 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40346105-48c3-47e1-8985-45d1196942b3 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:59.302211 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:59.399877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaac35-bfbb-4a8c-aca1-6aeb13839da8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:59.400511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaac35-bfbb-4a8c-aca1-6aeb13839da8 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:59.400794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaac35-bfbb-4a8c-aca1-6aeb13839da8 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:59.401073 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaac35-bfbb-4a8c-aca1-6aeb13839da8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:59.402770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-26eaac35-bfbb-4a8c-aca1-6aeb13839da8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:59.446513 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd7efc-8a3c-4739-8977-cfd3129527a4 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:59.446882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd7efc-8a3c-4739-8977-cfd3129527a4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:59.447078 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd7efc-8a3c-4739-8977-cfd3129527a4 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:59.448435 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 693/1391] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:23:59.453388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9f901-c652-4a53-b0bc-1e9a3cd9518c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:59.453708 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9f901-c652-4a53-b0bc-1e9a3cd9518c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:59.453993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9f901-c652-4a53-b0bc-1e9a3cd9518c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:59.469862 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:59.496613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eaac35-bfbb-4a8c-aca1-6aeb13839da8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:59.498268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eaac35-bfbb-4a8c-aca1-6aeb13839da8 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:59.517001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 699/1392] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:23:59.522258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-0ab9f901-c652-4a53-b0bc-1e9a3cd9518c None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:59.523646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0ab9f901-c652-4a53-b0bc-1e9a3cd9518c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:59.629134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 694/1393] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:23:59.686125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674e225-1add-431a-8f36-d14421f71cc5 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:59.686417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674e225-1add-431a-8f36-d14421f71cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:59.686773 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674e225-1add-431a-8f36-d14421f71cc5 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:59.688354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 700/1394] 10.222.0.33 () {54 vars in 966 bytes} [Thu Jul 28 05:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:59.694067 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988f599-40d7-41f6-8a0c-618c57e03935 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:59.694359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988f599-40d7-41f6-8a0c-618c57e03935 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:59.694728 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988f599-40d7-41f6-8a0c-618c57e03935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:59.781992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-0988f599-40d7-41f6-8a0c-618c57e03935 None None] MFA Rules not processed for user `628ef75fa7194253bcf6cd6c85211738`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:59.783135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0988f599-40d7-41f6-8a0c-618c57e03935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:59.822557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:59.866030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 695/1395] 10.222.0.33 () {58 vars in 1063 bytes} [Thu Jul 28 05:23:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:23:59.874414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674e225-1add-431a-8f36-d14421f71cc5 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:59.875964 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7674e225-1add-431a-8f36-d14421f71cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:59.898352 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:59.981154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674e225-1add-431a-8f36-d14421f71cc5 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:00.056445 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454da82-e438-4c80-b3ac-2b8952ca321e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628ef75fa7194253bcf6cd6c85211738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:00.056965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454da82-e438-4c80-b3ac-2b8952ca321e service glance] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:00.057307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454da82-e438-4c80-b3ac-2b8952ca321e service glance] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:00.057629 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454da82-e438-4c80-b3ac-2b8952ca321e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:00.059260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-a454da82-e438-4c80-b3ac-2b8952ca321e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:00.133843 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:00.171161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454da82-e438-4c80-b3ac-2b8952ca321e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:00.172580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454da82-e438-4c80-b3ac-2b8952ca321e service glance] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:00.190437 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 701/1396] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:01.074266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ade71-3931-4ff2-a40e-cbfc4274feda None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:01.074747 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ade71-3931-4ff2-a40e-cbfc4274feda None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:01.074957 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ade71-3931-4ff2-a40e-cbfc4274feda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:01.145732 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e08ade71-3931-4ff2-a40e-cbfc4274feda None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:01.146939 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e08ade71-3931-4ff2-a40e-cbfc4274feda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:01.235023 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 696/1397] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jul 28 05:24:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:01.282303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a62c-4083-436e-94c2-d8ca2d4c1fe6 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:01.282783 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a62c-4083-436e-94c2-d8ca2d4c1fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:01.282973 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a62c-4083-436e-94c2-d8ca2d4c1fe6 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:01.284319 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 702/1398] 10.222.0.33 () {54 vars in 943 bytes} [Thu Jul 28 05:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:01.291183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcb555-f026-4620-a866-0d20b2fc7fe2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:01.291490 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcb555-f026-4620-a866-0d20b2fc7fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:01.291801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcb555-f026-4620-a866-0d20b2fc7fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:01.349155 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:01.368885 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-31fcb555-f026-4620-a866-0d20b2fc7fe2 None None] MFA Rules not processed for user `eb89e2ac885f42eb95fe3b67f3808ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:01.370115 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-31fcb555-f026-4620-a866-0d20b2fc7fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:01.483044 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 697/1399] 10.222.0.33 () {58 vars in 1040 bytes} [Thu Jul 28 05:24:01 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:24:01.494084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30a62c-4083-436e-94c2-d8ca2d4c1fe6 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:01.495605 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6f30a62c-4083-436e-94c2-d8ca2d4c1fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:01.646050 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30a62c-4083-436e-94c2-d8ca2d4c1fe6 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:01.669148 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5590bbe-d903-42fa-a50e-92be95d89a10 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:01.669678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5590bbe-d903-42fa-a50e-92be95d89a10 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:01.670163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5590bbe-d903-42fa-a50e-92be95d89a10 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:01.671692 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 698/1400] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:24:01.678629 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa35dd-e984-4cbb-85f3-7a2fe494ad6b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:01.678918 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa35dd-e984-4cbb-85f3-7a2fe494ad6b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:01.679226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa35dd-e984-4cbb-85f3-7a2fe494ad6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:01.697818 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:01.764749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e4aa35dd-e984-4cbb-85f3-7a2fe494ad6b None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:01.766671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e4aa35dd-e984-4cbb-85f3-7a2fe494ad6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:01.786634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373bb06-5f95-42ec-8bef-d857bf93b5b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:01.787381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373bb06-5f95-42ec-8bef-d857bf93b5b2 service swift] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:01.787690 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373bb06-5f95-42ec-8bef-d857bf93b5b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:01.788083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373bb06-5f95-42ec-8bef-d857bf93b5b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:01.790667 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7373bb06-5f95-42ec-8bef-d857bf93b5b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:01.843016 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:01.885535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 699/1401] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:24:01.900871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373bb06-5f95-42ec-8bef-d857bf93b5b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:01.902443 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373bb06-5f95-42ec-8bef-d857bf93b5b2 service swift] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:01.910701 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 703/1402] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:24:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 05:24:01.933431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa35dd-e984-4cbb-85f3-7a2fe494ad6b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:01.933431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e4aa35dd-e984-4cbb-85f3-7a2fe494ad6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:02.048695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa35dd-e984-4cbb-85f3-7a2fe494ad6b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:02.115255 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:02.162678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40001692-2bd6-43b3-9421-0e3bbfaa494b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:02.163317 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40001692-2bd6-43b3-9421-0e3bbfaa494b service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:02.163600 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40001692-2bd6-43b3-9421-0e3bbfaa494b service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:02.163876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40001692-2bd6-43b3-9421-0e3bbfaa494b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:02.165721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-40001692-2bd6-43b3-9421-0e3bbfaa494b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:02.265576 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40001692-2bd6-43b3-9421-0e3bbfaa494b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:02.267145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40001692-2bd6-43b3-9421-0e3bbfaa494b service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:02.287853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 700/1403] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:04.444141 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca250c2c-0175-436a-a86d-634faec3e774 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:04.444748 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca250c2c-0175-436a-a86d-634faec3e774 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:04.444748 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca250c2c-0175-436a-a86d-634faec3e774 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:04.446633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 704/1404] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:24:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:24:04.452194 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008f8b8-108c-4ed4-9093-1782acfb66a9 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:04.452734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008f8b8-108c-4ed4-9093-1782acfb66a9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:04.452734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008f8b8-108c-4ed4-9093-1782acfb66a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:04.524756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-0008f8b8-108c-4ed4-9093-1782acfb66a9 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:04.525990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0008f8b8-108c-4ed4-9093-1782acfb66a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:04.562752 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:04.639750 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 701/1405] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:04.686157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca250c2c-0175-436a-a86d-634faec3e774 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:04.687958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ca250c2c-0175-436a-a86d-634faec3e774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:04.778035 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:04.860095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca250c2c-0175-436a-a86d-634faec3e774 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:04.999310 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e283bf-b6c7-44c0-be2d-112d2aa7191a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:05.000301 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e283bf-b6c7-44c0-be2d-112d2aa7191a service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:05.000644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e283bf-b6c7-44c0-be2d-112d2aa7191a service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:05.000981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e283bf-b6c7-44c0-be2d-112d2aa7191a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:05.002710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-54e283bf-b6c7-44c0-be2d-112d2aa7191a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:05.050383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:05.107549 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e283bf-b6c7-44c0-be2d-112d2aa7191a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:05.110470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e283bf-b6c7-44c0-be2d-112d2aa7191a service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:05.129852 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 705/1406] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:07.421396 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1838dca-9cce-4b87-9aef-8da19c93bda6 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:07.422044 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1838dca-9cce-4b87-9aef-8da19c93bda6 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:07.422044 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1838dca-9cce-4b87-9aef-8da19c93bda6 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:07.423338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 702/1407] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:07.428446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79963580-dc35-4b1c-bac8-f6f06ff7d7c0 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:07.428879 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79963580-dc35-4b1c-bac8-f6f06ff7d7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:07.428992 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79963580-dc35-4b1c-bac8-f6f06ff7d7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:07.503148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-79963580-dc35-4b1c-bac8-f6f06ff7d7c0 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:07.504440 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-79963580-dc35-4b1c-bac8-f6f06ff7d7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:07.642693 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 706/1408] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:07.662602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1838dca-9cce-4b87-9aef-8da19c93bda6 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:07.664696 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d1838dca-9cce-4b87-9aef-8da19c93bda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:07.840575 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1838dca-9cce-4b87-9aef-8da19c93bda6 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:07.860480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:08.089935 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434c50e-f31a-48e6-a6ba-358fab10cfb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:08.090731 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434c50e-f31a-48e6-a6ba-358fab10cfb5 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:08.091105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434c50e-f31a-48e6-a6ba-358fab10cfb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:08.091451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434c50e-f31a-48e6-a6ba-358fab10cfb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:08.093167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1434c50e-f31a-48e6-a6ba-358fab10cfb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:08.193286 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434c50e-f31a-48e6-a6ba-358fab10cfb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:08.194982 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434c50e-f31a-48e6-a6ba-358fab10cfb5 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:08.215171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 703/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:17.615613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=94 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:18.212856 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:25.627798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ddeaf-1a7a-4089-9c71-8eaa902aa5a9 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:25.628384 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ddeaf-1a7a-4089-9c71-8eaa902aa5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:25.628384 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ddeaf-1a7a-4089-9c71-8eaa902aa5a9 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:25.629756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 707/1410] 10.222.0.33 () {54 vars in 918 bytes} [Thu Jul 28 05:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:25.635488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94512102-3b1e-4be7-9bdd-586a88c2f311 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:25.635919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94512102-3b1e-4be7-9bdd-586a88c2f311 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:25.636028 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94512102-3b1e-4be7-9bdd-586a88c2f311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:25.710482 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-94512102-3b1e-4be7-9bdd-586a88c2f311 None None] MFA Rules not processed for user `3aae5b2e7bf74805b04d01df47693ded`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:25.712188 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-94512102-3b1e-4be7-9bdd-586a88c2f311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:25.817248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 704/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Thu Jul 28 05:24:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:25.831898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c29284-c8dc-4437-8604-db5300236cbd None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:25.832190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c29284-c8dc-4437-8604-db5300236cbd None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:25.832495 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c29284-c8dc-4437-8604-db5300236cbd None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:25.833918 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 708/1412] 10.222.0.33 () {54 vars in 918 bytes} [Thu Jul 28 05:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:25.839380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27cdaf-17f2-4af3-ade1-dddb77980287 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:25.839671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27cdaf-17f2-4af3-ade1-dddb77980287 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:25.839951 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27cdaf-17f2-4af3-ade1-dddb77980287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:25.912799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:25.915967 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3a27cdaf-17f2-4af3-ade1-dddb77980287 None None] MFA Rules not processed for user `99d8c709e6f4462c98c055cb03eebf42`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:25.917436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3a27cdaf-17f2-4af3-ade1-dddb77980287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:26.032629 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 705/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Thu Jul 28 05:24:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:28.487592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35989abd-0d3e-4fe5-bb25-6e90ceccebeb None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:28.488113 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35989abd-0d3e-4fe5-bb25-6e90ceccebeb None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:28.488113 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35989abd-0d3e-4fe5-bb25-6e90ceccebeb None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:28.489409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:28.494959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b67a08-3289-4656-b1f2-c89d92043b06 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:28.495392 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b67a08-3289-4656-b1f2-c89d92043b06 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:28.495520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b67a08-3289-4656-b1f2-c89d92043b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:28.561204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-00b67a08-3289-4656-b1f2-c89d92043b06 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:28.562443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-00b67a08-3289-4656-b1f2-c89d92043b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:28.616704 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:28.658499 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:28.700937 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35989abd-0d3e-4fe5-bb25-6e90ceccebeb None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:28.702488 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-35989abd-0d3e-4fe5-bb25-6e90ceccebeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:28.850831 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35989abd-0d3e-4fe5-bb25-6e90ceccebeb None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:28.923991 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:28.964929 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6f7ff-eb20-4956-8de3-444df3865682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:28.965577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6f7ff-eb20-4956-8de3-444df3865682 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:28.965859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6f7ff-eb20-4956-8de3-444df3865682 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:28.966135 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6f7ff-eb20-4956-8de3-444df3865682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:28.967749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c7e6f7ff-eb20-4956-8de3-444df3865682 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:29.055266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6f7ff-eb20-4956-8de3-444df3865682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:29.056851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6f7ff-eb20-4956-8de3-444df3865682 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:29.074963 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 710/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:29.972495 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ce3c9-2404-4475-be06-b4b686d680ed None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:29.973041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ce3c9-2404-4475-be06-b4b686d680ed None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:29.973041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ce3c9-2404-4475-be06-b4b686d680ed None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:29.974470 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:29.980151 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72935cb3-8e55-43e2-bf63-9af941b35078 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:29.980600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72935cb3-8e55-43e2-bf63-9af941b35078 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:29.980831 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72935cb3-8e55-43e2-bf63-9af941b35078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:30.056876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-72935cb3-8e55-43e2-bf63-9af941b35078 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:30.058106 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-72935cb3-8e55-43e2-bf63-9af941b35078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:30.084640 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:30.155529 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:30.304893 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ce3c9-2404-4475-be06-b4b686d680ed None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:30.306514 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-139ce3c9-2404-4475-be06-b4b686d680ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:30.451820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ce3c9-2404-4475-be06-b4b686d680ed None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:30.492024 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:30.565776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974a1eb-31a2-4796-8f1c-d943984cb35b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:30.566332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974a1eb-31a2-4796-8f1c-d943984cb35b service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:30.566613 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974a1eb-31a2-4796-8f1c-d943984cb35b service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:30.566888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974a1eb-31a2-4796-8f1c-d943984cb35b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:30.568501 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0974a1eb-31a2-4796-8f1c-d943984cb35b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:30.656858 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974a1eb-31a2-4796-8f1c-d943984cb35b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:30.658586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974a1eb-31a2-4796-8f1c-d943984cb35b service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:30.677250 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 708/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:31.550804 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28f550-473e-45bd-996a-182f3c81d287 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:31.551359 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28f550-473e-45bd-996a-182f3c81d287 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:31.551359 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28f550-473e-45bd-996a-182f3c81d287 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:31.552613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:31.558119 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a5266-1c50-474b-9160-f7d753b79f7f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:31.558566 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a5266-1c50-474b-9160-f7d753b79f7f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:31.558672 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a5266-1c50-474b-9160-f7d753b79f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:31.612759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:31.635611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-137a5266-1c50-474b-9160-f7d753b79f7f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:31.636822 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-137a5266-1c50-474b-9160-f7d753b79f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:31.732784 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:31.887864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28f550-473e-45bd-996a-182f3c81d287 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:31.889310 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-8a28f550-473e-45bd-996a-182f3c81d287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:32.033266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28f550-473e-45bd-996a-182f3c81d287 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:32.045907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:32.144225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e18195-dba4-497a-a59f-a75fd09e6a24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:32.144766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e18195-dba4-497a-a59f-a75fd09e6a24 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:32.145043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e18195-dba4-497a-a59f-a75fd09e6a24 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:32.145315 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e18195-dba4-497a-a59f-a75fd09e6a24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:32.146953 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d4e18195-dba4-497a-a59f-a75fd09e6a24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:32.236175 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e18195-dba4-497a-a59f-a75fd09e6a24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:32.237819 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e18195-dba4-497a-a59f-a75fd09e6a24 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:32.255556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 713/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:33.111818 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9642cf-d6d5-4c15-9d14-f7d1a3b6f02b None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:33.112383 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9642cf-d6d5-4c15-9d14-f7d1a3b6f02b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:33.112383 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9642cf-d6d5-4c15-9d14-f7d1a3b6f02b None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:33.113799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:33.118853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30191e-edbb-4861-8790-4ef9c4342cb2 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:33.119277 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30191e-edbb-4861-8790-4ef9c4342cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:33.119387 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30191e-edbb-4861-8790-4ef9c4342cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:33.138889 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:33.195949 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-5b30191e-edbb-4861-8790-4ef9c4342cb2 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:33.197167 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5b30191e-edbb-4861-8790-4ef9c4342cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:33.295114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:33.448771 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9642cf-d6d5-4c15-9d14-f7d1a3b6f02b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:33.450321 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9f9642cf-d6d5-4c15-9d14-f7d1a3b6f02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:33.559856 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:33.595726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9642cf-d6d5-4c15-9d14-f7d1a3b6f02b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:33.708451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c27891-bc25-4e42-b884-ad4846f0b94a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:33.709003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c27891-bc25-4e42-b884-ad4846f0b94a service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:33.709283 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c27891-bc25-4e42-b884-ad4846f0b94a service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:33.709583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c27891-bc25-4e42-b884-ad4846f0b94a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:33.711837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f5c27891-bc25-4e42-b884-ad4846f0b94a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:33.787314 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:33.801665 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c27891-bc25-4e42-b884-ad4846f0b94a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:33.803260 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c27891-bc25-4e42-b884-ad4846f0b94a service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:33.822252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 711/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:34.685054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b448d86-85fa-4327-a6de-5f7e35e6bfda None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:34.685601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b448d86-85fa-4327-a6de-5f7e35e6bfda None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:34.685601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b448d86-85fa-4327-a6de-5f7e35e6bfda None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:34.686940 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:34.691897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f59f3-d61e-42c4-96f4-08545f7c88d5 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:34.692282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f59f3-d61e-42c4-96f4-08545f7c88d5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:34.692456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f59f3-d61e-42c4-96f4-08545f7c88d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:34.767344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-f78f59f3-d61e-42c4-96f4-08545f7c88d5 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:34.768565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f78f59f3-d61e-42c4-96f4-08545f7c88d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:34.864140 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:35.016803 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b448d86-85fa-4327-a6de-5f7e35e6bfda None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:35.018360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6b448d86-85fa-4327-a6de-5f7e35e6bfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:35.102354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:35.164025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b448d86-85fa-4327-a6de-5f7e35e6bfda None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:35.280490 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb605e5-ef37-400f-8c86-70137ebb6c5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:35.281048 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb605e5-ef37-400f-8c86-70137ebb6c5d service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:35.281330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb605e5-ef37-400f-8c86-70137ebb6c5d service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:35.281645 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb605e5-ef37-400f-8c86-70137ebb6c5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:35.283260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5fb605e5-ef37-400f-8c86-70137ebb6c5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:35.330977 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:35.371937 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb605e5-ef37-400f-8c86-70137ebb6c5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:35.373773 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb605e5-ef37-400f-8c86-70137ebb6c5d service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:35.392023 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 716/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:36.272340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1545aa4-06af-49ff-bb12-4569e33e29bd None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:36.273353 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1545aa4-06af-49ff-bb12-4569e33e29bd None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:36.273490 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1545aa4-06af-49ff-bb12-4569e33e29bd None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:36.274840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:36.279729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26507e97-4cd6-4bd2-8f69-e72440879a95 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:36.280207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26507e97-4cd6-4bd2-8f69-e72440879a95 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:36.280315 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26507e97-4cd6-4bd2-8f69-e72440879a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:36.356149 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-26507e97-4cd6-4bd2-8f69-e72440879a95 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:36.357347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-26507e97-4cd6-4bd2-8f69-e72440879a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:36.455060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:36.606559 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1545aa4-06af-49ff-bb12-4569e33e29bd None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:36.608003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e1545aa4-06af-49ff-bb12-4569e33e29bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:36.656652 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:36.754976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1545aa4-06af-49ff-bb12-4569e33e29bd None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:36.869887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc010bc6-e1bf-4742-a2da-ff03e3d45f1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:36.870483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc010bc6-e1bf-4742-a2da-ff03e3d45f1e service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:36.870763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc010bc6-e1bf-4742-a2da-ff03e3d45f1e service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:36.871035 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc010bc6-e1bf-4742-a2da-ff03e3d45f1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:36.872709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cc010bc6-e1bf-4742-a2da-ff03e3d45f1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:36.879941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:36.965255 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc010bc6-e1bf-4742-a2da-ff03e3d45f1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:36.966878 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc010bc6-e1bf-4742-a2da-ff03e3d45f1e service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:36.985211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 714/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:37.907037 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7672-dcd9-4722-9b2a-beab1934e01a None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:37.907590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7672-dcd9-4722-9b2a-beab1934e01a None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:37.907590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7672-dcd9-4722-9b2a-beab1934e01a None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:37.908865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:37.913950 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce28ea-5c80-4638-a329-074a9b30b7fe None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:37.914364 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce28ea-5c80-4638-a329-074a9b30b7fe None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:37.914516 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce28ea-5c80-4638-a329-074a9b30b7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:37.989491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-7dce28ea-5c80-4638-a329-074a9b30b7fe None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:37.990719 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7dce28ea-5c80-4638-a329-074a9b30b7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:38.057726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:38.087122 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:38.240003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7672-dcd9-4722-9b2a-beab1934e01a None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:38.241498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4e7c7672-dcd9-4722-9b2a-beab1934e01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:38.259282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:38.387336 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7672-dcd9-4722-9b2a-beab1934e01a None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:38.476796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:38.503499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1556b7-9199-4c80-aada-ff8cbdf5f9ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:38.504001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1556b7-9199-4c80-aada-ff8cbdf5f9ac service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:38.504277 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1556b7-9199-4c80-aada-ff8cbdf5f9ac service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:38.504546 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1556b7-9199-4c80-aada-ff8cbdf5f9ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:38.506233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-db1556b7-9199-4c80-aada-ff8cbdf5f9ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:38.597356 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1556b7-9199-4c80-aada-ff8cbdf5f9ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:38.598996 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1556b7-9199-4c80-aada-ff8cbdf5f9ac service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:38.617059 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 719/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:39.457950 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a232a-938c-4547-ad74-ad3f191bf37c None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:39.458517 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a232a-938c-4547-ad74-ad3f191bf37c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:39.458517 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a232a-938c-4547-ad74-ad3f191bf37c None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:39.459863 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:39.464904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae717d-7102-4a34-ae47-8c01fe968d9e None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:39.465347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae717d-7102-4a34-ae47-8c01fe968d9e None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:39.465454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae717d-7102-4a34-ae47-8c01fe968d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:39.542437 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-f5ae717d-7102-4a34-ae47-8c01fe968d9e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:39.543551 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f5ae717d-7102-4a34-ae47-8c01fe968d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:39.586143 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:39.643449 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:39.795229 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a232a-938c-4547-ad74-ad3f191bf37c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:39.796672 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ba9a232a-938c-4547-ad74-ad3f191bf37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:39.941278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a232a-938c-4547-ad74-ad3f191bf37c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:39.996319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:40.057200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5105894-e4cc-4b61-aed3-e9e1a0c6c52d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:40.057773 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5105894-e4cc-4b61-aed3-e9e1a0c6c52d service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:40.058055 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5105894-e4cc-4b61-aed3-e9e1a0c6c52d service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:40.058330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5105894-e4cc-4b61-aed3-e9e1a0c6c52d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:40.059975 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d5105894-e4cc-4b61-aed3-e9e1a0c6c52d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:40.149312 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5105894-e4cc-4b61-aed3-e9e1a0c6c52d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:40.150903 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5105894-e4cc-4b61-aed3-e9e1a0c6c52d service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:40.169649 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 717/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:41.034309 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4254938-36c2-4ccc-a4ac-8f66a92fc8de None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:41.034835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4254938-36c2-4ccc-a4ac-8f66a92fc8de None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:41.034970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4254938-36c2-4ccc-a4ac-8f66a92fc8de None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:41.036255 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:41.041249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3176013-4eee-4ed5-9efb-023b25e3aaab None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:41.041985 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3176013-4eee-4ed5-9efb-023b25e3aaab None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:41.042091 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3176013-4eee-4ed5-9efb-023b25e3aaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:41.121348 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b3176013-4eee-4ed5-9efb-023b25e3aaab None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:41.122718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b3176013-4eee-4ed5-9efb-023b25e3aaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:41.124788 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:41.219712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:41.369590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4254938-36c2-4ccc-a4ac-8f66a92fc8de None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:41.371023 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d4254938-36c2-4ccc-a4ac-8f66a92fc8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:41.516882 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4254938-36c2-4ccc-a4ac-8f66a92fc8de None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:41.545227 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:41.630221 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d009468-dd00-4b2e-a4b0-1df6bed768af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:41.630760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d009468-dd00-4b2e-a4b0-1df6bed768af service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:41.631037 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d009468-dd00-4b2e-a4b0-1df6bed768af service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:41.631308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d009468-dd00-4b2e-a4b0-1df6bed768af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:41.633414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9d009468-dd00-4b2e-a4b0-1df6bed768af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:41.722498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d009468-dd00-4b2e-a4b0-1df6bed768af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:41.724092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d009468-dd00-4b2e-a4b0-1df6bed768af service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:41.743513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 722/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:43.657361 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acc2bb-2941-4057-953c-4a98c10e30c9 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:43.657925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acc2bb-2941-4057-953c-4a98c10e30c9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:43.657925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acc2bb-2941-4057-953c-4a98c10e30c9 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:43.659332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:43.664678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab8cf0-0d4f-4708-a077-d244b3d81319 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:43.665095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab8cf0-0d4f-4708-a077-d244b3d81319 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:43.665245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab8cf0-0d4f-4708-a077-d244b3d81319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:43.707365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:43.732107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-95ab8cf0-0d4f-4708-a077-d244b3d81319 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:43.733338 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-95ab8cf0-0d4f-4708-a077-d244b3d81319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:43.832233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:43.871310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acc2bb-2941-4057-953c-4a98c10e30c9 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:43.872928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d4acc2bb-2941-4057-953c-4a98c10e30c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:43.974647 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acc2bb-2941-4057-953c-4a98c10e30c9 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:44.006426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:44.048974 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1537fc-00c0-4a21-8fe9-d723db782c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:44.049614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1537fc-00c0-4a21-8fe9-d723db782c57 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:44.049889 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1537fc-00c0-4a21-8fe9-d723db782c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:44.050159 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1537fc-00c0-4a21-8fe9-d723db782c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:44.051760 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ee1537fc-00c0-4a21-8fe9-d723db782c57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:44.158277 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1537fc-00c0-4a21-8fe9-d723db782c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:44.159688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1537fc-00c0-4a21-8fe9-d723db782c57 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:44.178293 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 720/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:46.348251 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1fb1e-b13d-4e8b-8939-c6ae3b053ac6 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:46.348803 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1fb1e-b13d-4e8b-8939-c6ae3b053ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:46.348803 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1fb1e-b13d-4e8b-8939-c6ae3b053ac6 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:46.350287 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:46.356089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f67f1-14f4-4103-a717-13f9b10b28af None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:46.356524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f67f1-14f4-4103-a717-13f9b10b28af None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:46.356664 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f67f1-14f4-4103-a717-13f9b10b28af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:46.421408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1f1f67f1-14f4-4103-a717-13f9b10b28af None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:46.422636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1f1f67f1-14f4-4103-a717-13f9b10b28af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:46.436203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:46.518256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:46.557575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1fb1e-b13d-4e8b-8939-c6ae3b053ac6 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:46.559194 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-13e1fb1e-b13d-4e8b-8939-c6ae3b053ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:46.665235 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1fb1e-b13d-4e8b-8939-c6ae3b053ac6 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:46.677330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:46.736893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd8d1f-e5d0-4ffa-bb84-57b1b0935419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:46.737527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd8d1f-e5d0-4ffa-bb84-57b1b0935419 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:46.737811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd8d1f-e5d0-4ffa-bb84-57b1b0935419 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:46.738084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd8d1f-e5d0-4ffa-bb84-57b1b0935419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:46.739688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-b7fd8d1f-e5d0-4ffa-bb84-57b1b0935419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:46.850102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd8d1f-e5d0-4ffa-bb84-57b1b0935419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:46.851616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd8d1f-e5d0-4ffa-bb84-57b1b0935419 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:46.870313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 725/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:49.274056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c2202-8d74-461c-9c21-04cd77a815fc None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:49.274512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c2202-8d74-461c-9c21-04cd77a815fc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:49.274619 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c2202-8d74-461c-9c21-04cd77a815fc None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:49.276009 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:49.281370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc2d0d-8e15-4ef9-895f-5d60e070d81d None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:49.281801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc2d0d-8e15-4ef9-895f-5d60e070d81d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:49.281962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc2d0d-8e15-4ef9-895f-5d60e070d81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:49.330581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:49.348629 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-5dcc2d0d-8e15-4ef9-895f-5d60e070d81d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:49.349889 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5dcc2d0d-8e15-4ef9-895f-5d60e070d81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:49.448476 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:49.488960 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c2202-8d74-461c-9c21-04cd77a815fc None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:49.490564 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-725c2202-8d74-461c-9c21-04cd77a815fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:49.594012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c2202-8d74-461c-9c21-04cd77a815fc None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:49.634349 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:49.667742 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d974731-74ea-4ddc-bcee-91ae97c833a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:49.668637 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d974731-74ea-4ddc-bcee-91ae97c833a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:49.669096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d974731-74ea-4ddc-bcee-91ae97c833a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:49.669412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d974731-74ea-4ddc-bcee-91ae97c833a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:49.671335 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5d974731-74ea-4ddc-bcee-91ae97c833a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:49.778152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d974731-74ea-4ddc-bcee-91ae97c833a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:49.779561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d974731-74ea-4ddc-bcee-91ae97c833a6 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:49.797347 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 723/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:51.921578 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9728f-a397-41cd-af3f-3f14e82bd93c None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:51.922162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9728f-a397-41cd-af3f-3f14e82bd93c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:51.922162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9728f-a397-41cd-af3f-3f14e82bd93c None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:51.923586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:51.929676 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babc5dd-15e8-4789-8046-94e1fc5475b4 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:51.930079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babc5dd-15e8-4789-8046-94e1fc5475b4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:51.930230 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babc5dd-15e8-4789-8046-94e1fc5475b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:51.999073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2babc5dd-15e8-4789-8046-94e1fc5475b4 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:52.000287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2babc5dd-15e8-4789-8046-94e1fc5475b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:52.020879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:52.096231 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:52.135682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9728f-a397-41cd-af3f-3f14e82bd93c None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:52.137221 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-68d9728f-a397-41cd-af3f-3f14e82bd93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:52.362138 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9728f-a397-41cd-af3f-3f14e82bd93c None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:52.381271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:52.435192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891d202-43f5-4f12-9b29-eff64101f640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:52.435846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891d202-43f5-4f12-9b29-eff64101f640 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:52.436127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891d202-43f5-4f12-9b29-eff64101f640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:52.436403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891d202-43f5-4f12-9b29-eff64101f640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:52.438039 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4891d202-43f5-4f12-9b29-eff64101f640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:52.547887 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891d202-43f5-4f12-9b29-eff64101f640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:52.549232 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891d202-43f5-4f12-9b29-eff64101f640 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:52.567924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 728/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:54.721548 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f5c11-de9b-42bf-aeb9-562c24b561f9 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:54.722088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f5c11-de9b-42bf-aeb9-562c24b561f9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:54.722088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f5c11-de9b-42bf-aeb9-562c24b561f9 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:54.723471 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:54.729382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7881a7e-ddaa-495a-96b1-db8ef90a84a5 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:54.729822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7881a7e-ddaa-495a-96b1-db8ef90a84a5 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:54.729972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7881a7e-ddaa-495a-96b1-db8ef90a84a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:54.793547 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:54.796563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-f7881a7e-ddaa-495a-96b1-db8ef90a84a5 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:54.797807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f7881a7e-ddaa-495a-96b1-db8ef90a84a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:54.894556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:54.933339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f5c11-de9b-42bf-aeb9-562c24b561f9 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:54.934965 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-964f5c11-de9b-42bf-aeb9-562c24b561f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:55.046248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f5c11-de9b-42bf-aeb9-562c24b561f9 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:55.095386 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:55.120042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1223f-af92-44c7-b432-0611e0be0092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:55.120667 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1223f-af92-44c7-b432-0611e0be0092 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:55.120948 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1223f-af92-44c7-b432-0611e0be0092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:55.121220 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1223f-af92-44c7-b432-0611e0be0092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:55.123609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-72f1223f-af92-44c7-b432-0611e0be0092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:55.230864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1223f-af92-44c7-b432-0611e0be0092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:55.232352 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1223f-af92-44c7-b432-0611e0be0092 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:55.251791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 726/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:57.307023 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d666-c589-47e0-a9dd-b3140a161d83 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:57.307529 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d666-c589-47e0-a9dd-b3140a161d83 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:57.307651 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d666-c589-47e0-a9dd-b3140a161d83 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:57.308991 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:57.314453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358dd84-4d77-4245-9d01-8f2d6c38c5ed None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:57.314850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358dd84-4d77-4245-9d01-8f2d6c38c5ed None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:57.315011 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358dd84-4d77-4245-9d01-8f2d6c38c5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:57.381968 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2358dd84-4d77-4245-9d01-8f2d6c38c5ed None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:57.383210 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2358dd84-4d77-4245-9d01-8f2d6c38c5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:57.412250 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:57.478196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:24:57.516043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3d666-c589-47e0-a9dd-b3140a161d83 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:24:57.517602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6ef3d666-c589-47e0-a9dd-b3140a161d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:57.620032 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3d666-c589-47e0-a9dd-b3140a161d83 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:24:57.648281 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:57.693223 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c340e7-ec41-44e5-b9e4-0c40485b9617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:24:57.693901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c340e7-ec41-44e5-b9e4-0c40485b9617 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:57.694173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c340e7-ec41-44e5-b9e4-0c40485b9617 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:57.694443 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c340e7-ec41-44e5-b9e4-0c40485b9617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:57.696037 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-92c340e7-ec41-44e5-b9e4-0c40485b9617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:57.805947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c340e7-ec41-44e5-b9e4-0c40485b9617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:24:57.807298 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c340e7-ec41-44e5-b9e4-0c40485b9617 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:24:57.825655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 731/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:59.879020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f131c5-dda0-4844-9152-1911c6425227 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:59.879588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f131c5-dda0-4844-9152-1911c6425227 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:59.879588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f131c5-dda0-4844-9152-1911c6425227 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:59.880968 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:24:59.886347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e62277-2864-4ff2-b5de-5953ea0d4a4d None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:24:59.886777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e62277-2864-4ff2-b5de-5953ea0d4a4d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:24:59.886919 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e62277-2864-4ff2-b5de-5953ea0d4a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:24:59.952207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e3e62277-2864-4ff2-b5de-5953ea0d4a4d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:24:59.953416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e3e62277-2864-4ff2-b5de-5953ea0d4a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:24:59.962181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:00.050325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:25:00.087656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f131c5-dda0-4844-9152-1911c6425227 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:25:00.089205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-94f131c5-dda0-4844-9152-1911c6425227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:00.192271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f131c5-dda0-4844-9152-1911c6425227 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:25:00.247533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:00.266721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a574205-29c3-4713-becf-7dfc4b253807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:25:00.267359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a574205-29c3-4713-becf-7dfc4b253807 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:00.267641 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a574205-29c3-4713-becf-7dfc4b253807 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:00.267915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a574205-29c3-4713-becf-7dfc4b253807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:00.269900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1a574205-29c3-4713-becf-7dfc4b253807 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:00.378463 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a574205-29c3-4713-becf-7dfc4b253807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:25:00.379871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a574205-29c3-4713-becf-7dfc4b253807 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:25:00.399363 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 729/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:25:02.455604 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3f297-b85b-4a52-a30d-0163d8032aef None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:02.456119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3f297-b85b-4a52-a30d-0163d8032aef None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:02.456248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3f297-b85b-4a52-a30d-0163d8032aef None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:02.457555 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:25:02.463447 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7e196-0637-432a-835c-222ee224d656 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:02.463854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7e196-0637-432a-835c-222ee224d656 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:02.464011 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7e196-0637-432a-835c-222ee224d656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:02.530273 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-fae7e196-0637-432a-835c-222ee224d656 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:25:02.531412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fae7e196-0637-432a-835c-222ee224d656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:02.570063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:02.626995 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:25:02.666519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3f297-b85b-4a52-a30d-0163d8032aef None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:25:02.668044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e1a3f297-b85b-4a52-a30d-0163d8032aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:02.771497 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3f297-b85b-4a52-a30d-0163d8032aef None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:25:02.808736 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:02.843614 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6628245-82b8-44a8-9918-7c237600dce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:25:02.844238 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628245-82b8-44a8-9918-7c237600dce6 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:02.844518 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628245-82b8-44a8-9918-7c237600dce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:02.844788 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628245-82b8-44a8-9918-7c237600dce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:02.846449 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-a6628245-82b8-44a8-9918-7c237600dce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:02.953777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6628245-82b8-44a8-9918-7c237600dce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:25:02.955193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6628245-82b8-44a8-9918-7c237600dce6 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:25:02.973656 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 734/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:25:05.008519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662b379-18cb-4297-a7bc-93bdc155de71 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:05.009037 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662b379-18cb-4297-a7bc-93bdc155de71 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:05.009155 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662b379-18cb-4297-a7bc-93bdc155de71 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:05.010470 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:25:05.015879 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf0b57-e22f-4ba5-a0ea-4282c4e30fd2 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:05.016286 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf0b57-e22f-4ba5-a0ea-4282c4e30fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:05.016443 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf0b57-e22f-4ba5-a0ea-4282c4e30fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:05.081865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-7faf0b57-e22f-4ba5-a0ea-4282c4e30fd2 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:25:05.083076 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7faf0b57-e22f-4ba5-a0ea-4282c4e30fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:05.101329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:05.180652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:25:05.217756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662b379-18cb-4297-a7bc-93bdc155de71 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:25:05.222144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2662b379-18cb-4297-a7bc-93bdc155de71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:05.328437 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662b379-18cb-4297-a7bc-93bdc155de71 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:25:05.394776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:05.402303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1e198-d5d8-40b5-a3a4-05091c1114bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:25:05.402927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1e198-d5d8-40b5-a3a4-05091c1114bf service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:05.403210 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1e198-d5d8-40b5-a3a4-05091c1114bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:05.403488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1e198-d5d8-40b5-a3a4-05091c1114bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:05.405103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-50c1e198-d5d8-40b5-a3a4-05091c1114bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:05.515993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1e198-d5d8-40b5-a3a4-05091c1114bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:25:05.519208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1e198-d5d8-40b5-a3a4-05091c1114bf service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:25:05.536084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 732/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:25:07.558271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5e1b9-bbb5-4ed2-993a-849c40383841 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:07.558788 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5e1b9-bbb5-4ed2-993a-849c40383841 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:07.558788 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5e1b9-bbb5-4ed2-993a-849c40383841 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:07.560098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:25:07.565446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e6a6f-5057-4509-acee-54d57357bd85 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:07.565928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e6a6f-5057-4509-acee-54d57357bd85 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:07.566040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e6a6f-5057-4509-acee-54d57357bd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:07.633446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-197e6a6f-5057-4509-acee-54d57357bd85 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:25:07.634773 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-197e6a6f-5057-4509-acee-54d57357bd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:07.686495 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:07.735427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:25:07.773982 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5e1b9-bbb5-4ed2-993a-849c40383841 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:25:07.775530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-21e5e1b9-bbb5-4ed2-993a-849c40383841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:07.878903 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5e1b9-bbb5-4ed2-993a-849c40383841 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:25:07.926711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:07.952461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee75dea-7f26-4695-b475-98bbdb69de0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:25:07.953079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee75dea-7f26-4695-b475-98bbdb69de0c service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:07.953361 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee75dea-7f26-4695-b475-98bbdb69de0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:07.953668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee75dea-7f26-4695-b475-98bbdb69de0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:07.955287 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-aee75dea-7f26-4695-b475-98bbdb69de0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:08.066730 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee75dea-7f26-4695-b475-98bbdb69de0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:25:08.068293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee75dea-7f26-4695-b475-98bbdb69de0c service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:25:08.087113 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 737/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:25:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:25:17.733701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=22 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:18.084568 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=66 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:27.672077 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1ac4e-4a6c-4ed5-aed8-0aa70eb722b1 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:27.672667 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1ac4e-4a6c-4ed5-aed8-0aa70eb722b1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:27.672667 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1ac4e-4a6c-4ed5-aed8-0aa70eb722b1 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:27.674042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 734/1471] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:25:27.679732 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147c27e-b350-42aa-9249-5a10162d08f3 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:27.680201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147c27e-b350-42aa-9249-5a10162d08f3 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:27.680314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147c27e-b350-42aa-9249-5a10162d08f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:27.746536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-2147c27e-b350-42aa-9249-5a10162d08f3 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:25:27.748205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2147c27e-b350-42aa-9249-5a10162d08f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:27.851940 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 738/1472] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:25:27.935128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2797e-07db-4085-abaa-f9f6a43769d5 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:27.935416 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2797e-07db-4085-abaa-f9f6a43769d5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:27.935693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2797e-07db-4085-abaa-f9f6a43769d5 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:27.937034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 735/1473] 10.222.0.33 () {54 vars in 966 bytes} [Thu Jul 28 05:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:25:27.941686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13821c9c-3692-481a-ba93-8c616b5ae1d0 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:27.942006 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13821c9c-3692-481a-ba93-8c616b5ae1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:27.942292 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13821c9c-3692-481a-ba93-8c616b5ae1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:28.016340 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-13821c9c-3692-481a-ba93-8c616b5ae1d0 None None] MFA Rules not processed for user `628ef75fa7194253bcf6cd6c85211738`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:25:28.017570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-13821c9c-3692-481a-ba93-8c616b5ae1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:28.038535 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:28.094209 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 739/1474] 10.222.0.33 () {58 vars in 1063 bytes} [Thu Jul 28 05:25:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:25:28.101737 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2797e-07db-4085-abaa-f9f6a43769d5 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:25:28.103256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-95e2797e-07db-4085-abaa-f9f6a43769d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:28.206412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2797e-07db-4085-abaa-f9f6a43769d5 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:25:28.280026 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9d54a-35d1-461b-aa49-2c8c510c8f82 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628ef75fa7194253bcf6cd6c85211738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:25:28.280648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9d54a-35d1-461b-aa49-2c8c510c8f82 service glance] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:28.280929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9d54a-35d1-461b-aa49-2c8c510c8f82 service glance] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:28.281202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9d54a-35d1-461b-aa49-2c8c510c8f82 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:28.282862 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-aff9d54a-35d1-461b-aa49-2c8c510c8f82 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:28.336653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:28.390973 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9d54a-35d1-461b-aa49-2c8c510c8f82 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:25:28.392392 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9d54a-35d1-461b-aa49-2c8c510c8f82 service glance] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:25:28.410525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 736/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:25:30.494971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd81150-ea0c-4295-bda8-f9b95db0d8df None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:30.495519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd81150-ea0c-4295-bda8-f9b95db0d8df None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:30.495519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd81150-ea0c-4295-bda8-f9b95db0d8df None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:30.496891 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 740/1476] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:25:30.502220 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820c7fb-43ce-462d-b709-713835880beb None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:30.502660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820c7fb-43ce-462d-b709-713835880beb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:30.502811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820c7fb-43ce-462d-b709-713835880beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:30.570393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d820c7fb-43ce-462d-b709-713835880beb None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:25:30.571525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d820c7fb-43ce-462d-b709-713835880beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:30.667539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 737/1477] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:25:30.690217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd81150-ea0c-4295-bda8-f9b95db0d8df None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:25:30.692293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6cd81150-ea0c-4295-bda8-f9b95db0d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:30.816398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd81150-ea0c-4295-bda8-f9b95db0d8df None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:25:30.864685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:30.908189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c5b2a-f29f-4d4b-b68e-a047d6556ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:25:30.908797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c5b2a-f29f-4d4b-b68e-a047d6556ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:30.909070 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c5b2a-f29f-4d4b-b68e-a047d6556ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:30.909337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c5b2a-f29f-4d4b-b68e-a047d6556ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:30.910054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c5b2a-f29f-4d4b-b68e-a047d6556ac8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:25:30.911798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: WARNING py.warnings [None req-252c5b2a-f29f-4d4b-b68e-a047d6556ac8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:25:30.911798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: warnings.warn(msg) Jul 28 05:25:30.911798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: Jul 28 05:25:30.912920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c5b2a-f29f-4d4b-b68e-a047d6556ac8 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:25:30.933039 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 741/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jul 28 05:25:30 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:25:32.968596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1954f7-8e3c-4851-949d-ba1ee9896a70 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:32.969186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1954f7-8e3c-4851-949d-ba1ee9896a70 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:32.969186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1954f7-8e3c-4851-949d-ba1ee9896a70 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:32.970552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 738/1479] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:25:32.976410 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36b7cc-73e6-4714-9b29-899b91ab6d3a None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:32.976826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36b7cc-73e6-4714-9b29-899b91ab6d3a None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:32.976968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36b7cc-73e6-4714-9b29-899b91ab6d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:33.043590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-9f36b7cc-73e6-4714-9b29-899b91ab6d3a None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:25:33.044797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9f36b7cc-73e6-4714-9b29-899b91ab6d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:33.141739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 742/1480] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:25:33.186912 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1954f7-8e3c-4851-949d-ba1ee9896a70 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:25:33.188428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2c1954f7-8e3c-4851-949d-ba1ee9896a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:33.198887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:33.334545 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1954f7-8e3c-4851-949d-ba1ee9896a70 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:25:33.415728 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:33.449488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20145e6a-29e5-4ef3-9881-73a8bea5a272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:25:33.450122 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20145e6a-29e5-4ef3-9881-73a8bea5a272 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:33.450405 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20145e6a-29e5-4ef3-9881-73a8bea5a272 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:33.450679 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20145e6a-29e5-4ef3-9881-73a8bea5a272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:33.453374 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-20145e6a-29e5-4ef3-9881-73a8bea5a272 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:33.544856 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20145e6a-29e5-4ef3-9881-73a8bea5a272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:25:33.546482 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20145e6a-29e5-4ef3-9881-73a8bea5a272 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:25:33.564755 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 739/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:25:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:25:35.757555 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd4464-8029-4da7-af48-be56b12252e1 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:35.758130 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd4464-8029-4da7-af48-be56b12252e1 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:35.758130 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd4464-8029-4da7-af48-be56b12252e1 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:35.759470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 743/1482] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:25:35.764618 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f107c05-2535-423d-b19c-0c87837b045c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:35.765039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f107c05-2535-423d-b19c-0c87837b045c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:35.765175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f107c05-2535-423d-b19c-0c87837b045c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:35.834355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1f107c05-2535-423d-b19c-0c87837b045c None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:25:35.835603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1f107c05-2535-423d-b19c-0c87837b045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:35.881575 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:35.932702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 740/1483] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:25:35.969008 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd4464-8029-4da7-af48-be56b12252e1 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:25:35.970805 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f0bd4464-8029-4da7-af48-be56b12252e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:35.995016 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:36.074506 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd4464-8029-4da7-af48-be56b12252e1 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:25:36.148553 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef58c6-f0b6-4648-8d92-9076d7a3a48f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:25:36.149172 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef58c6-f0b6-4648-8d92-9076d7a3a48f service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:36.149452 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef58c6-f0b6-4648-8d92-9076d7a3a48f service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:36.149759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef58c6-f0b6-4648-8d92-9076d7a3a48f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:36.151375 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-acef58c6-f0b6-4648-8d92-9076d7a3a48f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:36.225198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:36.259716 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef58c6-f0b6-4648-8d92-9076d7a3a48f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:25:36.261147 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef58c6-f0b6-4648-8d92-9076d7a3a48f service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:25:36.280254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 744/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:25:38.343514 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f23c0-4e36-4954-95d6-1394fb964ed5 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:38.344066 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f23c0-4e36-4954-95d6-1394fb964ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:38.344066 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f23c0-4e36-4954-95d6-1394fb964ed5 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:38.345449 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 741/1485] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:25:38.351253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99e44a-498b-41b3-8199-49273899236c None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:38.351695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99e44a-498b-41b3-8199-49273899236c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:38.351793 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99e44a-498b-41b3-8199-49273899236c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:38.418189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-fa99e44a-498b-41b3-8199-49273899236c None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:25:38.419278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-fa99e44a-498b-41b3-8199-49273899236c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:38.516885 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 745/1486] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:25:38.556889 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f23c0-4e36-4954-95d6-1394fb964ed5 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:25:38.558559 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c83f23c0-4e36-4954-95d6-1394fb964ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:38.663160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f23c0-4e36-4954-95d6-1394fb964ed5 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:25:38.734401 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:38.736213 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af82e6-deaf-40b7-92ee-c1ad3c1dfc06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:25:38.736834 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af82e6-deaf-40b7-92ee-c1ad3c1dfc06 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:38.737116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af82e6-deaf-40b7-92ee-c1ad3c1dfc06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:38.737393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af82e6-deaf-40b7-92ee-c1ad3c1dfc06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:38.739674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-09af82e6-deaf-40b7-92ee-c1ad3c1dfc06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:38.857892 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af82e6-deaf-40b7-92ee-c1ad3c1dfc06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:25:38.859118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af82e6-deaf-40b7-92ee-c1ad3c1dfc06 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:25:38.878723 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 742/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:25:41.043350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e1a1c-c172-415f-b2a2-1c9f2342ada8 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:41.043915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e1a1c-c172-415f-b2a2-1c9f2342ada8 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:41.044019 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e1a1c-c172-415f-b2a2-1c9f2342ada8 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:41.045340 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 746/1488] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:25:41.050788 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f029c-9721-4729-bee0-232ebfeed9c8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:41.051216 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f029c-9721-4729-bee0-232ebfeed9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:41.051444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f029c-9721-4729-bee0-232ebfeed9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:41.118800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-411f029c-9721-4729-bee0-232ebfeed9c8 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:25:41.120045 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-411f029c-9721-4729-bee0-232ebfeed9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:41.175060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:41.219571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 743/1489] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:25:41.261451 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e1a1c-c172-415f-b2a2-1c9f2342ada8 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:25:41.263049 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-149e1a1c-c172-415f-b2a2-1c9f2342ada8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:41.299801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:41.367262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e1a1c-c172-415f-b2a2-1c9f2342ada8 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:25:41.439262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca89bf-4804-47b6-917a-46ef0c55d976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:25:41.440539 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca89bf-4804-47b6-917a-46ef0c55d976 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:41.440539 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca89bf-4804-47b6-917a-46ef0c55d976 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:41.440539 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca89bf-4804-47b6-917a-46ef0c55d976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:41.442441 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6cca89bf-4804-47b6-917a-46ef0c55d976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:41.527394 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:41.557145 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca89bf-4804-47b6-917a-46ef0c55d976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:25:41.558593 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca89bf-4804-47b6-917a-46ef0c55d976 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:25:41.577339 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 747/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:25:43.998022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773abaee-45e9-4cc3-8461-969f790f6ffb None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:43.998609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773abaee-45e9-4cc3-8461-969f790f6ffb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:43.998609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773abaee-45e9-4cc3-8461-969f790f6ffb None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:43.999939 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 744/1491] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jul 28 05:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:25:44.005727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db7a65-5fb7-4a8b-9b03-d5943bdb3513 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:44.006134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db7a65-5fb7-4a8b-9b03-d5943bdb3513 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:44.006274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db7a65-5fb7-4a8b-9b03-d5943bdb3513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:44.071850 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-99db7a65-5fb7-4a8b-9b03-d5943bdb3513 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:25:44.073071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-99db7a65-5fb7-4a8b-9b03-d5943bdb3513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:44.170024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 748/1492] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jul 28 05:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:25:44.210435 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773abaee-45e9-4cc3-8461-969f790f6ffb None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:25:44.212022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-773abaee-45e9-4cc3-8461-969f790f6ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:44.317492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773abaee-45e9-4cc3-8461-969f790f6ffb None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:25:44.390736 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff1663-95b8-4a37-b787-bcdd84e282d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:25:44.391357 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff1663-95b8-4a37-b787-bcdd84e282d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:25:44.391638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff1663-95b8-4a37-b787-bcdd84e282d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:25:44.391920 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff1663-95b8-4a37-b787-bcdd84e282d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:25:44.393566 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3eff1663-95b8-4a37-b787-bcdd84e282d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:25:44.403312 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:44.504325 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff1663-95b8-4a37-b787-bcdd84e282d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:25:44.505929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff1663-95b8-4a37-b787-bcdd84e282d5 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:25:44.526733 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 745/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:25:54.168121 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=82 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:54.522454 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=50 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:27:44.867108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedb15d-e5c2-41b2-bd22-027f1e26ee98 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:44.867711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedb15d-e5c2-41b2-bd22-027f1e26ee98 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:44.867711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedb15d-e5c2-41b2-bd22-027f1e26ee98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:44.948218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-9cedb15d-e5c2-41b2-bd22-027f1e26ee98 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:27:44.949432 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9cedb15d-e5c2-41b2-bd22-027f1e26ee98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:27:45.053712 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 749/1494] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:27:45.061908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492a184-1e91-4fa4-b31f-98bec548aa58 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:45.062395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492a184-1e91-4fa4-b31f-98bec548aa58 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:45.062501 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492a184-1e91-4fa4-b31f-98bec548aa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:45.082281 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-0492a184-1e91-4fa4-b31f-98bec548aa58 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:27:45.083468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0492a184-1e91-4fa4-b31f-98bec548aa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:27:45.091818 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 746/1495] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:27:45.097200 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedb15d-e5c2-41b2-bd22-027f1e26ee98 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:27:45.106718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedb15d-e5c2-41b2-bd22-027f1e26ee98 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:27:45.111762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805596c-85bb-4b35-92b8-603c3a1ad89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:27:45.112367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805596c-85bb-4b35-92b8-603c3a1ad89a admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:45.112644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805596c-85bb-4b35-92b8-603c3a1ad89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:45.112915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805596c-85bb-4b35-92b8-603c3a1ad89a admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:45.113651 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805596c-85bb-4b35-92b8-603c3a1ad89a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:27:45.113958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805596c-85bb-4b35-92b8-603c3a1ad89a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:27:45.114959 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: WARNING py.warnings [None req-2805596c-85bb-4b35-92b8-603c3a1ad89a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:27:45.114959 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: warnings.warn(msg) Jul 28 05:27:45.114959 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: Jul 28 05:27:45.115837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805596c-85bb-4b35-92b8-603c3a1ad89a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:27:45.127590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 750/1496] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:27:45.135726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492a184-1e91-4fa4-b31f-98bec548aa58 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:27:45.145734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492a184-1e91-4fa4-b31f-98bec548aa58 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:27:45.150323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6c20a-5533-4f1f-afb9-0688fb12784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:27:45.150935 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6c20a-5533-4f1f-afb9-0688fb12784a admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:45.151219 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6c20a-5533-4f1f-afb9-0688fb12784a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:45.151497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6c20a-5533-4f1f-afb9-0688fb12784a admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:45.152211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6c20a-5533-4f1f-afb9-0688fb12784a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:27:45.153990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: WARNING py.warnings [None req-9bc6c20a-5533-4f1f-afb9-0688fb12784a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:27:45.153990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: warnings.warn(msg) Jul 28 05:27:45.153990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: Jul 28 05:27:45.155759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6c20a-5533-4f1f-afb9-0688fb12784a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:27:45.278684 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 747/1497] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:27:45 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:27:45.283886 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805596c-85bb-4b35-92b8-603c3a1ad89a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:27:45.338150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805596c-85bb-4b35-92b8-603c3a1ad89a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:27:45.346504 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:27:45.353273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bfc3f-30c9-4077-b1e4-8be0a2fd047c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:27:45.353928 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bfc3f-30c9-4077-b1e4-8be0a2fd047c admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:45.354209 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bfc3f-30c9-4077-b1e4-8be0a2fd047c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:45.354484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bfc3f-30c9-4077-b1e4-8be0a2fd047c admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:45.355142 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bfc3f-30c9-4077-b1e4-8be0a2fd047c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:27:45.356148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: WARNING py.warnings [None req-bc1bfc3f-30c9-4077-b1e4-8be0a2fd047c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:27:45.356148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: warnings.warn(msg) Jul 28 05:27:45.356148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: Jul 28 05:27:45.357416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bfc3f-30c9-4077-b1e4-8be0a2fd047c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:27:45.407767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 751/1498] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:27:45 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:27:45.412091 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6c20a-5533-4f1f-afb9-0688fb12784a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:27:45.423130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6c20a-5533-4f1f-afb9-0688fb12784a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:27:45.427728 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201ebb7-8651-4d25-9962-e1b3b79464b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:27:45.428342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201ebb7-8651-4d25-9962-e1b3b79464b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:45.428625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201ebb7-8651-4d25-9962-e1b3b79464b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:45.428903 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201ebb7-8651-4d25-9962-e1b3b79464b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:45.429622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201ebb7-8651-4d25-9962-e1b3b79464b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:27:45.430628 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: WARNING py.warnings [None req-3201ebb7-8651-4d25-9962-e1b3b79464b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:27:45.430628 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: warnings.warn(msg) Jul 28 05:27:45.430628 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: Jul 28 05:27:45.431519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201ebb7-8651-4d25-9962-e1b3b79464b6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:27:45.444988 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 748/1499] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:27:45.448915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bfc3f-30c9-4077-b1e4-8be0a2fd047c admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:27:45.459533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bfc3f-30c9-4077-b1e4-8be0a2fd047c admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:27:45.464190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42d068-b1ee-4223-8d3c-f5837b06738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:27:45.464798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42d068-b1ee-4223-8d3c-f5837b06738e admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:45.465082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42d068-b1ee-4223-8d3c-f5837b06738e admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:45.465356 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42d068-b1ee-4223-8d3c-f5837b06738e admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:45.466088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42d068-b1ee-4223-8d3c-f5837b06738e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:27:45.467089 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: WARNING py.warnings [None req-0b42d068-b1ee-4223-8d3c-f5837b06738e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:27:45.467089 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: warnings.warn(msg) Jul 28 05:27:45.467089 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: Jul 28 05:27:45.468029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42d068-b1ee-4223-8d3c-f5837b06738e admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:27:45.482295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 752/1500] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:27:45.486638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201ebb7-8651-4d25-9962-e1b3b79464b6 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:27:45.496466 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201ebb7-8651-4d25-9962-e1b3b79464b6 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:27:45.501834 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1eab2-000c-4668-836e-8671b971cc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:27:45.502491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1eab2-000c-4668-836e-8671b971cc9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:45.502774 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1eab2-000c-4668-836e-8671b971cc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:45.503053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1eab2-000c-4668-836e-8671b971cc9f admin admin] PATH_INFO: `/v3/projects/96573f124ae64cdcb4bc49c6b8e807df/users/e43e8ce752ff49fea61655103d75fbc9/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:45.518108 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1eab2-000c-4668-836e-8671b971cc9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=96573f124ae64cdcb4bc49c6b8e807df, user_id=e43e8ce752ff49fea61655103d75fbc9, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:27:45.519135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: WARNING py.warnings [None req-60d1eab2-000c-4668-836e-8671b971cc9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:27:45.519135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: warnings.warn(msg) Jul 28 05:27:45.519135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: Jul 28 05:27:45.521040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1eab2-000c-4668-836e-8671b971cc9f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:27:45.584634 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 749/1501] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:27:45 2022] PUT /identity/v3/projects/96573f124ae64cdcb4bc49c6b8e807df/users/e43e8ce752ff49fea61655103d75fbc9/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:27:45.596842 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157d4b7-b620-4929-b279-0a384a588a93 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:45.597160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157d4b7-b620-4929-b279-0a384a588a93 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:45.597459 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157d4b7-b620-4929-b279-0a384a588a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:45.625710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-5157d4b7-b620-4929-b279-0a384a588a93 None None] MFA Rules not processed for user `e43e8ce752ff49fea61655103d75fbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:27:45.626938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5157d4b7-b620-4929-b279-0a384a588a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:27:45.692228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 753/1502] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:27:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:27:45.706294 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a031e0-c26e-4225-9c78-280e496f3357 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:45.706582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a031e0-c26e-4225-9c78-280e496f3357 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:45.706858 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a031e0-c26e-4225-9c78-280e496f3357 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:45.708292 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 750/1503] 10.222.0.33 () {54 vars in 964 bytes} [Thu Jul 28 05:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:27:45.713012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bd839-b3c5-44b7-a988-829c241dbc66 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:45.713311 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bd839-b3c5-44b7-a988-829c241dbc66 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:45.713635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bd839-b3c5-44b7-a988-829c241dbc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:45.773354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-143bd839-b3c5-44b7-a988-829c241dbc66 None None] MFA Rules not processed for user `bae981c7273843d4ac734dd876bebe5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:27:45.774592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-143bd839-b3c5-44b7-a988-829c241dbc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:27:45.850025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 754/1504] 10.222.0.33 () {58 vars in 1061 bytes} [Thu Jul 28 05:27:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:27:45.857711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a031e0-c26e-4225-9c78-280e496f3357 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:27:45.868359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a031e0-c26e-4225-9c78-280e496f3357 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:27:45.872129 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6d274-5a10-4967-a2ba-b62e81c4eaf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:27:45.872767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6d274-5a10-4967-a2ba-b62e81c4eaf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:45.873051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6d274-5a10-4967-a2ba-b62e81c4eaf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:45.873328 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6d274-5a10-4967-a2ba-b62e81c4eaf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:45.881940 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6d274-5a10-4967-a2ba-b62e81c4eaf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:27:45.883357 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6d274-5a10-4967-a2ba-b62e81c4eaf5 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:27:45.892822 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 751/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:27:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:27:45.938153 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060be1-d2ed-4319-804a-065fc50818a9 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:45.938569 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060be1-d2ed-4319-804a-065fc50818a9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:45.938718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060be1-d2ed-4319-804a-065fc50818a9 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:45.939984 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 755/1506] 10.222.0.33 () {52 vars in 830 bytes} [Thu Jul 28 05:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:27:45.943629 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6d274-5a10-4967-a2ba-b62e81c4eaf5 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:27:46.006604 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6d274-5a10-4967-a2ba-b62e81c4eaf5 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:27:46.011154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e733de-5a2b-4b81-acb1-2ce56ef2572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:27:46.011815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e733de-5a2b-4b81-acb1-2ce56ef2572b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:46.012095 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e733de-5a2b-4b81-acb1-2ce56ef2572b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:46.012371 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e733de-5a2b-4b81-acb1-2ce56ef2572b admin admin] PATH_INFO: `/v3/users/e43e8ce752ff49fea61655103d75fbc9` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:46.013565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e733de-5a2b-4b81-acb1-2ce56ef2572b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e43e8ce752ff49fea61655103d75fbc9)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:27:46.015205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: WARNING py.warnings [None req-45e733de-5a2b-4b81-acb1-2ce56ef2572b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:27:46.015205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: warnings.warn(msg) Jul 28 05:27:46.015205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: Jul 28 05:27:46.016407 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e733de-5a2b-4b81-acb1-2ce56ef2572b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:27:46.214975 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-45e733de-5a2b-4b81-acb1-2ce56ef2572b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e43e8ce752ff49fea61655103d75fbc9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:27:46.215600 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-45e733de-5a2b-4b81-acb1-2ce56ef2572b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e43e8ce752ff49fea61655103d75fbc9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:27:46.303762 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-45e733de-5a2b-4b81-acb1-2ce56ef2572b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e43e8ce752ff49fea61655103d75fbc9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:27:46.322447 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-45e733de-5a2b-4b81-acb1-2ce56ef2572b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e43e8ce752ff49fea61655103d75fbc9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:27:46.323193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-45e733de-5a2b-4b81-acb1-2ce56ef2572b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e43e8ce752ff49fea61655103d75fbc9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:27:46.334072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:27:46.343632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 752/1507] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:27:45 2022] DELETE /identity/v3/users/e43e8ce752ff49fea61655103d75fbc9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:27:46.347990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbac946-c1b1-48af-b3bb-e1fd68a100a0 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:46.348285 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbac946-c1b1-48af-b3bb-e1fd68a100a0 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:46.348572 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbac946-c1b1-48af-b3bb-e1fd68a100a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:46.367957 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-adbac946-c1b1-48af-b3bb-e1fd68a100a0 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:27:46.376299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-adbac946-c1b1-48af-b3bb-e1fd68a100a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:27:46.378965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:27:46.429449 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 756/1508] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:27:46.440582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e733de-5a2b-4b81-acb1-2ce56ef2572b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:27:46.442037 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-45e733de-5a2b-4b81-acb1-2ce56ef2572b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:27:46.520897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e733de-5a2b-4b81-acb1-2ce56ef2572b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:27:46.524559 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db27693-4459-4129-8eb0-64c16b2950e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:27:46.525209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db27693-4459-4129-8eb0-64c16b2950e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:46.525524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db27693-4459-4129-8eb0-64c16b2950e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:46.525812 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db27693-4459-4129-8eb0-64c16b2950e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:46.535853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db27693-4459-4129-8eb0-64c16b2950e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:27:46.537316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db27693-4459-4129-8eb0-64c16b2950e4 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:27:46.547367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 753/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:27:47.119293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbac946-c1b1-48af-b3bb-e1fd68a100a0 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:27:47.119797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-adbac946-c1b1-48af-b3bb-e1fd68a100a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:27:47.131770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbac946-c1b1-48af-b3bb-e1fd68a100a0 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:27:47.138142 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145f504-4d13-4ecf-8c5d-db1a4eadc1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:27:47.139140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145f504-4d13-4ecf-8c5d-db1a4eadc1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:27:47.139645 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145f504-4d13-4ecf-8c5d-db1a4eadc1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:27:47.140022 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145f504-4d13-4ecf-8c5d-db1a4eadc1bf admin admin] PATH_INFO: `/v3/projects/96573f124ae64cdcb4bc49c6b8e807df` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:27:47.141232 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145f504-4d13-4ecf-8c5d-db1a4eadc1bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=96573f124ae64cdcb4bc49c6b8e807df)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:27:47.143532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: WARNING py.warnings [None req-2145f504-4d13-4ecf-8c5d-db1a4eadc1bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:27:47.143532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: warnings.warn(msg) Jul 28 05:27:47.143532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: Jul 28 05:27:47.148119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145f504-4d13-4ecf-8c5d-db1a4eadc1bf admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:27:47.266419 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2145f504-4d13-4ecf-8c5d-db1a4eadc1bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96573f124ae64cdcb4bc49c6b8e807df', 'request_id': 'req-2145f504-4d13-4ecf-8c5d-db1a4eadc1bf'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:27:47.344331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2145f504-4d13-4ecf-8c5d-db1a4eadc1bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96573f124ae64cdcb4bc49c6b8e807df', 'request_id': 'req-2145f504-4d13-4ecf-8c5d-db1a4eadc1bf'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:27:47.351345 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2145f504-4d13-4ecf-8c5d-db1a4eadc1bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96573f124ae64cdcb4bc49c6b8e807df', 'request_id': 'req-2145f504-4d13-4ecf-8c5d-db1a4eadc1bf'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:27:47.370049 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2145f504-4d13-4ecf-8c5d-db1a4eadc1bf admin admin] The token cache is being invalidate because project 96573f124ae64cdcb4bc49c6b8e807df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:27:47.370274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2145f504-4d13-4ecf-8c5d-db1a4eadc1bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:27:47.371088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2145f504-4d13-4ecf-8c5d-db1a4eadc1bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:27:47.372610 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 757/1510] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:27:47 2022] DELETE /identity/v3/projects/96573f124ae64cdcb4bc49c6b8e807df => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:27:56.542665 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=38 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:27:57.366765 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:26.268246 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a119b3-81e2-4cda-b56e-ed616802fb39 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:26.268759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a119b3-81e2-4cda-b56e-ed616802fb39 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:26.268882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a119b3-81e2-4cda-b56e-ed616802fb39 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:26.270259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:26.275105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d1026-a7e2-4e77-91fe-a71316a53e87 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:26.275566 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d1026-a7e2-4e77-91fe-a71316a53e87 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:26.275694 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d1026-a7e2-4e77-91fe-a71316a53e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:26.298127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-207d1026-a7e2-4e77-91fe-a71316a53e87 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:26.299339 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-207d1026-a7e2-4e77-91fe-a71316a53e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:26.359646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:26.514524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a119b3-81e2-4cda-b56e-ed616802fb39 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:26.521059 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-21a119b3-81e2-4cda-b56e-ed616802fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:26.619853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a119b3-81e2-4cda-b56e-ed616802fb39 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:26.625721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e5afd-264c-40ed-9004-6eaa20ce7270 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:26.626366 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e5afd-264c-40ed-9004-6eaa20ce7270 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:26.626651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e5afd-264c-40ed-9004-6eaa20ce7270 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:26.626930 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e5afd-264c-40ed-9004-6eaa20ce7270 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:26.635052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e5afd-264c-40ed-9004-6eaa20ce7270 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:26.636629 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e5afd-264c-40ed-9004-6eaa20ce7270 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:26.646540 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 755/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:29:27.477453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbfa91-25bd-4e0b-b064-71ee0ad94a22 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:27.478034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbfa91-25bd-4e0b-b064-71ee0ad94a22 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:27.478034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbfa91-25bd-4e0b-b064-71ee0ad94a22 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:27.479420 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:27.484182 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95629c61-6f02-4c94-8ab1-b2def944c799 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:27.484591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95629c61-6f02-4c94-8ab1-b2def944c799 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:27.484734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95629c61-6f02-4c94-8ab1-b2def944c799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:27.504356 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-95629c61-6f02-4c94-8ab1-b2def944c799 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:27.505609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-95629c61-6f02-4c94-8ab1-b2def944c799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:27.514410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:27.668804 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbfa91-25bd-4e0b-b064-71ee0ad94a22 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:27.683122 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbfa91-25bd-4e0b-b064-71ee0ad94a22 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:27.689137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708825fa-da15-40b9-b123-0abfbe78229d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:27.689782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708825fa-da15-40b9-b123-0abfbe78229d service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:27.690065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708825fa-da15-40b9-b123-0abfbe78229d service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:27.690336 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708825fa-da15-40b9-b123-0abfbe78229d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:27.698399 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708825fa-da15-40b9-b123-0abfbe78229d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:27.699967 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708825fa-da15-40b9-b123-0abfbe78229d service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:27.709838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 760/1516] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:29:28.749018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0db89d-6522-44f2-bdf8-ff1ed5162fee None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:28.749604 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0db89d-6522-44f2-bdf8-ff1ed5162fee None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:28.749711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0db89d-6522-44f2-bdf8-ff1ed5162fee None None] PATH_INFO: `/v3` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:28.750942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 757/1517] 10.222.0.57 () {54 vars in 925 bytes} [Thu Jul 28 05:29:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:29:28.757677 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2f26d-deac-403f-ac10-137adc02b179 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:28.758082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2f26d-deac-403f-ac10-137adc02b179 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:28.758242 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2f26d-deac-403f-ac10-137adc02b179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:28.807866 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e4e2f26d-deac-403f-ac10-137adc02b179 None None] MFA Rules not processed for user `3aae5b2e7bf74805b04d01df47693ded`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:28.809007 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e4e2f26d-deac-403f-ac10-137adc02b179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:28.879363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 761/1518] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Jul 28 05:29:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:29:32.857722 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179360e3-f6ff-4ff6-85c1-6337cdf09ef3 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:32.858291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179360e3-f6ff-4ff6-85c1-6337cdf09ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:32.858291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179360e3-f6ff-4ff6-85c1-6337cdf09ef3 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:32.859519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 758/1519] 10.222.0.33 () {54 vars in 961 bytes} [Thu Jul 28 05:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:32.864439 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f4f82-7185-40a3-abd6-3e76442f1d5c None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:32.864924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f4f82-7185-40a3-abd6-3e76442f1d5c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:32.865036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f4f82-7185-40a3-abd6-3e76442f1d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:32.884961 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-d59f4f82-7185-40a3-abd6-3e76442f1d5c None None] MFA Rules not processed for user `3aae5b2e7bf74805b04d01df47693ded`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:32.886173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d59f4f82-7185-40a3-abd6-3e76442f1d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:32.895397 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 762/1520] 10.222.0.33 () {58 vars in 1058 bytes} [Thu Jul 28 05:29:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:32.902735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179360e3-f6ff-4ff6-85c1-6337cdf09ef3 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:32.916257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179360e3-f6ff-4ff6-85c1-6337cdf09ef3 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:32.921224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d58d7-f2c1-418a-8b02-b58c4799dcaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aae5b2e7bf74805b04d01df47693ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:32.921850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d58d7-f2c1-418a-8b02-b58c4799dcaa service placement] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:32.922136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d58d7-f2c1-418a-8b02-b58c4799dcaa service placement] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:32.922413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d58d7-f2c1-418a-8b02-b58c4799dcaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:32.930623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d58d7-f2c1-418a-8b02-b58c4799dcaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:32.932177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d58d7-f2c1-418a-8b02-b58c4799dcaa service placement] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:32.942342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 759/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:29:38.932165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4650-8944-479d-b8cd-ddd85c3ca3f8 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:38.932723 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4650-8944-479d-b8cd-ddd85c3ca3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:38.932723 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4650-8944-479d-b8cd-ddd85c3ca3f8 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:38.934099 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:38.939628 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb605447-4f82-4ce3-a8df-cabd955682ec None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:38.941233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb605447-4f82-4ce3-a8df-cabd955682ec None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:38.941233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb605447-4f82-4ce3-a8df-cabd955682ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:38.959929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-fb605447-4f82-4ce3-a8df-cabd955682ec None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:38.961126 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fb605447-4f82-4ce3-a8df-cabd955682ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:38.968947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:39.123948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c4650-8944-479d-b8cd-ddd85c3ca3f8 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:39.138328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c4650-8944-479d-b8cd-ddd85c3ca3f8 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:39.144580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cf6aa-1fc8-486c-9f11-85115098e419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:39.145232 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cf6aa-1fc8-486c-9f11-85115098e419 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:39.145540 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cf6aa-1fc8-486c-9f11-85115098e419 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:39.145826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cf6aa-1fc8-486c-9f11-85115098e419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:39.154013 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cf6aa-1fc8-486c-9f11-85115098e419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:39.155758 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cf6aa-1fc8-486c-9f11-85115098e419 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:39.165378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 764/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:29:39.991159 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037373e-beaa-42a9-a84c-dd7da0312c5a None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:39.991751 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037373e-beaa-42a9-a84c-dd7da0312c5a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:39.991751 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037373e-beaa-42a9-a84c-dd7da0312c5a None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:39.993140 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:39.998297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e7fdd-2bcd-4e78-814f-3974f4f3d808 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:39.998963 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e7fdd-2bcd-4e78-814f-3974f4f3d808 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:39.999097 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e7fdd-2bcd-4e78-814f-3974f4f3d808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:40.018893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-099e7fdd-2bcd-4e78-814f-3974f4f3d808 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:40.020098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-099e7fdd-2bcd-4e78-814f-3974f4f3d808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:40.027980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:40.182676 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037373e-beaa-42a9-a84c-dd7da0312c5a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:40.197999 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037373e-beaa-42a9-a84c-dd7da0312c5a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:40.204266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3a123-f631-4dd7-aa0d-a5195a8e38e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:40.204876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3a123-f631-4dd7-aa0d-a5195a8e38e1 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:40.205165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3a123-f631-4dd7-aa0d-a5195a8e38e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:40.205443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3a123-f631-4dd7-aa0d-a5195a8e38e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:40.213525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3a123-f631-4dd7-aa0d-a5195a8e38e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:40.215089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3a123-f631-4dd7-aa0d-a5195a8e38e1 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:40.225341 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 762/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:29:44.068427 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3937e6d-d52d-4814-9d1e-2560e354bf99 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:44.068987 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3937e6d-d52d-4814-9d1e-2560e354bf99 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:44.068987 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3937e6d-d52d-4814-9d1e-2560e354bf99 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:44.070389 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:44.075565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3392ea-b352-4c1b-8536-992a4030d8c0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:44.075959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3392ea-b352-4c1b-8536-992a4030d8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:44.076161 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3392ea-b352-4c1b-8536-992a4030d8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:44.096563 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4c3392ea-b352-4c1b-8536-992a4030d8c0 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:44.099652 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4c3392ea-b352-4c1b-8536-992a4030d8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:44.105938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:44.182571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3937e6d-d52d-4814-9d1e-2560e354bf99 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:44.184280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-b3937e6d-d52d-4814-9d1e-2560e354bf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:44.221402 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:44.250709 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3937e6d-d52d-4814-9d1e-2560e354bf99 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:44.254227 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5846b7-02d8-4e2a-bf7f-33b23712da54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:44.255095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5846b7-02d8-4e2a-bf7f-33b23712da54 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:44.255569 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5846b7-02d8-4e2a-bf7f-33b23712da54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:44.255979 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5846b7-02d8-4e2a-bf7f-33b23712da54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:44.266457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5846b7-02d8-4e2a-bf7f-33b23712da54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:44.267880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5846b7-02d8-4e2a-bf7f-33b23712da54 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:44.277782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 767/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:29:46.294982 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca7d48-2422-47fa-a5d8-a0b1744e3c97 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:46.295511 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca7d48-2422-47fa-a5d8-a0b1744e3c97 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:46.295511 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca7d48-2422-47fa-a5d8-a0b1744e3c97 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:46.297186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:46.302378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1cabc-0a75-4ac3-953c-b185c02b2c8b None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:46.302818 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1cabc-0a75-4ac3-953c-b185c02b2c8b None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:46.303050 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1cabc-0a75-4ac3-953c-b185c02b2c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:46.322840 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e8d1cabc-0a75-4ac3-953c-b185c02b2c8b None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:46.324020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e8d1cabc-0a75-4ac3-953c-b185c02b2c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:46.332304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:46.367771 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca7d48-2422-47fa-a5d8-a0b1744e3c97 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:46.379118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca7d48-2422-47fa-a5d8-a0b1744e3c97 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:46.382681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388a087-0a33-4ee0-8ee6-77a8705c1e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:46.383290 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388a087-0a33-4ee0-8ee6-77a8705c1e49 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:46.383574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388a087-0a33-4ee0-8ee6-77a8705c1e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:46.383852 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388a087-0a33-4ee0-8ee6-77a8705c1e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:46.393693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388a087-0a33-4ee0-8ee6-77a8705c1e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:46.395119 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388a087-0a33-4ee0-8ee6-77a8705c1e49 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:46.404479 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 765/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:29:49.831858 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac502a6-da7c-4196-b8ff-704849f6dd79 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:49.832450 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac502a6-da7c-4196-b8ff-704849f6dd79 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:49.832450 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac502a6-da7c-4196-b8ff-704849f6dd79 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:49.833780 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:49.838985 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a01f0f-0685-4ab6-83c1-01b88e80420f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:49.839382 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a01f0f-0685-4ab6-83c1-01b88e80420f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:49.839575 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a01f0f-0685-4ab6-83c1-01b88e80420f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:49.848010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=74 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:49.860757 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e7a01f0f-0685-4ab6-83c1-01b88e80420f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:49.868524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e7a01f0f-0685-4ab6-83c1-01b88e80420f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:49.869887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:50.175511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac502a6-da7c-4196-b8ff-704849f6dd79 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:50.177185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-0ac502a6-da7c-4196-b8ff-704849f6dd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:50.233042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac502a6-da7c-4196-b8ff-704849f6dd79 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:50.237145 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6c36a-f5dc-4699-8f5e-f81cb946a631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:50.237791 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6c36a-f5dc-4699-8f5e-f81cb946a631 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:50.238071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6c36a-f5dc-4699-8f5e-f81cb946a631 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:50.238347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6c36a-f5dc-4699-8f5e-f81cb946a631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:50.247140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6c36a-f5dc-4699-8f5e-f81cb946a631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:50.248558 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6c36a-f5dc-4699-8f5e-f81cb946a631 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:50.258064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 770/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:29:52.278291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6bf89-73cf-41a3-9611-5a269b00952c None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:52.278813 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6bf89-73cf-41a3-9611-5a269b00952c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:52.278927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6bf89-73cf-41a3-9611-5a269b00952c None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:52.281299 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:29:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:52.286678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0237578-f1e0-449e-9066-285b41e8f057 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:52.287120 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0237578-f1e0-449e-9066-285b41e8f057 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:52.287233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0237578-f1e0-449e-9066-285b41e8f057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:52.306229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-c0237578-f1e0-449e-9066-285b41e8f057 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:52.307423 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c0237578-f1e0-449e-9066-285b41e8f057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:52.315863 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:29:52.618610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6bf89-73cf-41a3-9611-5a269b00952c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:52.620297 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e8f6bf89-73cf-41a3-9611-5a269b00952c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:52.633906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6bf89-73cf-41a3-9611-5a269b00952c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:52.637413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b777b5-7afd-4b3c-aa34-7133f3eff777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:52.638074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b777b5-7afd-4b3c-aa34-7133f3eff777 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:52.638439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b777b5-7afd-4b3c-aa34-7133f3eff777 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:52.638791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b777b5-7afd-4b3c-aa34-7133f3eff777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:52.648748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b777b5-7afd-4b3c-aa34-7133f3eff777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:52.650331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b777b5-7afd-4b3c-aa34-7133f3eff777 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:52.660087 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 768/1539] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:02.300985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=47 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:02.655696 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=8 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:20.964390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81747546-323c-4289-bcdd-a178bc0f68df None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:20.967862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81747546-323c-4289-bcdd-a178bc0f68df None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:20.967862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81747546-323c-4289-bcdd-a178bc0f68df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:20.977179 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a652786-7bc2-44d2-8045-62bb01098439 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:20.977784 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a652786-7bc2-44d2-8045-62bb01098439 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:20.977784 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a652786-7bc2-44d2-8045-62bb01098439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:20.991364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-81747546-323c-4289-bcdd-a178bc0f68df None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:20.992934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-81747546-323c-4289-bcdd-a178bc0f68df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:21.009669 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 772/1540] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:21.012347 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9a652786-7bc2-44d2-8045-62bb01098439 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:21.013606 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9a652786-7bc2-44d2-8045-62bb01098439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:21.020210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd60dad-d121-4e0f-a008-835d1d21c27e None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.020798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd60dad-d121-4e0f-a008-835d1d21c27e None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.021307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd60dad-d121-4e0f-a008-835d1d21c27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.038954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 769/1541] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 28 05:31:21.047910 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d330ee2-e2b6-4c7a-9874-829b5ef59d66 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.048238 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d330ee2-e2b6-4c7a-9874-829b5ef59d66 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.048483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d330ee2-e2b6-4c7a-9874-829b5ef59d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.053342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-3cd60dad-d121-4e0f-a008-835d1d21c27e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:21.055084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-3cd60dad-d121-4e0f-a008-835d1d21c27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:21.080207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 773/1542] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:31:21.085296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd60dad-d121-4e0f-a008-835d1d21c27e None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:21.086760 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3d330ee2-e2b6-4c7a-9874-829b5ef59d66 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:21.087981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3d330ee2-e2b6-4c7a-9874-829b5ef59d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:21.096760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd60dad-d121-4e0f-a008-835d1d21c27e None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:21.106806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0ff27-8d70-4e76-b348-10d0926a4a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:21.107850 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ff27-8d70-4e76-b348-10d0926a4a6a admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.108386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ff27-8d70-4e76-b348-10d0926a4a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.108894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ff27-8d70-4e76-b348-10d0926a4a6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.109985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0ff27-8d70-4e76-b348-10d0926a4a6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:31:21.110529 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0ff27-8d70-4e76-b348-10d0926a4a6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:21.112054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 770/1543] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:31:21.112623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0ff27-8d70-4e76-b348-10d0926a4a6a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:21.116581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d330ee2-e2b6-4c7a-9874-829b5ef59d66 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:21.135212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d330ee2-e2b6-4c7a-9874-829b5ef59d66 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:21.135893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 774/1544] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:31:21.147848 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0ff27-8d70-4e76-b348-10d0926a4a6a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:21.158937 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b99ce5-bb8d-491d-b548-fb05ba45504d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:21.165598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b99ce5-bb8d-491d-b548-fb05ba45504d admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.165598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b99ce5-bb8d-491d-b548-fb05ba45504d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.165598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b99ce5-bb8d-491d-b548-fb05ba45504d admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.165598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b99ce5-bb8d-491d-b548-fb05ba45504d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:31:21.165598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b99ce5-bb8d-491d-b548-fb05ba45504d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:21.166013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: WARNING py.warnings [None req-49b99ce5-bb8d-491d-b548-fb05ba45504d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:31:21.166013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: warnings.warn(msg) Jul 28 05:31:21.166013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: Jul 28 05:31:21.166013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b99ce5-bb8d-491d-b548-fb05ba45504d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:21.171288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0ff27-8d70-4e76-b348-10d0926a4a6a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:21.180820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 771/1545] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:31:21.182811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922bfd7-3003-4a13-a079-1b3d8f1ab623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:21.183689 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922bfd7-3003-4a13-a079-1b3d8f1ab623 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.184217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922bfd7-3003-4a13-a079-1b3d8f1ab623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.184689 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922bfd7-3003-4a13-a079-1b3d8f1ab623 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.185679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922bfd7-3003-4a13-a079-1b3d8f1ab623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:21.187824 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: WARNING py.warnings [None req-7922bfd7-3003-4a13-a079-1b3d8f1ab623 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:31:21.187824 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: warnings.warn(msg) Jul 28 05:31:21.187824 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: Jul 28 05:31:21.189368 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922bfd7-3003-4a13-a079-1b3d8f1ab623 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:21.189567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b99ce5-bb8d-491d-b548-fb05ba45504d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:21.203743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b99ce5-bb8d-491d-b548-fb05ba45504d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:21.219602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbe0ff-fe33-4a10-8a2e-d969f40603c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:21.219805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbe0ff-fe33-4a10-8a2e-d969f40603c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.220034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbe0ff-fe33-4a10-8a2e-d969f40603c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.220318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbe0ff-fe33-4a10-8a2e-d969f40603c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.221076 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbe0ff-fe33-4a10-8a2e-d969f40603c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:21.223101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbe0ff-fe33-4a10-8a2e-d969f40603c9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:21.291588 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 775/1546] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:31:21 2022] POST /identity/v3/projects => generated 393 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:31:21.296272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922bfd7-3003-4a13-a079-1b3d8f1ab623 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:21.361872 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 772/1547] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:31:21 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:21.366291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbe0ff-fe33-4a10-8a2e-d969f40603c9 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:21.394767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922bfd7-3003-4a13-a079-1b3d8f1ab623 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:21.471222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbe0ff-fe33-4a10-8a2e-d969f40603c9 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:21.480408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e470dc1-ec81-4455-9d1d-41e015d71131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:21.480408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e470dc1-ec81-4455-9d1d-41e015d71131 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.480408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e470dc1-ec81-4455-9d1d-41e015d71131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.480408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e470dc1-ec81-4455-9d1d-41e015d71131 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.480878 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e470dc1-ec81-4455-9d1d-41e015d71131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:21.480878 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: WARNING py.warnings [None req-5e470dc1-ec81-4455-9d1d-41e015d71131 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:31:21.480878 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: warnings.warn(msg) Jul 28 05:31:21.480878 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: Jul 28 05:31:21.481735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e470dc1-ec81-4455-9d1d-41e015d71131 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:21.524764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a76c9-1af8-461e-8621-f4cd70c50eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:21.525824 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a76c9-1af8-461e-8621-f4cd70c50eba admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.526367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a76c9-1af8-461e-8621-f4cd70c50eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.526847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a76c9-1af8-461e-8621-f4cd70c50eba admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.528003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a76c9-1af8-461e-8621-f4cd70c50eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:21.530414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a76c9-1af8-461e-8621-f4cd70c50eba admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:21.571713 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 773/1548] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:31:21 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:31:21.572786 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcfad1-03e9-4c60-ad80-7b8216e43485 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.573085 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcfad1-03e9-4c60-ad80-7b8216e43485 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.573406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcfad1-03e9-4c60-ad80-7b8216e43485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.621435 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-53dcfad1-03e9-4c60-ad80-7b8216e43485 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:21.622803 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-53dcfad1-03e9-4c60-ad80-7b8216e43485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:21.636918 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 774/1549] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:21.641153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcfad1-03e9-4c60-ad80-7b8216e43485 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:21.651515 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcfad1-03e9-4c60-ad80-7b8216e43485 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:21.661755 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0ee3f-8ce8-48eb-a7ac-4508352c5bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:21.662392 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0ee3f-8ce8-48eb-a7ac-4508352c5bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.662677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0ee3f-8ce8-48eb-a7ac-4508352c5bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.662956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0ee3f-8ce8-48eb-a7ac-4508352c5bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.663761 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0ee3f-8ce8-48eb-a7ac-4508352c5bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:21.665459 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0ee3f-8ce8-48eb-a7ac-4508352c5bb6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:21.676682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 776/1550] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:31:21 2022] POST /identity/v3/users => generated 297 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:31:21.678342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b952e0c-fcec-47c8-bfb9-33aab0149f68 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.678830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b952e0c-fcec-47c8-bfb9-33aab0149f68 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.679305 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b952e0c-fcec-47c8-bfb9-33aab0149f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.681321 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 775/1551] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:21.689571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0ee3f-8ce8-48eb-a7ac-4508352c5bb6 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:21.704122 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0ee3f-8ce8-48eb-a7ac-4508352c5bb6 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:21.710448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-7b952e0c-fcec-47c8-bfb9-33aab0149f68 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:21.712066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7b952e0c-fcec-47c8-bfb9-33aab0149f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:21.712903 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ede520-266e-43b6-86f0-1c328e780b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:21.713609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ede520-266e-43b6-86f0-1c328e780b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.713903 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ede520-266e-43b6-86f0-1c328e780b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.714181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ede520-266e-43b6-86f0-1c328e780b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.714884 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ede520-266e-43b6-86f0-1c328e780b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:21.721560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ede520-266e-43b6-86f0-1c328e780b2d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:21.734859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 777/1552] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:21.735800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 776/1553] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:31:21.736411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b952e0c-fcec-47c8-bfb9-33aab0149f68 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:21.739284 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ede520-266e-43b6-86f0-1c328e780b2d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:21.756172 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b952e0c-fcec-47c8-bfb9-33aab0149f68 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:21.760133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ede520-266e-43b6-86f0-1c328e780b2d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:21.765403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfe662-c25f-43b9-b06c-f78d9c2bf036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:21.766446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfe662-c25f-43b9-b06c-f78d9c2bf036 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.766951 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfe662-c25f-43b9-b06c-f78d9c2bf036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.767444 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfe662-c25f-43b9-b06c-f78d9c2bf036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.768582 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfe662-c25f-43b9-b06c-f78d9c2bf036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:21.769886 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170af21e-0117-425f-bd9f-61361d55a4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:21.770518 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170af21e-0117-425f-bd9f-61361d55a4ea admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.770799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170af21e-0117-425f-bd9f-61361d55a4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.771073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170af21e-0117-425f-bd9f-61361d55a4ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.771453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfe662-c25f-43b9-b06c-f78d9c2bf036 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:21.771828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170af21e-0117-425f-bd9f-61361d55a4ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:31:21.772146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170af21e-0117-425f-bd9f-61361d55a4ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:21.781806 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170af21e-0117-425f-bd9f-61361d55a4ea admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:21.794790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 778/1554] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:21.796713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfe662-c25f-43b9-b06c-f78d9c2bf036 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:21.806645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 777/1555] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:31:21.808998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ae802-9d6b-4318-9e26-eed9e33a353f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.809301 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ae802-9d6b-4318-9e26-eed9e33a353f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.809610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ae802-9d6b-4318-9e26-eed9e33a353f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.816764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfe662-c25f-43b9-b06c-f78d9c2bf036 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:21.833366 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af6c4d-6b6e-4b9f-833c-ff6d7dbc81d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:21.834103 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af6c4d-6b6e-4b9f-833c-ff6d7dbc81d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.834381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af6c4d-6b6e-4b9f-833c-ff6d7dbc81d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.834660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af6c4d-6b6e-4b9f-833c-ff6d7dbc81d2 admin admin] PATH_INFO: `/v3/projects/7b96e460476f4bc9b35224e38b33f4c7/users/b3c43b517c8a464c93f0ce620826ad35/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.852478 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1c8ae802-9d6b-4318-9e26-eed9e33a353f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:21.855553 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1c8ae802-9d6b-4318-9e26-eed9e33a353f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:21.867064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af6c4d-6b6e-4b9f-833c-ff6d7dbc81d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b96e460476f4bc9b35224e38b33f4c7, user_id=b3c43b517c8a464c93f0ce620826ad35, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:21.870058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: WARNING py.warnings [None req-c1af6c4d-6b6e-4b9f-833c-ff6d7dbc81d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:31:21.870058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: warnings.warn(msg) Jul 28 05:31:21.870058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: Jul 28 05:31:21.873914 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af6c4d-6b6e-4b9f-833c-ff6d7dbc81d2 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:21.874796 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 778/1556] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:21.875630 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ae802-9d6b-4318-9e26-eed9e33a353f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:21.893518 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ae802-9d6b-4318-9e26-eed9e33a353f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:21.916373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818bf05-1ed8-4b4c-8d6d-73d1eab61d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:21.916373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818bf05-1ed8-4b4c-8d6d-73d1eab61d5b admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.916373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818bf05-1ed8-4b4c-8d6d-73d1eab61d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.916373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818bf05-1ed8-4b4c-8d6d-73d1eab61d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.916815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818bf05-1ed8-4b4c-8d6d-73d1eab61d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:21.916815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818bf05-1ed8-4b4c-8d6d-73d1eab61d5b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:21.916815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 779/1557] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:21.916815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b03ba-4570-4644-8424-25df2c6140f3 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.916815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b03ba-4570-4644-8424-25df2c6140f3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.916815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b03ba-4570-4644-8424-25df2c6140f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.936312 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-fd9b03ba-4570-4644-8424-25df2c6140f3 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:21.937583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fd9b03ba-4570-4644-8424-25df2c6140f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:21.945532 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 780/1558] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:21.946336 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b03ba-4570-4644-8424-25df2c6140f3 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:21.956216 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b03ba-4570-4644-8424-25df2c6140f3 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:21.960794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3af8c8-66f2-4cde-9f9b-ce3de5659b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:21.965603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3af8c8-66f2-4cde-9f9b-ce3de5659b81 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.965603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3af8c8-66f2-4cde-9f9b-ce3de5659b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.965603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3af8c8-66f2-4cde-9f9b-ce3de5659b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.965603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3af8c8-66f2-4cde-9f9b-ce3de5659b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:21.965603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3af8c8-66f2-4cde-9f9b-ce3de5659b81 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:21.988447 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 779/1559] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:21 2022] PUT /identity/v3/projects/7b96e460476f4bc9b35224e38b33f4c7/users/b3c43b517c8a464c93f0ce620826ad35/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:21.988447 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e1fe8-fc46-4ef0-90de-88a8d7bf4029 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.988447 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e1fe8-fc46-4ef0-90de-88a8d7bf4029 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.988447 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e1fe8-fc46-4ef0-90de-88a8d7bf4029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.000604 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:22.006374 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-706e1fe8-fc46-4ef0-90de-88a8d7bf4029 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:22.007591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-706e1fe8-fc46-4ef0-90de-88a8d7bf4029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:22.034787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 781/1560] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:31:21 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:22.034787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987b5e1-46a9-4dc0-ae03-d87f24f20a3d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.034787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987b5e1-46a9-4dc0-ae03-d87f24f20a3d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.034787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987b5e1-46a9-4dc0-ae03-d87f24f20a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.053450 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a987b5e1-46a9-4dc0-ae03-d87f24f20a3d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:22.054716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a987b5e1-46a9-4dc0-ae03-d87f24f20a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:22.064022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:22.072656 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 780/1561] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:22.074199 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034ddd1-e693-4a59-8da2-b13daceba08c None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.074457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034ddd1-e693-4a59-8da2-b13daceba08c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.074799 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034ddd1-e693-4a59-8da2-b13daceba08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.095130 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-1034ddd1-e693-4a59-8da2-b13daceba08c None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:22.096363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-1034ddd1-e693-4a59-8da2-b13daceba08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:22.124312 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 782/1562] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:22.125771 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f14029-43fa-4e02-8b77-1930908813ae None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.126063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f14029-43fa-4e02-8b77-1930908813ae None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.126363 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f14029-43fa-4e02-8b77-1930908813ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.145114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e2f14029-43fa-4e02-8b77-1930908813ae None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:22.146357 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e2f14029-43fa-4e02-8b77-1930908813ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:22.155383 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 783/1563] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:22.156266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f14029-43fa-4e02-8b77-1930908813ae None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:22.162489 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 781/1564] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:22.164075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13d724-efbb-4816-a3c1-2657bb96e949 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.164516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13d724-efbb-4816-a3c1-2657bb96e949 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.164949 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13d724-efbb-4816-a3c1-2657bb96e949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.166706 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f14029-43fa-4e02-8b77-1930908813ae None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:22.174666 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d83b21-e14a-4a2e-812d-cd85eda43961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:22.175345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d83b21-e14a-4a2e-812d-cd85eda43961 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.175622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d83b21-e14a-4a2e-812d-cd85eda43961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.175892 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d83b21-e14a-4a2e-812d-cd85eda43961 admin admin] PATH_INFO: `/v3/projects/99f094bca18d4939bb22f8d076d3a35c/users/4fcc81558e8f4224ad2ea6fb2b7bf0f9/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.185514 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-5a13d724-efbb-4816-a3c1-2657bb96e949 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:22.186927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5a13d724-efbb-4816-a3c1-2657bb96e949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:22.191298 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d83b21-e14a-4a2e-812d-cd85eda43961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f094bca18d4939bb22f8d076d3a35c, user_id=4fcc81558e8f4224ad2ea6fb2b7bf0f9, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:22.194061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d83b21-e14a-4a2e-812d-cd85eda43961 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:22.195159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 782/1565] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:22.196560 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d9368-48a8-4938-8502-fada55919f11 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.196844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d9368-48a8-4938-8502-fada55919f11 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.197385 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d9368-48a8-4938-8502-fada55919f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.216192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-550d9368-48a8-4938-8502-fada55919f11 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:22.218027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-550d9368-48a8-4938-8502-fada55919f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:22.225797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 783/1566] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:22.228891 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d9368-48a8-4938-8502-fada55919f11 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:22.236136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d9368-48a8-4938-8502-fada55919f11 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:22.241037 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f347c-0da8-421b-b262-c78886a49742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:22.241612 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f347c-0da8-421b-b262-c78886a49742 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.241890 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f347c-0da8-421b-b262-c78886a49742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.242165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f347c-0da8-421b-b262-c78886a49742 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.242820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f347c-0da8-421b-b262-c78886a49742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:22.244704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f347c-0da8-421b-b262-c78886a49742 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:22.258015 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 784/1567] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:22 2022] PUT /identity/v3/projects/99f094bca18d4939bb22f8d076d3a35c/users/4fcc81558e8f4224ad2ea6fb2b7bf0f9/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:22.259311 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badae49e-3977-48ed-a834-c7b9e2b737af None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.259716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badae49e-3977-48ed-a834-c7b9e2b737af None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.259998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badae49e-3977-48ed-a834-c7b9e2b737af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.280930 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-badae49e-3977-48ed-a834-c7b9e2b737af None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:22.282196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-badae49e-3977-48ed-a834-c7b9e2b737af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:22.340615 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 785/1568] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:22.341452 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badae49e-3977-48ed-a834-c7b9e2b737af None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:22.351382 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badae49e-3977-48ed-a834-c7b9e2b737af None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:22.355902 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08c850-514b-4155-b5f7-592e9508e072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:22.356487 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08c850-514b-4155-b5f7-592e9508e072 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.356764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08c850-514b-4155-b5f7-592e9508e072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.357037 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08c850-514b-4155-b5f7-592e9508e072 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.358397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08c850-514b-4155-b5f7-592e9508e072 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:31:22.358843 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08c850-514b-4155-b5f7-592e9508e072 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:22.360461 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08c850-514b-4155-b5f7-592e9508e072 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:22.371555 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 786/1569] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:31:22.372745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387033fb-a5be-4302-a6af-3478a153b1b3 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.373028 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387033fb-a5be-4302-a6af-3478a153b1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.373926 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387033fb-a5be-4302-a6af-3478a153b1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.396701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-387033fb-a5be-4302-a6af-3478a153b1b3 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:22.397943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-387033fb-a5be-4302-a6af-3478a153b1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:22.407224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 787/1570] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:22.408607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cae6cc-f3be-4463-b8ef-a9b6d24bf8f2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.408893 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cae6cc-f3be-4463-b8ef-a9b6d24bf8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.409167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cae6cc-f3be-4463-b8ef-a9b6d24bf8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.428630 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b2cae6cc-f3be-4463-b8ef-a9b6d24bf8f2 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:22.429842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b2cae6cc-f3be-4463-b8ef-a9b6d24bf8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:22.437839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 788/1571] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:22.438613 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cae6cc-f3be-4463-b8ef-a9b6d24bf8f2 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:22.446909 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 784/1572] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:31:22 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:22.446909 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f347c-0da8-421b-b262-c78886a49742 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:22.446909 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6e4f347c-0da8-421b-b262-c78886a49742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:22.447908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cae6cc-f3be-4463-b8ef-a9b6d24bf8f2 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:22.452974 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7d407-9507-4a86-8ab4-5271db0a2ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:22.453601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d407-9507-4a86-8ab4-5271db0a2ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.454291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d407-9507-4a86-8ab4-5271db0a2ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.454291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d407-9507-4a86-8ab4-5271db0a2ff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.454858 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7d407-9507-4a86-8ab4-5271db0a2ff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:31:22.455203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7d407-9507-4a86-8ab4-5271db0a2ff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:22.456741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7d407-9507-4a86-8ab4-5271db0a2ff7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:22.470601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 789/1573] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:31:22.470601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bb09f-bee3-4865-a976-b78c3ab54908 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.480493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bb09f-bee3-4865-a976-b78c3ab54908 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.480493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bb09f-bee3-4865-a976-b78c3ab54908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.497865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-cb9bb09f-bee3-4865-a976-b78c3ab54908 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:22.497865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cb9bb09f-bee3-4865-a976-b78c3ab54908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:22.501580 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 790/1574] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:22.502170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bb09f-bee3-4865-a976-b78c3ab54908 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:22.512270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bb09f-bee3-4865-a976-b78c3ab54908 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:22.512450 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f347c-0da8-421b-b262-c78886a49742 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:22.517376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1d668-19d3-48ce-b123-ba0bd36e0f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:22.518054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1d668-19d3-48ce-b123-ba0bd36e0f2a admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.518288 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1d668-19d3-48ce-b123-ba0bd36e0f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.518552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1d668-19d3-48ce-b123-ba0bd36e0f2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.519244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1d668-19d3-48ce-b123-ba0bd36e0f2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:31:22.519547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1d668-19d3-48ce-b123-ba0bd36e0f2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:22.521117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1d668-19d3-48ce-b123-ba0bd36e0f2a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:22.533781 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 791/1575] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:31:22.534549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1d668-19d3-48ce-b123-ba0bd36e0f2a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:22.544251 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1d668-19d3-48ce-b123-ba0bd36e0f2a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:22.544427 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:22.549075 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3b5e5-3354-4302-8c18-42f86d70d1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:22.549693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3b5e5-3354-4302-8c18-42f86d70d1da admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.555203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3b5e5-3354-4302-8c18-42f86d70d1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.555203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3b5e5-3354-4302-8c18-42f86d70d1da admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.555203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3b5e5-3354-4302-8c18-42f86d70d1da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:22.555203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3b5e5-3354-4302-8c18-42f86d70d1da admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:22.563449 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14077f2f-5f43-41f4-89bf-8e57fa154fbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:22.564080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14077f2f-5f43-41f4-89bf-8e57fa154fbe service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.564367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14077f2f-5f43-41f4-89bf-8e57fa154fbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.564638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14077f2f-5f43-41f4-89bf-8e57fa154fbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.574758 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14077f2f-5f43-41f4-89bf-8e57fa154fbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:22.576703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14077f2f-5f43-41f4-89bf-8e57fa154fbe service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:22.586591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 785/1576] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:22.587390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14077f2f-5f43-41f4-89bf-8e57fa154fbe service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:22.597124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14077f2f-5f43-41f4-89bf-8e57fa154fbe service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:22.602187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea87d8-67aa-41a8-ae91-392afb13ad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:22.602825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea87d8-67aa-41a8-ae91-392afb13ad01 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.603102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea87d8-67aa-41a8-ae91-392afb13ad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.603499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea87d8-67aa-41a8-ae91-392afb13ad01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.604189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea87d8-67aa-41a8-ae91-392afb13ad01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:31:22.604494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea87d8-67aa-41a8-ae91-392afb13ad01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:22.606165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea87d8-67aa-41a8-ae91-392afb13ad01 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:22.618087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 786/1577] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:31:22.621994 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea87d8-67aa-41a8-ae91-392afb13ad01 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:22.629148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea87d8-67aa-41a8-ae91-392afb13ad01 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:22.633857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2dcd1-69ae-41ce-8317-2d66d034d427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:22.634442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2dcd1-69ae-41ce-8317-2d66d034d427 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.634720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2dcd1-69ae-41ce-8317-2d66d034d427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.634993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2dcd1-69ae-41ce-8317-2d66d034d427 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.635664 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2dcd1-69ae-41ce-8317-2d66d034d427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:31:22.635965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2dcd1-69ae-41ce-8317-2d66d034d427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:22.637544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2dcd1-69ae-41ce-8317-2d66d034d427 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:22.649907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 792/1578] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:31:22 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:22.649907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3b5e5-3354-4302-8c18-42f86d70d1da admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:22.660833 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 787/1579] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:31:22.660833 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2dcd1-69ae-41ce-8317-2d66d034d427 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:22.661076 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2dcd1-69ae-41ce-8317-2d66d034d427 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:22.661520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:22.720525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3b5e5-3354-4302-8c18-42f86d70d1da admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:22.723918 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c61907-0cc3-4f8b-b6fa-2544a97c9ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:22.724564 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c61907-0cc3-4f8b-b6fa-2544a97c9ccc admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.724845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c61907-0cc3-4f8b-b6fa-2544a97c9ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.725259 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c61907-0cc3-4f8b-b6fa-2544a97c9ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.726020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c61907-0cc3-4f8b-b6fa-2544a97c9ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:22.727205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b1c23-e321-4154-9388-fe396de1881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:22.728043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c61907-0cc3-4f8b-b6fa-2544a97c9ccc admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:22.728435 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b1c23-e321-4154-9388-fe396de1881d admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.728908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b1c23-e321-4154-9388-fe396de1881d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.729421 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b1c23-e321-4154-9388-fe396de1881d admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.730344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b1c23-e321-4154-9388-fe396de1881d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:22.732182 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b1c23-e321-4154-9388-fe396de1881d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:22.744860 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 793/1580] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:22.746361 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b1c23-e321-4154-9388-fe396de1881d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:22.802044 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b1c23-e321-4154-9388-fe396de1881d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:22.805740 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc198f-37d4-4f3c-9a74-f5e7ae1512d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:22.806360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc198f-37d4-4f3c-9a74-f5e7ae1512d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.806673 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc198f-37d4-4f3c-9a74-f5e7ae1512d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.806923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc198f-37d4-4f3c-9a74-f5e7ae1512d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.816376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc198f-37d4-4f3c-9a74-f5e7ae1512d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:22.819502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc198f-37d4-4f3c-9a74-f5e7ae1512d9 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:22.829661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 794/1581] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:22.830403 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc198f-37d4-4f3c-9a74-f5e7ae1512d9 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:22.833245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 788/1582] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:31:22 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:22.834098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c61907-0cc3-4f8b-b6fa-2544a97c9ccc admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:22.843550 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc198f-37d4-4f3c-9a74-f5e7ae1512d9 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:22.916974 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6825e2-715c-41cc-b150-cb031110ecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:22.917660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6825e2-715c-41cc-b150-cb031110ecfb admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.917958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6825e2-715c-41cc-b150-cb031110ecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.918542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6825e2-715c-41cc-b150-cb031110ecfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.922945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6825e2-715c-41cc-b150-cb031110ecfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:22.923073 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c61907-0cc3-4f8b-b6fa-2544a97c9ccc admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:22.923204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6825e2-715c-41cc-b150-cb031110ecfb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:22.925503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdee57-0ab8-4717-aef3-5ad962d63dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:22.926140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdee57-0ab8-4717-aef3-5ad962d63dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.926547 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdee57-0ab8-4717-aef3-5ad962d63dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.926808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdee57-0ab8-4717-aef3-5ad962d63dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.927592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdee57-0ab8-4717-aef3-5ad962d63dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:22.929531 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdee57-0ab8-4717-aef3-5ad962d63dc9 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.052274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 795/1583] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:31:22 2022] POST /identity/v3/projects => generated 373 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:23.052274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6825e2-715c-41cc-b150-cb031110ecfb admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.067955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 789/1584] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:31:22 2022] POST /identity/v3/projects => generated 373 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:23.068906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdee57-0ab8-4717-aef3-5ad962d63dc9 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.086022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:23.097889 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:23.125622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6825e2-715c-41cc-b150-cb031110ecfb admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.146776 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdee57-0ab8-4717-aef3-5ad962d63dc9 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.151970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff07cc-3092-4656-9a81-5d907af9bf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.153031 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff07cc-3092-4656-9a81-5d907af9bf89 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.153189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff07cc-3092-4656-9a81-5d907af9bf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.153412 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff07cc-3092-4656-9a81-5d907af9bf89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.154142 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff07cc-3092-4656-9a81-5d907af9bf89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.157284 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff07cc-3092-4656-9a81-5d907af9bf89 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.190248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83bdc6-36f6-4469-a0d5-52d1595fcaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.190876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83bdc6-36f6-4469-a0d5-52d1595fcaff admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.191160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83bdc6-36f6-4469-a0d5-52d1595fcaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.191451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83bdc6-36f6-4469-a0d5-52d1595fcaff admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.192103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83bdc6-36f6-4469-a0d5-52d1595fcaff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.194050 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83bdc6-36f6-4469-a0d5-52d1595fcaff admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.294213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 790/1585] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:31:23 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:23.295878 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff07cc-3092-4656-9a81-5d907af9bf89 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.355975 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 796/1586] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:31:23 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:23.359721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83bdc6-36f6-4469-a0d5-52d1595fcaff admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.369410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83bdc6-36f6-4469-a0d5-52d1595fcaff admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.371645 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff07cc-3092-4656-9a81-5d907af9bf89 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.374630 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb9d63-4203-4df2-90f2-c44b95248cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.375252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb9d63-4203-4df2-90f2-c44b95248cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.375539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb9d63-4203-4df2-90f2-c44b95248cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.375820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb9d63-4203-4df2-90f2-c44b95248cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.376552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb9d63-4203-4df2-90f2-c44b95248cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.377693 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594701-59e5-47b4-9239-a5bac542800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.378571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594701-59e5-47b4-9239-a5bac542800d admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.378690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb9d63-4203-4df2-90f2-c44b95248cb3 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.378897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594701-59e5-47b4-9239-a5bac542800d admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.379228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594701-59e5-47b4-9239-a5bac542800d admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.379984 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9594701-59e5-47b4-9239-a5bac542800d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.381881 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9594701-59e5-47b4-9239-a5bac542800d admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.392914 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 791/1587] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:23.393858 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594701-59e5-47b4-9239-a5bac542800d admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.406781 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594701-59e5-47b4-9239-a5bac542800d admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.412574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4e78d-1f7f-4cfd-9f06-3dc670e865bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.413289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4e78d-1f7f-4cfd-9f06-3dc670e865bf admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.413603 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4e78d-1f7f-4cfd-9f06-3dc670e865bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.414010 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4e78d-1f7f-4cfd-9f06-3dc670e865bf admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.414679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4e78d-1f7f-4cfd-9f06-3dc670e865bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.416832 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4e78d-1f7f-4cfd-9f06-3dc670e865bf admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.481814 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 797/1588] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:31:23 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:23.483343 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb9d63-4203-4df2-90f2-c44b95248cb3 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.495677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb9d63-4203-4df2-90f2-c44b95248cb3 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.500314 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55f3e7-568d-4610-9b5b-17b52ac8f7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.500940 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55f3e7-568d-4610-9b5b-17b52ac8f7df admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.501503 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55f3e7-568d-4610-9b5b-17b52ac8f7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.501503 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55f3e7-568d-4610-9b5b-17b52ac8f7df admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.509927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55f3e7-568d-4610-9b5b-17b52ac8f7df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.519270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55f3e7-568d-4610-9b5b-17b52ac8f7df admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.520000 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 792/1589] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:31:23 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:23.521877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4e78d-1f7f-4cfd-9f06-3dc670e865bf admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.539025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4e78d-1f7f-4cfd-9f06-3dc670e865bf admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.547807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c09ed9-0c30-4ce1-9566-41972b8e227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.548735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c09ed9-0c30-4ce1-9566-41972b8e227c admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.549266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c09ed9-0c30-4ce1-9566-41972b8e227c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.550474 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c09ed9-0c30-4ce1-9566-41972b8e227c admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.556834 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c09ed9-0c30-4ce1-9566-41972b8e227c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.556834 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c09ed9-0c30-4ce1-9566-41972b8e227c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.646056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 798/1590] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:31:23 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:23.646237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 793/1591] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:31:23 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:23.646237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c09ed9-0c30-4ce1-9566-41972b8e227c admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.647763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55f3e7-568d-4610-9b5b-17b52ac8f7df admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.658912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c09ed9-0c30-4ce1-9566-41972b8e227c admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.662565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55f3e7-568d-4610-9b5b-17b52ac8f7df admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.663976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a24491-ff51-4240-9898-1df6b05ac255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.664714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a24491-ff51-4240-9898-1df6b05ac255 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.665006 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a24491-ff51-4240-9898-1df6b05ac255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.665284 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a24491-ff51-4240-9898-1df6b05ac255 admin admin] PATH_INFO: `/v3/projects/ee5ed205b4a048e18443c6d18b871a90/users/b3124696ed4c40029066ceef822f35b7/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.665463 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15ca09-3ece-44c4-8653-b1fc4dd5ad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.666117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ca09-3ece-44c4-8653-b1fc4dd5ad1b admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.666582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ca09-3ece-44c4-8653-b1fc4dd5ad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.666927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ca09-3ece-44c4-8653-b1fc4dd5ad1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.667845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15ca09-3ece-44c4-8653-b1fc4dd5ad1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.669634 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15ca09-3ece-44c4-8653-b1fc4dd5ad1b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.681889 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 799/1592] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:23.682981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15ca09-3ece-44c4-8653-b1fc4dd5ad1b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.683102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a24491-ff51-4240-9898-1df6b05ac255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5ed205b4a048e18443c6d18b871a90, user_id=b3124696ed4c40029066ceef822f35b7, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.686754 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a24491-ff51-4240-9898-1df6b05ac255 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.695322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15ca09-3ece-44c4-8653-b1fc4dd5ad1b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.700381 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fac99-dc65-4d13-8f9f-bbee53e8a26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.701923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fac99-dc65-4d13-8f9f-bbee53e8a26e admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.702183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fac99-dc65-4d13-8f9f-bbee53e8a26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.702524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fac99-dc65-4d13-8f9f-bbee53e8a26e admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.703334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fac99-dc65-4d13-8f9f-bbee53e8a26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.705287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fac99-dc65-4d13-8f9f-bbee53e8a26e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.722600 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 800/1593] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:23.722600 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fac99-dc65-4d13-8f9f-bbee53e8a26e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.731224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fac99-dc65-4d13-8f9f-bbee53e8a26e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.737350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5538d5-3545-49e5-87db-ee5dfc9dd95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.738026 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5538d5-3545-49e5-87db-ee5dfc9dd95f admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.738416 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5538d5-3545-49e5-87db-ee5dfc9dd95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.738961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5538d5-3545-49e5-87db-ee5dfc9dd95f admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.739265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5538d5-3545-49e5-87db-ee5dfc9dd95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.741037 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5538d5-3545-49e5-87db-ee5dfc9dd95f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.748477 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 794/1594] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:23 2022] PUT /identity/v3/projects/ee5ed205b4a048e18443c6d18b871a90/users/b3124696ed4c40029066ceef822f35b7/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:23.749656 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a24491-ff51-4240-9898-1df6b05ac255 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.763496 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 801/1595] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:23.765512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5538d5-3545-49e5-87db-ee5dfc9dd95f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.775690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5538d5-3545-49e5-87db-ee5dfc9dd95f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.806950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:23.825967 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a24491-ff51-4240-9898-1df6b05ac255 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.832410 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12956d-7137-4934-8194-dccf1b0fd25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.833114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12956d-7137-4934-8194-dccf1b0fd25a admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.833463 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12956d-7137-4934-8194-dccf1b0fd25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.834001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12956d-7137-4934-8194-dccf1b0fd25a admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.834858 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12956d-7137-4934-8194-dccf1b0fd25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.836785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12956d-7137-4934-8194-dccf1b0fd25a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.837236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:23.845230 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00df38-aa44-4098-9dc8-d2a8f7529ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.846019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00df38-aa44-4098-9dc8-d2a8f7529ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.846404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00df38-aa44-4098-9dc8-d2a8f7529ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.846780 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00df38-aa44-4098-9dc8-d2a8f7529ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.847616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00df38-aa44-4098-9dc8-d2a8f7529ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.848294 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 795/1596] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:23.849218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12956d-7137-4934-8194-dccf1b0fd25a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.849531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00df38-aa44-4098-9dc8-d2a8f7529ce2 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.860164 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 802/1597] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:23.860596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12956d-7137-4934-8194-dccf1b0fd25a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.861175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00df38-aa44-4098-9dc8-d2a8f7529ce2 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.866352 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5ded8-0fd8-41b5-877f-0e0017a3ea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.866983 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5ded8-0fd8-41b5-877f-0e0017a3ea91 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.867265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5ded8-0fd8-41b5-877f-0e0017a3ea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.867540 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5ded8-0fd8-41b5-877f-0e0017a3ea91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.868320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5ded8-0fd8-41b5-877f-0e0017a3ea91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.870001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5ded8-0fd8-41b5-877f-0e0017a3ea91 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.873177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00df38-aa44-4098-9dc8-d2a8f7529ce2 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.878119 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d9885-58de-47fc-98bd-b74c906052ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.878726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d9885-58de-47fc-98bd-b74c906052ec admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.879181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d9885-58de-47fc-98bd-b74c906052ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.880601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 796/1598] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:23.881754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d9885-58de-47fc-98bd-b74c906052ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.889382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cfe33-e795-4b19-8056-a26b001c47bb None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.889382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cfe33-e795-4b19-8056-a26b001c47bb None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.889382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cfe33-e795-4b19-8056-a26b001c47bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.889908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d9885-58de-47fc-98bd-b74c906052ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.889908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d9885-58de-47fc-98bd-b74c906052ec admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.896783 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 803/1599] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:23.898028 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d9885-58de-47fc-98bd-b74c906052ec admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.901709 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-b69cfe33-e795-4b19-8056-a26b001c47bb None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:23.903193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-b69cfe33-e795-4b19-8056-a26b001c47bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:23.908918 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d9885-58de-47fc-98bd-b74c906052ec admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.911600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 797/1600] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:23.912377 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cfe33-e795-4b19-8056-a26b001c47bb None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.914124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6592a-8b37-4512-8ffb-314470b1f1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.915061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6592a-8b37-4512-8ffb-314470b1f1fb admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.915709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6592a-8b37-4512-8ffb-314470b1f1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.915991 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6592a-8b37-4512-8ffb-314470b1f1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.916827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6592a-8b37-4512-8ffb-314470b1f1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.918429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6592a-8b37-4512-8ffb-314470b1f1fb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.923833 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cfe33-e795-4b19-8056-a26b001c47bb None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.928805 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183f70e-1a48-41ae-9f11-7a0e0a335fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.929660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183f70e-1a48-41ae-9f11-7a0e0a335fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.929947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183f70e-1a48-41ae-9f11-7a0e0a335fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.930251 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183f70e-1a48-41ae-9f11-7a0e0a335fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.930386 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 804/1601] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:23.931389 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6592a-8b37-4512-8ffb-314470b1f1fb admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.934216 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183f70e-1a48-41ae-9f11-7a0e0a335fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.936152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183f70e-1a48-41ae-9f11-7a0e0a335fa9 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.941295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6592a-8b37-4512-8ffb-314470b1f1fb admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.946068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf6deb-3207-4dac-884c-b114f8f4168a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.951906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 798/1602] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:23.952027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf6deb-3207-4dac-884c-b114f8f4168a admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.952027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf6deb-3207-4dac-884c-b114f8f4168a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.952027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf6deb-3207-4dac-884c-b114f8f4168a admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.952258 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183f70e-1a48-41ae-9f11-7a0e0a335fa9 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.952351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf6deb-3207-4dac-884c-b114f8f4168a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.952351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf6deb-3207-4dac-884c-b114f8f4168a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.957880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183f70e-1a48-41ae-9f11-7a0e0a335fa9 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.960245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 805/1603] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:23.961160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf6deb-3207-4dac-884c-b114f8f4168a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.965032 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43912df-a5f1-434f-ad45-789479b733e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.965725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43912df-a5f1-434f-ad45-789479b733e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.966012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43912df-a5f1-434f-ad45-789479b733e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.966287 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43912df-a5f1-434f-ad45-789479b733e3 admin admin] PATH_INFO: `/v3/projects/ba0b7f7639504a25a73c94335d62b98f/users/0002ebbc629b4dafb109dc94450fe1d8/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.973749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf6deb-3207-4dac-884c-b114f8f4168a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.985660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a8f09-88a6-4c07-b6d7-5aac0c8b0b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.986622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a8f09-88a6-4c07-b6d7-5aac0c8b0b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.986903 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a8f09-88a6-4c07-b6d7-5aac0c8b0b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.987316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a8f09-88a6-4c07-b6d7-5aac0c8b0b63 admin admin] PATH_INFO: `/v3/projects/fe6ba5ebeed545748c37785b9cd087fe/users/2008109b89af4620b2de74464b4c9758/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.988148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43912df-a5f1-434f-ad45-789479b733e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0b7f7639504a25a73c94335d62b98f, user_id=0002ebbc629b4dafb109dc94450fe1d8, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.992094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43912df-a5f1-434f-ad45-789479b733e3 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:24.003482 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a8f09-88a6-4c07-b6d7-5aac0c8b0b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6ba5ebeed545748c37785b9cd087fe, user_id=2008109b89af4620b2de74464b4c9758, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:24.007459 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a8f09-88a6-4c07-b6d7-5aac0c8b0b63 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:24.059945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 799/1604] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:23 2022] PUT /identity/v3/projects/ba0b7f7639504a25a73c94335d62b98f/users/0002ebbc629b4dafb109dc94450fe1d8/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:24.061122 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43912df-a5f1-434f-ad45-789479b733e3 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:24.097462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 806/1605] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:23 2022] PUT /identity/v3/projects/fe6ba5ebeed545748c37785b9cd087fe/users/2008109b89af4620b2de74464b4c9758/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:24.097462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a8f09-88a6-4c07-b6d7-5aac0c8b0b63 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:24.129891 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43912df-a5f1-434f-ad45-789479b733e3 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:24.165414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a8f09-88a6-4c07-b6d7-5aac0c8b0b63 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:24.172562 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86515a7-928c-41b2-89e2-83f561262bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:24.173314 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86515a7-928c-41b2-89e2-83f561262bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.173694 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86515a7-928c-41b2-89e2-83f561262bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.173977 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86515a7-928c-41b2-89e2-83f561262bf3 admin admin] PATH_INFO: `/v3/projects/19eae28e6e994365b586085a55f29aeb/users/c93ac044c94544bd97d8dc7484a60f2e/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:24.192358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86515a7-928c-41b2-89e2-83f561262bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19eae28e6e994365b586085a55f29aeb, user_id=c93ac044c94544bd97d8dc7484a60f2e, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:24.195312 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540a22b-d1fc-4201-863a-6da4a10e22d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:24.195768 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86515a7-928c-41b2-89e2-83f561262bf3 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:24.196316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540a22b-d1fc-4201-863a-6da4a10e22d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.196607 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540a22b-d1fc-4201-863a-6da4a10e22d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.196889 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540a22b-d1fc-4201-863a-6da4a10e22d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:24.208319 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540a22b-d1fc-4201-863a-6da4a10e22d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:24.209847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540a22b-d1fc-4201-863a-6da4a10e22d4 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:24.228386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 800/1606] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:24.229245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540a22b-d1fc-4201-863a-6da4a10e22d4 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:24.241291 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540a22b-d1fc-4201-863a-6da4a10e22d4 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:24.246293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74e826-0e7f-4883-90fb-ee11b07683bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:24.246982 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74e826-0e7f-4883-90fb-ee11b07683bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.247267 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74e826-0e7f-4883-90fb-ee11b07683bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.247552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74e826-0e7f-4883-90fb-ee11b07683bc admin admin] PATH_INFO: `/v3/projects/3df895dfc7b342658d72bffd0f5ac40e/users/2b29296ad64f4c87907ffc9722f2300d/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:24.260144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 807/1607] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:24 2022] PUT /identity/v3/projects/19eae28e6e994365b586085a55f29aeb/users/c93ac044c94544bd97d8dc7484a60f2e/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:24.261582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86515a7-928c-41b2-89e2-83f561262bf3 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:24.276917 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74e826-0e7f-4883-90fb-ee11b07683bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df895dfc7b342658d72bffd0f5ac40e, user_id=2b29296ad64f4c87907ffc9722f2300d, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:24.284055 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74e826-0e7f-4883-90fb-ee11b07683bc admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:24.349088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86515a7-928c-41b2-89e2-83f561262bf3 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:24.354871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ec32f-77d5-421f-9137-6620ff6f3cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:24.355637 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ec32f-77d5-421f-9137-6620ff6f3cba admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.355996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ec32f-77d5-421f-9137-6620ff6f3cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.356344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ec32f-77d5-421f-9137-6620ff6f3cba admin admin] PATH_INFO: `/v3/projects/d6e54a77d2aa469b8c0197d99170d978/users/22fddcc9952a459899e48a93d1d962db/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:24.382717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ec32f-77d5-421f-9137-6620ff6f3cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e54a77d2aa469b8c0197d99170d978, user_id=22fddcc9952a459899e48a93d1d962db, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:24.386349 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ec32f-77d5-421f-9137-6620ff6f3cba admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:24.393554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 801/1608] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:24 2022] PUT /identity/v3/projects/3df895dfc7b342658d72bffd0f5ac40e/users/2b29296ad64f4c87907ffc9722f2300d/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:24.395126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766c0d6-71b4-4fea-8220-2737fc705a7d None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.395419 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766c0d6-71b4-4fea-8220-2737fc705a7d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.396345 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766c0d6-71b4-4fea-8220-2737fc705a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:24.419059 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-5766c0d6-71b4-4fea-8220-2737fc705a7d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:24.421551 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5766c0d6-71b4-4fea-8220-2737fc705a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:24.437775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:24.471086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:24.476018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 808/1609] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:24 2022] PUT /identity/v3/projects/d6e54a77d2aa469b8c0197d99170d978/users/22fddcc9952a459899e48a93d1d962db/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:24.481038 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a1533-1d7d-4474-a846-8ca4e4d25479 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.481326 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a1533-1d7d-4474-a846-8ca4e4d25479 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.481968 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a1533-1d7d-4474-a846-8ca4e4d25479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:24.499142 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 802/1610] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:24.503571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca078c-9fa2-4c03-b1f9-8a660f5952c7 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.503571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca078c-9fa2-4c03-b1f9-8a660f5952c7 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.503571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca078c-9fa2-4c03-b1f9-8a660f5952c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:24.540608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e01a1533-1d7d-4474-a846-8ca4e4d25479 None None] MFA Rules not processed for user `2008109b89af4620b2de74464b4c9758`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:24.543054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e01a1533-1d7d-4474-a846-8ca4e4d25479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:24.549020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-1fca078c-9fa2-4c03-b1f9-8a660f5952c7 None None] MFA Rules not processed for user `c93ac044c94544bd97d8dc7484a60f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:24.549936 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-1fca078c-9fa2-4c03-b1f9-8a660f5952c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:24.647952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 809/1611] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:24.647952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943afedf-a03b-4fa9-b4dd-00dce25ac734 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.647952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943afedf-a03b-4fa9-b4dd-00dce25ac734 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.647952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943afedf-a03b-4fa9-b4dd-00dce25ac734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:24.665621 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 803/1612] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:24.667562 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4490cc-109b-4ebf-ae2e-796b551df93d None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.667863 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4490cc-109b-4ebf-ae2e-796b551df93d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.668186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4490cc-109b-4ebf-ae2e-796b551df93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:24.709897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-6f4490cc-109b-4ebf-ae2e-796b551df93d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:24.711151 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6f4490cc-109b-4ebf-ae2e-796b551df93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:24.712196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-943afedf-a03b-4fa9-b4dd-00dce25ac734 None None] MFA Rules not processed for user `2b29296ad64f4c87907ffc9722f2300d`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:24.714140 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-943afedf-a03b-4fa9-b4dd-00dce25ac734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:24.800608 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 804/1613] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:24.802754 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4490cc-109b-4ebf-ae2e-796b551df93d None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:24.843777 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 810/1614] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:24.849098 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a3124-6c49-46db-ba8a-323d93397e92 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.852127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a3124-6c49-46db-ba8a-323d93397e92 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.853314 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a3124-6c49-46db-ba8a-323d93397e92 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:24.865380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 811/1615] 10.222.0.33 () {54 vars in 962 bytes} [Thu Jul 28 05:31:24 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:24.870490 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0a1ed-084f-4f86-9630-8f4012590d84 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.872195 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0a1ed-084f-4f86-9630-8f4012590d84 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.875111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0a1ed-084f-4f86-9630-8f4012590d84 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:24.878001 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 812/1616] 10.222.0.33 () {54 vars in 962 bytes} [Thu Jul 28 05:31:24 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:24.880392 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0a1ed-084f-4f86-9630-8f4012590d84 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:24.922337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4490cc-109b-4ebf-ae2e-796b551df93d None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:24.933211 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77114b49-7994-4f10-944f-8919cd3e2beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:24.935361 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77114b49-7994-4f10-944f-8919cd3e2beb service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.937580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77114b49-7994-4f10-944f-8919cd3e2beb service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.938076 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77114b49-7994-4f10-944f-8919cd3e2beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:24.950754 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:24.957412 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77114b49-7994-4f10-944f-8919cd3e2beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:24.959167 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77114b49-7994-4f10-944f-8919cd3e2beb service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:24.973502 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 805/1617] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:24.975069 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcde8c-d2a9-4195-9ce2-afc0361e5a58 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.981670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcde8c-d2a9-4195-9ce2-afc0361e5a58 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.981670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcde8c-d2a9-4195-9ce2-afc0361e5a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:24.988443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0a1ed-084f-4f86-9630-8f4012590d84 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:24.992550 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f61cb0-a824-4a70-adf6-9468490fb9fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:24.993575 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f61cb0-a824-4a70-adf6-9468490fb9fb service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.994012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f61cb0-a824-4a70-adf6-9468490fb9fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.994448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f61cb0-a824-4a70-adf6-9468490fb9fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:25.025362 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f61cb0-a824-4a70-adf6-9468490fb9fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:25.028091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-2ebcde8c-d2a9-4195-9ce2-afc0361e5a58 None None] MFA Rules not processed for user `99d8c709e6f4462c98c055cb03eebf42`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:25.028227 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f61cb0-a824-4a70-adf6-9468490fb9fb service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:25.030363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2ebcde8c-d2a9-4195-9ce2-afc0361e5a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:25.052944 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 813/1618] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:25.056837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0d36d-cc58-4ba6-a7b0-f41febaf1a7c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:25.057959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0d36d-cc58-4ba6-a7b0-f41febaf1a7c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:25.058257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0d36d-cc58-4ba6-a7b0-f41febaf1a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:25.104970 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-69b0d36d-cc58-4ba6-a7b0-f41febaf1a7c None None] MFA Rules not processed for user `99d8c709e6f4462c98c055cb03eebf42`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:25.108883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-69b0d36d-cc58-4ba6-a7b0-f41febaf1a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:25.127650 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 806/1619] 10.222.0.33 () {58 vars in 1059 bytes} [Thu Jul 28 05:31:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:25.140960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcde8c-d2a9-4195-9ce2-afc0361e5a58 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:25.155598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:25.157102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcde8c-d2a9-4195-9ce2-afc0361e5a58 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:25.166032 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b2ec6-91e2-4269-8e38-9e56ae4a0ac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:25.167924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b2ec6-91e2-4269-8e38-9e56ae4a0ac9 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:25.167924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b2ec6-91e2-4269-8e38-9e56ae4a0ac9 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:25.167924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b2ec6-91e2-4269-8e38-9e56ae4a0ac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:25.186649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b2ec6-91e2-4269-8e38-9e56ae4a0ac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:25.192201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b2ec6-91e2-4269-8e38-9e56ae4a0ac9 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:25.205686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 807/1620] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:25.271515 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 814/1621] 10.222.0.33 () {58 vars in 1059 bytes} [Thu Jul 28 05:31:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:25.280194 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b2ec6-91e2-4269-8e38-9e56ae4a0ac9 service nova] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:25.294787 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b2ec6-91e2-4269-8e38-9e56ae4a0ac9 service nova] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:25.303676 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fca1d0-60c0-455d-a383-34dfcd93f2ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:25.304449 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fca1d0-60c0-455d-a383-34dfcd93f2ef service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:25.304807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fca1d0-60c0-455d-a383-34dfcd93f2ef service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:25.305160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fca1d0-60c0-455d-a383-34dfcd93f2ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:25.320508 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fca1d0-60c0-455d-a383-34dfcd93f2ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:25.323217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fca1d0-60c0-455d-a383-34dfcd93f2ef service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:25.339584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 808/1622] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:25.725055 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771953ec-cddb-4845-952d-fbf8ff987487 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:25.725344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771953ec-cddb-4845-952d-fbf8ff987487 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:25.725709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771953ec-cddb-4845-952d-fbf8ff987487 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:25.727275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 815/1623] 10.222.0.33 () {54 vars in 912 bytes} [Thu Jul 28 05:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:25.733205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74b202-7714-40c9-806e-76f47438aeab None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:25.733420 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b4349-c511-4175-985e-5fe67a80f883 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:25.733903 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b4349-c511-4175-985e-5fe67a80f883 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:25.734192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b4349-c511-4175-985e-5fe67a80f883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:25.734801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74b202-7714-40c9-806e-76f47438aeab None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:25.734801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74b202-7714-40c9-806e-76f47438aeab None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:25.736785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 809/1624] 10.222.0.33 () {54 vars in 912 bytes} [Thu Jul 28 05:31:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:25.742860 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084670a-b594-4f0c-b50f-388934aa7c85 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:25.743275 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084670a-b594-4f0c-b50f-388934aa7c85 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:25.744796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084670a-b594-4f0c-b50f-388934aa7c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:25.768735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ae2b4349-c511-4175-985e-5fe67a80f883 None None] MFA Rules not processed for user `99d8c709e6f4462c98c055cb03eebf42`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:25.771413 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-2084670a-b594-4f0c-b50f-388934aa7c85 None None] MFA Rules not processed for user `99d8c709e6f4462c98c055cb03eebf42`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:25.771697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ae2b4349-c511-4175-985e-5fe67a80f883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:25.773192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2084670a-b594-4f0c-b50f-388934aa7c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:25.788717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 810/1625] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jul 28 05:31:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:31:25.802479 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 816/1626] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jul 28 05:31:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:25.812409 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b4349-c511-4175-985e-5fe67a80f883 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:25.816073 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084670a-b594-4f0c-b50f-388934aa7c85 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:25.886679 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b4349-c511-4175-985e-5fe67a80f883 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:25.892582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6f48f-ed12-442a-8c1d-5467f9e01dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:25.893629 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6f48f-ed12-442a-8c1d-5467f9e01dee service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:25.894109 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6f48f-ed12-442a-8c1d-5467f9e01dee service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:25.894535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6f48f-ed12-442a-8c1d-5467f9e01dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:25.910013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6f48f-ed12-442a-8c1d-5467f9e01dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:25.911887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6f48f-ed12-442a-8c1d-5467f9e01dee service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:25.920148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084670a-b594-4f0c-b50f-388934aa7c85 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:25.928814 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f7555-a782-454f-beac-29f1aa4589c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:25.930063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f7555-a782-454f-beac-29f1aa4589c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:25.931326 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f7555-a782-454f-beac-29f1aa4589c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:25.931709 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f7555-a782-454f-beac-29f1aa4589c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:25.939549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 817/1627] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:31:25.962995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f7555-a782-454f-beac-29f1aa4589c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:25.962995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f7555-a782-454f-beac-29f1aa4589c2 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:25.994810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 811/1628] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:27.133214 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6f48f-ed12-442a-8c1d-5467f9e01dee service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:27.150851 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6f48f-ed12-442a-8c1d-5467f9e01dee service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:27.167766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0de35-ffb7-4999-9566-ba70869a5440 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:27.168707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0de35-ffb7-4999-9566-ba70869a5440 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:27.169178 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0de35-ffb7-4999-9566-ba70869a5440 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:27.171297 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0de35-ffb7-4999-9566-ba70869a5440 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:27.204126 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0de35-ffb7-4999-9566-ba70869a5440 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:27.206086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0de35-ffb7-4999-9566-ba70869a5440 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:27.536884 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 818/1629] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:27.727396 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f7555-a782-454f-beac-29f1aa4589c2 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:27.742876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f7555-a782-454f-beac-29f1aa4589c2 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:27.763202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062173db-24d0-4219-9082-aad8729d7a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:27.764256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062173db-24d0-4219-9082-aad8729d7a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:27.764608 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062173db-24d0-4219-9082-aad8729d7a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:27.769197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062173db-24d0-4219-9082-aad8729d7a20 admin admin] PATH_INFO: `/v3/users/2b29296ad64f4c87907ffc9722f2300d` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:27.769197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062173db-24d0-4219-9082-aad8729d7a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b29296ad64f4c87907ffc9722f2300d)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:27.769586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: WARNING py.warnings [None req-062173db-24d0-4219-9082-aad8729d7a20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:31:27.769586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: warnings.warn(msg) Jul 28 05:31:27.769586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: Jul 28 05:31:27.771069 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062173db-24d0-4219-9082-aad8729d7a20 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:28.068135 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:28.083043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-062173db-24d0-4219-9082-aad8729d7a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b29296ad64f4c87907ffc9722f2300d'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:28.084672 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-062173db-24d0-4219-9082-aad8729d7a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b29296ad64f4c87907ffc9722f2300d'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:28.202208 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-062173db-24d0-4219-9082-aad8729d7a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b29296ad64f4c87907ffc9722f2300d'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:28.220386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-062173db-24d0-4219-9082-aad8729d7a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b29296ad64f4c87907ffc9722f2300d'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:28.252815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-062173db-24d0-4219-9082-aad8729d7a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b29296ad64f4c87907ffc9722f2300d'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:28.267963 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 812/1630] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:31:27 2022] DELETE /identity/v3/users/2b29296ad64f4c87907ffc9722f2300d => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:28.269485 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580b779-9fa0-48fe-8a51-fb320c779382 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:28.271450 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580b779-9fa0-48fe-8a51-fb320c779382 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:28.271959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580b779-9fa0-48fe-8a51-fb320c779382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:28.293165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a580b779-9fa0-48fe-8a51-fb320c779382 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:28.295360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a580b779-9fa0-48fe-8a51-fb320c779382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:28.377351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 819/1631] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:28.395504 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062173db-24d0-4219-9082-aad8729d7a20 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:28.397061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-062173db-24d0-4219-9082-aad8729d7a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:28.530227 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062173db-24d0-4219-9082-aad8729d7a20 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:28.543595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13517380-6dca-4c63-84a5-7bbc1203539d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:28.544067 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13517380-6dca-4c63-84a5-7bbc1203539d service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:28.544324 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13517380-6dca-4c63-84a5-7bbc1203539d service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:28.545442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13517380-6dca-4c63-84a5-7bbc1203539d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:28.561857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13517380-6dca-4c63-84a5-7bbc1203539d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:28.563901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13517380-6dca-4c63-84a5-7bbc1203539d service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:28.578517 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 813/1632] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:30.087425 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580b779-9fa0-48fe-8a51-fb320c779382 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:30.087425 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a580b779-9fa0-48fe-8a51-fb320c779382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:30.117150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580b779-9fa0-48fe-8a51-fb320c779382 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:30.136391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea968e47-e468-44e3-a0e5-5891e803a5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:30.139131 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea968e47-e468-44e3-a0e5-5891e803a5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:30.139131 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea968e47-e468-44e3-a0e5-5891e803a5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:30.139131 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea968e47-e468-44e3-a0e5-5891e803a5d7 admin admin] PATH_INFO: `/v3/projects/3df895dfc7b342658d72bffd0f5ac40e` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:30.140115 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea968e47-e468-44e3-a0e5-5891e803a5d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df895dfc7b342658d72bffd0f5ac40e)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:30.142156 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: WARNING py.warnings [None req-ea968e47-e468-44e3-a0e5-5891e803a5d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:31:30.142156 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: warnings.warn(msg) Jul 28 05:31:30.142156 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: Jul 28 05:31:30.156276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea968e47-e468-44e3-a0e5-5891e803a5d7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:30.318534 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:30.363141 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ea968e47-e468-44e3-a0e5-5891e803a5d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df895dfc7b342658d72bffd0f5ac40e', 'request_id': 'req-ea968e47-e468-44e3-a0e5-5891e803a5d7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:30.452785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ea968e47-e468-44e3-a0e5-5891e803a5d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df895dfc7b342658d72bffd0f5ac40e', 'request_id': 'req-ea968e47-e468-44e3-a0e5-5891e803a5d7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:30.483909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ea968e47-e468-44e3-a0e5-5891e803a5d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df895dfc7b342658d72bffd0f5ac40e', 'request_id': 'req-ea968e47-e468-44e3-a0e5-5891e803a5d7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:30.516069 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ea968e47-e468-44e3-a0e5-5891e803a5d7 admin admin] The token cache is being invalidate because project 3df895dfc7b342658d72bffd0f5ac40e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:31:30.517715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ea968e47-e468-44e3-a0e5-5891e803a5d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:30.517715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ea968e47-e468-44e3-a0e5-5891e803a5d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:30.519433 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 820/1633] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:31:30 2022] DELETE /identity/v3/projects/3df895dfc7b342658d72bffd0f5ac40e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:30.529846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e73a-0d0d-42a9-88e1-d3a60b0b9f27 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:30.530613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e73a-0d0d-42a9-88e1-d3a60b0b9f27 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:30.530613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e73a-0d0d-42a9-88e1-d3a60b0b9f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:30.589424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-3928e73a-0d0d-42a9-88e1-d3a60b0b9f27 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:30.590819 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-3928e73a-0d0d-42a9-88e1-d3a60b0b9f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:30.764670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 814/1634] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:30.767276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aeddd-cdb4-4540-9bf0-a31688e5c1ca None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:30.767687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aeddd-cdb4-4540-9bf0-a31688e5c1ca None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:30.767994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aeddd-cdb4-4540-9bf0-a31688e5c1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:30.818595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d56aeddd-cdb4-4540-9bf0-a31688e5c1ca None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:30.820351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d56aeddd-cdb4-4540-9bf0-a31688e5c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:30.845566 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 821/1635] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:30.849626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928e73a-0d0d-42a9-88e1-d3a60b0b9f27 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:30.904240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928e73a-0d0d-42a9-88e1-d3a60b0b9f27 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:30.923683 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869e5d3-2cb0-4c50-bc7a-f52d768149b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:30.924335 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869e5d3-2cb0-4c50-bc7a-f52d768149b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:30.925293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869e5d3-2cb0-4c50-bc7a-f52d768149b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:30.925293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869e5d3-2cb0-4c50-bc7a-f52d768149b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:30.925645 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869e5d3-2cb0-4c50-bc7a-f52d768149b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:31:30.925934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869e5d3-2cb0-4c50-bc7a-f52d768149b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:30.927551 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869e5d3-2cb0-4c50-bc7a-f52d768149b4 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:30.970121 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 815/1636] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:31:30.970424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56aeddd-cdb4-4540-9bf0-a31688e5c1ca None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:30.988446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56aeddd-cdb4-4540-9bf0-a31688e5c1ca None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:31.000385 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321f8aa-6edd-4c05-b00c-29ab2b5dae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:31.001057 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321f8aa-6edd-4c05-b00c-29ab2b5dae65 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:31.001343 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321f8aa-6edd-4c05-b00c-29ab2b5dae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:31.001655 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321f8aa-6edd-4c05-b00c-29ab2b5dae65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:31.002368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321f8aa-6edd-4c05-b00c-29ab2b5dae65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:31.004341 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321f8aa-6edd-4c05-b00c-29ab2b5dae65 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:31.158433 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 822/1637] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:31:30 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:31:31.162085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869e5d3-2cb0-4c50-bc7a-f52d768149b4 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:31.182171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869e5d3-2cb0-4c50-bc7a-f52d768149b4 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:31.341096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321f8aa-6edd-4c05-b00c-29ab2b5dae65 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:31.343830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f321f8aa-6edd-4c05-b00c-29ab2b5dae65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:31.358438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:31.394826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c4772-d7dc-44f9-9846-67a19f92b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:31.395646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c4772-d7dc-44f9-9846-67a19f92b7ba admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:31.395762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c4772-d7dc-44f9-9846-67a19f92b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:31.396000 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c4772-d7dc-44f9-9846-67a19f92b7ba admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:31.396671 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c4772-d7dc-44f9-9846-67a19f92b7ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:31.398636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c4772-d7dc-44f9-9846-67a19f92b7ba admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:31.509652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 816/1638] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:31:31 2022] POST /identity/v3/users => generated 292 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:31.509652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c4772-d7dc-44f9-9846-67a19f92b7ba admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:31.509985 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321f8aa-6edd-4c05-b00c-29ab2b5dae65 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:31.517634 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f686c93-24b2-4562-8158-9c25eb0d5a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:31.518257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f686c93-24b2-4562-8158-9c25eb0d5a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:31.518462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f686c93-24b2-4562-8158-9c25eb0d5a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:31.518744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f686c93-24b2-4562-8158-9c25eb0d5a8c admin admin] PATH_INFO: `/v3/users/c93ac044c94544bd97d8dc7484a60f2e` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:31.519372 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c4772-d7dc-44f9-9846-67a19f92b7ba admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:31.523549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f686c93-24b2-4562-8158-9c25eb0d5a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c93ac044c94544bd97d8dc7484a60f2e)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:31.525571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f686c93-24b2-4562-8158-9c25eb0d5a8c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:31.531383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd436d8-e8d5-4ba0-8491-e58a467e5fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:31.539228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd436d8-e8d5-4ba0-8491-e58a467e5fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:31.539228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd436d8-e8d5-4ba0-8491-e58a467e5fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:31.539228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd436d8-e8d5-4ba0-8491-e58a467e5fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:31.539228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd436d8-e8d5-4ba0-8491-e58a467e5fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:31.539228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd436d8-e8d5-4ba0-8491-e58a467e5fe5 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:31.557621 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 817/1639] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:31.563802 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd436d8-e8d5-4ba0-8491-e58a467e5fe5 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:31.591117 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd436d8-e8d5-4ba0-8491-e58a467e5fe5 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:31.607880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe48462-216f-473c-9371-0272d633e4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:31.608474 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48462-216f-473c-9371-0272d633e4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:31.608763 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48462-216f-473c-9371-0272d633e4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:31.609189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48462-216f-473c-9371-0272d633e4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:31.610488 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe48462-216f-473c-9371-0272d633e4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:31.614654 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe48462-216f-473c-9371-0272d633e4b6 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:31.637740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 818/1640] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:31.645290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe48462-216f-473c-9371-0272d633e4b6 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:31.665532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe48462-216f-473c-9371-0272d633e4b6 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:31.679635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603709a-24b4-4352-a768-09fb39aabcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:31.680358 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603709a-24b4-4352-a768-09fb39aabcbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:31.680644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603709a-24b4-4352-a768-09fb39aabcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:31.680910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603709a-24b4-4352-a768-09fb39aabcbe admin admin] PATH_INFO: `/v3/projects/4ea63b9556a041a0bb83bd44566b4edd/users/845b568ca7a5431d990ef4c80226e201/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:31.704088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603709a-24b4-4352-a768-09fb39aabcbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea63b9556a041a0bb83bd44566b4edd, user_id=845b568ca7a5431d990ef4c80226e201, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:31.707525 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603709a-24b4-4352-a768-09fb39aabcbe admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:31.758719 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6f686c93-24b2-4562-8158-9c25eb0d5a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93ac044c94544bd97d8dc7484a60f2e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:31.759599 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6f686c93-24b2-4562-8158-9c25eb0d5a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93ac044c94544bd97d8dc7484a60f2e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:31.821380 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 819/1641] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:31 2022] PUT /identity/v3/projects/4ea63b9556a041a0bb83bd44566b4edd/users/845b568ca7a5431d990ef4c80226e201/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:31:31.832862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70f165-6275-4b58-932e-9c798dbd401e None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:31.833259 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70f165-6275-4b58-932e-9c798dbd401e None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:31.833792 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70f165-6275-4b58-932e-9c798dbd401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:31.921269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6f686c93-24b2-4562-8158-9c25eb0d5a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93ac044c94544bd97d8dc7484a60f2e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:31.934111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-bb70f165-6275-4b58-932e-9c798dbd401e None None] MFA Rules not processed for user `845b568ca7a5431d990ef4c80226e201`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:31.944758 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-bb70f165-6275-4b58-932e-9c798dbd401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:31.970344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6f686c93-24b2-4562-8158-9c25eb0d5a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93ac044c94544bd97d8dc7484a60f2e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:31.973914 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6f686c93-24b2-4562-8158-9c25eb0d5a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93ac044c94544bd97d8dc7484a60f2e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:32.033939 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 823/1642] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:31:31 2022] DELETE /identity/v3/users/c93ac044c94544bd97d8dc7484a60f2e => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:31:32.041440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0ef40-a4e8-4cfc-b29d-1df891c73feb None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:32.041440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0ef40-a4e8-4cfc-b29d-1df891c73feb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:32.041440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0ef40-a4e8-4cfc-b29d-1df891c73feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:32.061071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-cbe0ef40-a4e8-4cfc-b29d-1df891c73feb None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:32.063051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cbe0ef40-a4e8-4cfc-b29d-1df891c73feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:32.070730 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:32.231251 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 820/1643] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:32.231251 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70f165-6275-4b58-932e-9c798dbd401e None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:32.231399 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 824/1644] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:32.232171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-bb70f165-6275-4b58-932e-9c798dbd401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:32.250216 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0ef40-a4e8-4cfc-b29d-1df891c73feb None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:32.251986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cbe0ef40-a4e8-4cfc-b29d-1df891c73feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:32.352247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70f165-6275-4b58-932e-9c798dbd401e None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:32.361533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b216fde-fe54-4c7d-ab6d-972d56058e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:32.362160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0ef40-a4e8-4cfc-b29d-1df891c73feb None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:32.363267 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b216fde-fe54-4c7d-ab6d-972d56058e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:32.363656 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b216fde-fe54-4c7d-ab6d-972d56058e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:32.368507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b216fde-fe54-4c7d-ab6d-972d56058e73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:32.369496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b216fde-fe54-4c7d-ab6d-972d56058e73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:32.372202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b216fde-fe54-4c7d-ab6d-972d56058e73 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:32.378838 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06008264-4367-48a6-a978-6577e2336635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:32.379554 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06008264-4367-48a6-a978-6577e2336635 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:32.380004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06008264-4367-48a6-a978-6577e2336635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:32.380440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06008264-4367-48a6-a978-6577e2336635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:32.430559 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06008264-4367-48a6-a978-6577e2336635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:32.434429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06008264-4367-48a6-a978-6577e2336635 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:32.449965 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 825/1645] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:31:32.539761 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 821/1646] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:31:32 2022] POST /identity/v3/projects => generated 381 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:31:32.543949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06008264-4367-48a6-a978-6577e2336635 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:32.563748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06008264-4367-48a6-a978-6577e2336635 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:32.674156 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c38de0-14c3-4795-8145-580b5c0676bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:32.675219 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c38de0-14c3-4795-8145-580b5c0676bd admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:32.675771 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c38de0-14c3-4795-8145-580b5c0676bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:32.676316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c38de0-14c3-4795-8145-580b5c0676bd admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:32.677874 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c38de0-14c3-4795-8145-580b5c0676bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:32.680310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c38de0-14c3-4795-8145-580b5c0676bd admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:32.774624 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 826/1647] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:31:32 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:32.779548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b216fde-fe54-4c7d-ab6d-972d56058e73 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:32.787115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:32.795228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b216fde-fe54-4c7d-ab6d-972d56058e73 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:32.809126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13634f22-a44f-4abf-bb18-10e789b19657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:32.809838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13634f22-a44f-4abf-bb18-10e789b19657 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:32.810224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13634f22-a44f-4abf-bb18-10e789b19657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:32.810663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13634f22-a44f-4abf-bb18-10e789b19657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:32.811620 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13634f22-a44f-4abf-bb18-10e789b19657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:32.813328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13634f22-a44f-4abf-bb18-10e789b19657 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:32.839105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 822/1648] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:32.840568 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c38de0-14c3-4795-8145-580b5c0676bd admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:32.860363 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c38de0-14c3-4795-8145-580b5c0676bd admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:32.871416 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5df98-089c-4e70-9187-7c6634527b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:32.872123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5df98-089c-4e70-9187-7c6634527b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:32.872408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5df98-089c-4e70-9187-7c6634527b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:32.872978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5df98-089c-4e70-9187-7c6634527b3c admin admin] PATH_INFO: `/v3/projects/b6f05ed1950d4b188199aa00477d0838/users/54e8989187514c3b917b52a184fbf7d6/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:32.910023 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5df98-089c-4e70-9187-7c6634527b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f05ed1950d4b188199aa00477d0838, user_id=54e8989187514c3b917b52a184fbf7d6, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:32.913880 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5df98-089c-4e70-9187-7c6634527b3c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:33.021120 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 827/1649] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:32 2022] PUT /identity/v3/projects/b6f05ed1950d4b188199aa00477d0838/users/54e8989187514c3b917b52a184fbf7d6/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:33.025672 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13634f22-a44f-4abf-bb18-10e789b19657 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:33.060050 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13634f22-a44f-4abf-bb18-10e789b19657 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:33.242511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e4118-53f7-42f4-9680-948a096c8a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:33.243287 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e4118-53f7-42f4-9680-948a096c8a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:33.246032 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e4118-53f7-42f4-9680-948a096c8a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:33.250913 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e4118-53f7-42f4-9680-948a096c8a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:33.253692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e4118-53f7-42f4-9680-948a096c8a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:33.273314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e4118-53f7-42f4-9680-948a096c8a5d admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:33.301575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 823/1650] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:33.314057 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5df98-089c-4e70-9187-7c6634527b3c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:33.353589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5df98-089c-4e70-9187-7c6634527b3c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:33.360683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad752e-ca67-42a3-a747-2693d88056a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:33.361690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad752e-ca67-42a3-a747-2693d88056a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:33.362204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad752e-ca67-42a3-a747-2693d88056a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:33.362715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad752e-ca67-42a3-a747-2693d88056a0 admin admin] PATH_INFO: `/v3/projects/b6f05ed1950d4b188199aa00477d0838/users/54e8989187514c3b917b52a184fbf7d6/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:33.367356 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad752e-ca67-42a3-a747-2693d88056a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f05ed1950d4b188199aa00477d0838, user_id=54e8989187514c3b917b52a184fbf7d6, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:33.375537 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad752e-ca67-42a3-a747-2693d88056a0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:33.403489 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 828/1651] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:33 2022] PUT /identity/v3/projects/b6f05ed1950d4b188199aa00477d0838/users/54e8989187514c3b917b52a184fbf7d6/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:33.413296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf26b8-69ee-410d-a321-9fe9eeaafe5a None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:33.417634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf26b8-69ee-410d-a321-9fe9eeaafe5a None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:33.417634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf26b8-69ee-410d-a321-9fe9eeaafe5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:33.496128 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-9ebf26b8-69ee-410d-a321-9fe9eeaafe5a None None] MFA Rules not processed for user `54e8989187514c3b917b52a184fbf7d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:33.498388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9ebf26b8-69ee-410d-a321-9fe9eeaafe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:33.686053 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 824/1652] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:31:33.698313 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad752e-ca67-42a3-a747-2693d88056a0 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:33.702236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-73ad752e-ca67-42a3-a747-2693d88056a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:33.724537 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:33.832366 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad752e-ca67-42a3-a747-2693d88056a0 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:33.836748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b4225-fb5c-4484-b93d-a42ec872570f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:33.837579 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b4225-fb5c-4484-b93d-a42ec872570f service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:33.837969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b4225-fb5c-4484-b93d-a42ec872570f service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:33.838350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b4225-fb5c-4484-b93d-a42ec872570f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:33.881131 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b4225-fb5c-4484-b93d-a42ec872570f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:33.883173 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b4225-fb5c-4484-b93d-a42ec872570f service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:33.945144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 829/1653] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:34.183827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf26b8-69ee-410d-a321-9fe9eeaafe5a None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:34.201549 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf26b8-69ee-410d-a321-9fe9eeaafe5a None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:34.211893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0056d06-7379-4cd2-8e70-127f5e182fd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:34.212899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056d06-7379-4cd2-8e70-127f5e182fd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:34.213575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056d06-7379-4cd2-8e70-127f5e182fd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:34.214098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056d06-7379-4cd2-8e70-127f5e182fd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:34.383218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0056d06-7379-4cd2-8e70-127f5e182fd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:34.384966 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0056d06-7379-4cd2-8e70-127f5e182fd6 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:34.397294 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 825/1654] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:35.008736 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b4225-fb5c-4484-b93d-a42ec872570f service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:35.011039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-941b4225-fb5c-4484-b93d-a42ec872570f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:35.192087 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b4225-fb5c-4484-b93d-a42ec872570f service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:35.201098 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7894f85-0b48-492f-8c5c-a0f4e7bfada6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:35.204907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7894f85-0b48-492f-8c5c-a0f4e7bfada6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:35.204907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7894f85-0b48-492f-8c5c-a0f4e7bfada6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:35.204907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7894f85-0b48-492f-8c5c-a0f4e7bfada6 admin admin] PATH_INFO: `/v3/projects/19eae28e6e994365b586085a55f29aeb` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:35.204907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7894f85-0b48-492f-8c5c-a0f4e7bfada6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19eae28e6e994365b586085a55f29aeb)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:35.209265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7894f85-0b48-492f-8c5c-a0f4e7bfada6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:35.427830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f7894f85-0b48-492f-8c5c-a0f4e7bfada6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19eae28e6e994365b586085a55f29aeb', 'request_id': 'req-f7894f85-0b48-492f-8c5c-a0f4e7bfada6'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:35.530421 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f7894f85-0b48-492f-8c5c-a0f4e7bfada6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19eae28e6e994365b586085a55f29aeb', 'request_id': 'req-f7894f85-0b48-492f-8c5c-a0f4e7bfada6'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:35.539195 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f7894f85-0b48-492f-8c5c-a0f4e7bfada6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19eae28e6e994365b586085a55f29aeb', 'request_id': 'req-f7894f85-0b48-492f-8c5c-a0f4e7bfada6'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:35.555485 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f7894f85-0b48-492f-8c5c-a0f4e7bfada6 admin admin] The token cache is being invalidate because project 19eae28e6e994365b586085a55f29aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:31:35.560006 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f7894f85-0b48-492f-8c5c-a0f4e7bfada6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:35.560006 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f7894f85-0b48-492f-8c5c-a0f4e7bfada6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:35.564360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 830/1655] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:31:35 2022] DELETE /identity/v3/projects/19eae28e6e994365b586085a55f29aeb => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:35.564693 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c6fbe-5676-4d62-9c0d-2aa465ba629b None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:35.566033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c6fbe-5676-4d62-9c0d-2aa465ba629b None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:35.566665 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c6fbe-5676-4d62-9c0d-2aa465ba629b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:35.646627 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-a36c6fbe-5676-4d62-9c0d-2aa465ba629b None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:35.650520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-a36c6fbe-5676-4d62-9c0d-2aa465ba629b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:35.662995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:35.845048 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 826/1656] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:35.855364 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb251fea-48e7-40bd-ab6d-ab4144026cfd None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:35.855661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb251fea-48e7-40bd-ab6d-ab4144026cfd None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:35.855950 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb251fea-48e7-40bd-ab6d-ab4144026cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:35.881094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da469e70-1257-476c-a75b-c31f7f8dd049 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:35.881377 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da469e70-1257-476c-a75b-c31f7f8dd049 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:35.881708 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da469e70-1257-476c-a75b-c31f7f8dd049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:35.933996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-cb251fea-48e7-40bd-ab6d-ab4144026cfd None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:35.940820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cb251fea-48e7-40bd-ab6d-ab4144026cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:35.970764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 831/1657] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:35.970852 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-da469e70-1257-476c-a75b-c31f7f8dd049 None None] MFA Rules not processed for user `b3c43b517c8a464c93f0ce620826ad35`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:35.970852 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-da469e70-1257-476c-a75b-c31f7f8dd049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:35.970997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb251fea-48e7-40bd-ab6d-ab4144026cfd None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:35.985818 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb251fea-48e7-40bd-ab6d-ab4144026cfd None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:35.991037 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb091d16-9ac4-4eab-8fc3-d36b3df4d392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:35.991732 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb091d16-9ac4-4eab-8fc3-d36b3df4d392 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:35.992418 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb091d16-9ac4-4eab-8fc3-d36b3df4d392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:35.992418 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb091d16-9ac4-4eab-8fc3-d36b3df4d392 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:35.993004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb091d16-9ac4-4eab-8fc3-d36b3df4d392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:31:35.993319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb091d16-9ac4-4eab-8fc3-d36b3df4d392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:35.995141 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb091d16-9ac4-4eab-8fc3-d36b3df4d392 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:36.014185 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 832/1658] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:31:36.016161 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb091d16-9ac4-4eab-8fc3-d36b3df4d392 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:36.032420 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb091d16-9ac4-4eab-8fc3-d36b3df4d392 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:36.046895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fea369-f982-47d8-b3ce-11d74d20b373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:36.047952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea369-f982-47d8-b3ce-11d74d20b373 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:36.048539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea369-f982-47d8-b3ce-11d74d20b373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:36.049037 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea369-f982-47d8-b3ce-11d74d20b373 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:36.050177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fea369-f982-47d8-b3ce-11d74d20b373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:36.052504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fea369-f982-47d8-b3ce-11d74d20b373 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:36.064584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 827/1659] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:36.080683 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da469e70-1257-476c-a75b-c31f7f8dd049 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:36.082724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-da469e70-1257-476c-a75b-c31f7f8dd049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:36.167264 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:36.181593 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 833/1660] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:31:36 2022] POST /identity/v3/projects => generated 363 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:31:36.186098 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802311e5-406d-44b3-8e3b-491d77c1241c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:36.188758 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802311e5-406d-44b3-8e3b-491d77c1241c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:36.189271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802311e5-406d-44b3-8e3b-491d77c1241c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:36.233903 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da469e70-1257-476c-a75b-c31f7f8dd049 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:36.310468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-802311e5-406d-44b3-8e3b-491d77c1241c None None] MFA Rules not processed for user `4fcc81558e8f4224ad2ea6fb2b7bf0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:36.313839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-802311e5-406d-44b3-8e3b-491d77c1241c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:36.314573 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:36.384191 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e297b43-ab3a-4902-a545-61dea6387858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:36.384980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e297b43-ab3a-4902-a545-61dea6387858 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:36.385328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e297b43-ab3a-4902-a545-61dea6387858 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:36.385768 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e297b43-ab3a-4902-a545-61dea6387858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:36.425743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 834/1661] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:36.427342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802311e5-406d-44b3-8e3b-491d77c1241c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:36.532477 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e297b43-ab3a-4902-a545-61dea6387858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:36.533967 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e297b43-ab3a-4902-a545-61dea6387858 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:36.578991 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 828/1662] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:31:36.581874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504c3b5-ceb1-4075-8d5f-f8a510b6e36a None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:36.583941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504c3b5-ceb1-4075-8d5f-f8a510b6e36a None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:36.584375 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504c3b5-ceb1-4075-8d5f-f8a510b6e36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:36.617007 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802311e5-406d-44b3-8e3b-491d77c1241c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:36.631817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-7504c3b5-ceb1-4075-8d5f-f8a510b6e36a None None] MFA Rules not processed for user `4fcc81558e8f4224ad2ea6fb2b7bf0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:36.634377 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5f863-5336-4d49-8eb6-16ac9820f7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:36.641211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5f863-5336-4d49-8eb6-16ac9820f7af admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:36.641211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5f863-5336-4d49-8eb6-16ac9820f7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:36.641211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5f863-5336-4d49-8eb6-16ac9820f7af admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:36.641211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5f863-5336-4d49-8eb6-16ac9820f7af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:36.641211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5f863-5336-4d49-8eb6-16ac9820f7af admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:36.641784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7504c3b5-ceb1-4075-8d5f-f8a510b6e36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:36.664266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 829/1663] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:36.677220 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504c3b5-ceb1-4075-8d5f-f8a510b6e36a None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:36.681366 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7504c3b5-ceb1-4075-8d5f-f8a510b6e36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:36.718342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504c3b5-ceb1-4075-8d5f-f8a510b6e36a None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:36.732400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b7350-9417-4bda-8aeb-119e47a06829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:36.735262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b7350-9417-4bda-8aeb-119e47a06829 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:36.739271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b7350-9417-4bda-8aeb-119e47a06829 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:36.739729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b7350-9417-4bda-8aeb-119e47a06829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:36.760079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b7350-9417-4bda-8aeb-119e47a06829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:36.765400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b7350-9417-4bda-8aeb-119e47a06829 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:36.796941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 830/1664] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:36.848372 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b7350-9417-4bda-8aeb-119e47a06829 service nova] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:36.849417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 835/1665] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:31:36 2022] POST /identity/v3/users => generated 282 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:36.882398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b7350-9417-4bda-8aeb-119e47a06829 service nova] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:36.891838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a457de4-556e-4eeb-9fc8-4b778ef81406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:36.892639 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a457de4-556e-4eeb-9fc8-4b778ef81406 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:36.897197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a457de4-556e-4eeb-9fc8-4b778ef81406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:36.905649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a457de4-556e-4eeb-9fc8-4b778ef81406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:36.907818 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a457de4-556e-4eeb-9fc8-4b778ef81406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:36.914076 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a457de4-556e-4eeb-9fc8-4b778ef81406 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:36.945781 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5f863-5336-4d49-8eb6-16ac9820f7af admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:36.989492 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 831/1666] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:31:36.995088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5f863-5336-4d49-8eb6-16ac9820f7af admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:37.009247 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d75f3-93c8-447e-b3fc-b9813cf79022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:37.009247 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d75f3-93c8-447e-b3fc-b9813cf79022 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:37.009560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d75f3-93c8-447e-b3fc-b9813cf79022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:37.009778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d75f3-93c8-447e-b3fc-b9813cf79022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:37.012655 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d75f3-93c8-447e-b3fc-b9813cf79022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:37.017747 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d75f3-93c8-447e-b3fc-b9813cf79022 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:37.048520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a457de4-556e-4eeb-9fc8-4b778ef81406 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:37.055159 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 836/1667] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:37.065111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a457de4-556e-4eeb-9fc8-4b778ef81406 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:37.097516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6824a-0c02-424c-b2fd-99943868764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:37.099175 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6824a-0c02-424c-b2fd-99943868764e admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:37.099658 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6824a-0c02-424c-b2fd-99943868764e admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:37.100564 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6824a-0c02-424c-b2fd-99943868764e admin admin] PATH_INFO: `/v3/projects/9a0165a9056f47e7a337a04041d4064e/users/a25dba6dad2b4c07906e6ef7e8d6fa4c/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:37.155374 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6824a-0c02-424c-b2fd-99943868764e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0165a9056f47e7a337a04041d4064e, user_id=a25dba6dad2b4c07906e6ef7e8d6fa4c, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:37.158667 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6824a-0c02-424c-b2fd-99943868764e admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:37.284365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 832/1668] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:37 2022] PUT /identity/v3/projects/9a0165a9056f47e7a337a04041d4064e/users/a25dba6dad2b4c07906e6ef7e8d6fa4c/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:37.290144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1069a42-87cf-4b62-8bb2-e2b7c6df20af None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:37.290741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1069a42-87cf-4b62-8bb2-e2b7c6df20af None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:37.291214 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1069a42-87cf-4b62-8bb2-e2b7c6df20af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:37.352114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b1069a42-87cf-4b62-8bb2-e2b7c6df20af None None] MFA Rules not processed for user `a25dba6dad2b4c07906e6ef7e8d6fa4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:37.355338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b1069a42-87cf-4b62-8bb2-e2b7c6df20af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:37.579441 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 837/1669] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:37 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:37.593189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6824a-0c02-424c-b2fd-99943868764e admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:37.596469 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f7a6824a-0c02-424c-b2fd-99943868764e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:37.668915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1069a42-87cf-4b62-8bb2-e2b7c6df20af None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:37.670921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b1069a42-87cf-4b62-8bb2-e2b7c6df20af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:37.804601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6824a-0c02-424c-b2fd-99943868764e admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:37.809113 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1266c9-5829-4c85-930e-78bd2811b0c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:37.811497 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1266c9-5829-4c85-930e-78bd2811b0c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:37.811794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1266c9-5829-4c85-930e-78bd2811b0c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:37.812074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1266c9-5829-4c85-930e-78bd2811b0c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:37.827539 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1266c9-5829-4c85-930e-78bd2811b0c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:37.829278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1266c9-5829-4c85-930e-78bd2811b0c6 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:37.847142 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 833/1670] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:37.848669 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a271-cd45-41f3-b133-83d8e373deef None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:37.848961 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a271-cd45-41f3-b133-83d8e373deef None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:37.849982 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a271-cd45-41f3-b133-83d8e373deef None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:37.853767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 834/1671] 10.222.0.33 () {54 vars in 912 bytes} [Thu Jul 28 05:31:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:37.862323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09223638-b090-4b81-b487-3d7fc68cfcf9 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:37.862876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09223638-b090-4b81-b487-3d7fc68cfcf9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:37.863550 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09223638-b090-4b81-b487-3d7fc68cfcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:37.917247 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1069a42-87cf-4b62-8bb2-e2b7c6df20af None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:37.930339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbf3de-17ce-4c2f-b545-a6aca70c78f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:37.933089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbf3de-17ce-4c2f-b545-a6aca70c78f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:37.933764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbf3de-17ce-4c2f-b545-a6aca70c78f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:37.934431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbf3de-17ce-4c2f-b545-a6aca70c78f8 admin admin] PATH_INFO: `/v3/users/2008109b89af4620b2de74464b4c9758` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:37.944207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbf3de-17ce-4c2f-b545-a6aca70c78f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2008109b89af4620b2de74464b4c9758)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:37.954327 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbf3de-17ce-4c2f-b545-a6aca70c78f8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:37.955573 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-09223638-b090-4b81-b487-3d7fc68cfcf9 None None] MFA Rules not processed for user `6907d8a429404b1c92805b364900ba60`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:37.959577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-09223638-b090-4b81-b487-3d7fc68cfcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:37.974925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:38.093989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:38.125137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 835/1672] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jul 28 05:31:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:38.150287 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09223638-b090-4b81-b487-3d7fc68cfcf9 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:38.152073 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-09223638-b090-4b81-b487-3d7fc68cfcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:38.175884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09223638-b090-4b81-b487-3d7fc68cfcf9 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:38.185211 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e822f-d59f-4ed5-9237-dc5a6c425253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:38.185916 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e822f-d59f-4ed5-9237-dc5a6c425253 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:38.186319 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e822f-d59f-4ed5-9237-dc5a6c425253 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:38.186779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e822f-d59f-4ed5-9237-dc5a6c425253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:38.204397 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e822f-d59f-4ed5-9237-dc5a6c425253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:38.211377 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e822f-d59f-4ed5-9237-dc5a6c425253 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:38.250013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-33cbf3de-17ce-4c2f-b545-a6aca70c78f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2008109b89af4620b2de74464b4c9758'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:38.252908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-33cbf3de-17ce-4c2f-b545-a6aca70c78f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2008109b89af4620b2de74464b4c9758'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:38.269692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 836/1673] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:31:38.396859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e822f-d59f-4ed5-9237-dc5a6c425253 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:38.397286 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-1f0e822f-d59f-4ed5-9237-dc5a6c425253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:38.418778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-33cbf3de-17ce-4c2f-b545-a6aca70c78f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2008109b89af4620b2de74464b4c9758'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:38.432253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e822f-d59f-4ed5-9237-dc5a6c425253 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:38.438511 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-33cbf3de-17ce-4c2f-b545-a6aca70c78f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2008109b89af4620b2de74464b4c9758'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:38.439453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-33cbf3de-17ce-4c2f-b545-a6aca70c78f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2008109b89af4620b2de74464b4c9758'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:38.443300 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96483c-6fd7-4567-9756-b6d673a553a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:38.446546 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96483c-6fd7-4567-9756-b6d673a553a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:38.447014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96483c-6fd7-4567-9756-b6d673a553a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:38.447682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96483c-6fd7-4567-9756-b6d673a553a7 admin admin] PATH_INFO: `/v3/users/845b568ca7a5431d990ef4c80226e201` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:38.449245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96483c-6fd7-4567-9756-b6d673a553a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=845b568ca7a5431d990ef4c80226e201)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:38.452849 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96483c-6fd7-4567-9756-b6d673a553a7 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:38.475711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 838/1674] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:31:37 2022] DELETE /identity/v3/users/2008109b89af4620b2de74464b4c9758 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:38.491202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773841a-2457-48c0-8ffe-d17fa8b4eaca None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:38.491496 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773841a-2457-48c0-8ffe-d17fa8b4eaca None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:38.491778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773841a-2457-48c0-8ffe-d17fa8b4eaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:38.528196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9773841a-2457-48c0-8ffe-d17fa8b4eaca None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:38.530715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9773841a-2457-48c0-8ffe-d17fa8b4eaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:38.702763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 839/1675] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:38.802824 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773841a-2457-48c0-8ffe-d17fa8b4eaca None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:38.807964 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9773841a-2457-48c0-8ffe-d17fa8b4eaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:38.815297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-fc96483c-6fd7-4567-9756-b6d673a553a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '845b568ca7a5431d990ef4c80226e201'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:38.820259 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-fc96483c-6fd7-4567-9756-b6d673a553a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '845b568ca7a5431d990ef4c80226e201'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:38.911150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-fc96483c-6fd7-4567-9756-b6d673a553a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '845b568ca7a5431d990ef4c80226e201'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:38.929953 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-fc96483c-6fd7-4567-9756-b6d673a553a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '845b568ca7a5431d990ef4c80226e201'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:38.970820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773841a-2457-48c0-8ffe-d17fa8b4eaca None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:38.976057 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8900b6-67b5-45bd-b9fa-59399021149c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:38.976341 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-fc96483c-6fd7-4567-9756-b6d673a553a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '845b568ca7a5431d990ef4c80226e201'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:38.976856 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8900b6-67b5-45bd-b9fa-59399021149c service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:38.977205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8900b6-67b5-45bd-b9fa-59399021149c service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:38.977709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8900b6-67b5-45bd-b9fa-59399021149c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:38.980314 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2c8900b6-67b5-45bd-b9fa-59399021149c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:38.999831 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 837/1676] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:31:38 2022] DELETE /identity/v3/users/845b568ca7a5431d990ef4c80226e201 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:31:39.001924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2318c19-3fab-4d07-b3ca-e6f8cd8ea9a2 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:39.002326 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8900b6-67b5-45bd-b9fa-59399021149c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:39.002523 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2318c19-3fab-4d07-b3ca-e6f8cd8ea9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:39.002896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2318c19-3fab-4d07-b3ca-e6f8cd8ea9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:39.014703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8900b6-67b5-45bd-b9fa-59399021149c service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:39.045360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 840/1677] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:39.065866 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-b2318c19-3fab-4d07-b3ca-e6f8cd8ea9a2 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:39.067640 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-b2318c19-3fab-4d07-b3ca-e6f8cd8ea9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:39.166378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 838/1678] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:39.230318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8900b6-67b5-45bd-b9fa-59399021149c service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:39.233980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2c8900b6-67b5-45bd-b9fa-59399021149c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:39.250919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8900b6-67b5-45bd-b9fa-59399021149c service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:39.367355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34295a8-278f-446a-a9a4-b8830d5689be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:39.368188 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34295a8-278f-446a-a9a4-b8830d5689be service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:39.368639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34295a8-278f-446a-a9a4-b8830d5689be service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:39.369643 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34295a8-278f-446a-a9a4-b8830d5689be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:39.395640 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34295a8-278f-446a-a9a4-b8830d5689be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:39.399745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34295a8-278f-446a-a9a4-b8830d5689be service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:39.437094 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 841/1679] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:39.885553 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459cfd0-31c3-4851-9867-19df41a5125b None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:39.886066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459cfd0-31c3-4851-9867-19df41a5125b None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:39.886162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459cfd0-31c3-4851-9867-19df41a5125b None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:39.887472 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 839/1680] 10.222.0.33 () {54 vars in 961 bytes} [Thu Jul 28 05:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:39.899984 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c7062-c281-4c7a-828d-eb8b66183cd8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:39.899984 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c7062-c281-4c7a-828d-eb8b66183cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:39.899984 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c7062-c281-4c7a-828d-eb8b66183cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:39.943421 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:39.945947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-7c1c7062-c281-4c7a-828d-eb8b66183cd8 None None] MFA Rules not processed for user `3aae5b2e7bf74805b04d01df47693ded`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:39.947505 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7c1c7062-c281-4c7a-828d-eb8b66183cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:40.097349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5c252-b549-4f36-ab29-af411fceaa23 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:40.098218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5c252-b549-4f36-ab29-af411fceaa23 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:40.098699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5c252-b549-4f36-ab29-af411fceaa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:40.114782 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 842/1681] 10.222.0.33 () {58 vars in 1058 bytes} [Thu Jul 28 05:31:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:40.116044 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c7062-c281-4c7a-828d-eb8b66183cd8 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:40.134393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c7062-c281-4c7a-828d-eb8b66183cd8 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:40.140280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-c8c5c252-b549-4f36-ab29-af411fceaa23 None None] MFA Rules not processed for user `4fcc81558e8f4224ad2ea6fb2b7bf0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:40.144717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c8c5c252-b549-4f36-ab29-af411fceaa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:40.150543 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bce7f3-590c-459d-b0e7-18b96a131bd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aae5b2e7bf74805b04d01df47693ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:40.151836 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bce7f3-590c-459d-b0e7-18b96a131bd1 service placement] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:40.152343 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bce7f3-590c-459d-b0e7-18b96a131bd1 service placement] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:40.152812 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bce7f3-590c-459d-b0e7-18b96a131bd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:40.155764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-75bce7f3-590c-459d-b0e7-18b96a131bd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:40.168569 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:40.207691 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bce7f3-590c-459d-b0e7-18b96a131bd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:40.209346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bce7f3-590c-459d-b0e7-18b96a131bd1 service placement] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:40.301951 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 843/1682] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:40.332777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 840/1683] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:41.526868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e02c83-315f-4ce2-8ff0-45f4f2814b84 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:41.527373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e02c83-315f-4ce2-8ff0-45f4f2814b84 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:41.527661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e02c83-315f-4ce2-8ff0-45f4f2814b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:41.613350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c3e02c83-315f-4ce2-8ff0-45f4f2814b84 None None] MFA Rules not processed for user `b3124696ed4c40029066ceef822f35b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:41.618526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c3e02c83-315f-4ce2-8ff0-45f4f2814b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:41.870446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5c252-b549-4f36-ab29-af411fceaa23 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:41.875073 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c8c5c252-b549-4f36-ab29-af411fceaa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:41.891877 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 844/1684] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:41.926404 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5c252-b549-4f36-ab29-af411fceaa23 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:41.928642 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce12605-51ea-4fe8-b507-97485304bc4d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:41.928932 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce12605-51ea-4fe8-b507-97485304bc4d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:41.929209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce12605-51ea-4fe8-b507-97485304bc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:41.951479 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:41.952149 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:41.952433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:41.952721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e admin admin] PATH_INFO: `/v3/projects/4ea63b9556a041a0bb83bd44566b4edd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:41.954245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea63b9556a041a0bb83bd44566b4edd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:41.956366 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:41.975691 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-bce12605-51ea-4fe8-b507-97485304bc4d None None] MFA Rules not processed for user `b3124696ed4c40029066ceef822f35b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:41.977246 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bce12605-51ea-4fe8-b507-97485304bc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:41.985946 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 845/1685] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:41.998512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce12605-51ea-4fe8-b507-97485304bc4d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:42.002464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bce12605-51ea-4fe8-b507-97485304bc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:42.119972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce12605-51ea-4fe8-b507-97485304bc4d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:42.142743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fedee9-17a0-496d-8a70-bef875f7b26d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:42.143733 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fedee9-17a0-496d-8a70-bef875f7b26d service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:42.147430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fedee9-17a0-496d-8a70-bef875f7b26d service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:42.147848 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fedee9-17a0-496d-8a70-bef875f7b26d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:42.162239 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fedee9-17a0-496d-8a70-bef875f7b26d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:42.163613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea63b9556a041a0bb83bd44566b4edd', 'request_id': 'req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:42.164397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:42.166609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fedee9-17a0-496d-8a70-bef875f7b26d service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:42.183445 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 846/1686] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:42.248753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fedee9-17a0-496d-8a70-bef875f7b26d service nova] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:42.250718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-40fedee9-17a0-496d-8a70-bef875f7b26d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:42.292127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea63b9556a041a0bb83bd44566b4edd', 'request_id': 'req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:42.307501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea63b9556a041a0bb83bd44566b4edd', 'request_id': 'req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:42.316149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fedee9-17a0-496d-8a70-bef875f7b26d service nova] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:42.364902 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e admin admin] The token cache is being invalidate because project 4ea63b9556a041a0bb83bd44566b4edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:31:42.365198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:42.368845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:42.373458 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 841/1687] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:31:41 2022] DELETE /identity/v3/projects/4ea63b9556a041a0bb83bd44566b4edd => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:31:42.380327 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:42.382873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:42.549436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e7773-41a2-489d-9741-842cb415c279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:42.553310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e7773-41a2-489d-9741-842cb415c279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:42.556168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e7773-41a2-489d-9741-842cb415c279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:42.556604 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e7773-41a2-489d-9741-842cb415c279 admin admin] PATH_INFO: `/v3/projects/fe6ba5ebeed545748c37785b9cd087fe` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:42.562477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e7773-41a2-489d-9741-842cb415c279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6ba5ebeed545748c37785b9cd087fe)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:42.570779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e7773-41a2-489d-9741-842cb415c279 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:42.633243 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a4cf4-4bd2-468f-9dc4-4a5d06a0c23e admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:42.659140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c103a5-74c8-43d8-83ec-b3750698e975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:42.661459 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c103a5-74c8-43d8-83ec-b3750698e975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:42.661779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c103a5-74c8-43d8-83ec-b3750698e975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:42.662056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c103a5-74c8-43d8-83ec-b3750698e975 admin admin] PATH_INFO: `/v3/users/54e8989187514c3b917b52a184fbf7d6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:42.672746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c103a5-74c8-43d8-83ec-b3750698e975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e8989187514c3b917b52a184fbf7d6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:42.674618 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c103a5-74c8-43d8-83ec-b3750698e975 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:42.849498 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e66e7773-41a2-489d-9741-842cb415c279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6ba5ebeed545748c37785b9cd087fe', 'request_id': 'req-e66e7773-41a2-489d-9741-842cb415c279'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:42.857361 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:42.926131 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e66e7773-41a2-489d-9741-842cb415c279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6ba5ebeed545748c37785b9cd087fe', 'request_id': 'req-e66e7773-41a2-489d-9741-842cb415c279'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:42.941546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e66e7773-41a2-489d-9741-842cb415c279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6ba5ebeed545748c37785b9cd087fe', 'request_id': 'req-e66e7773-41a2-489d-9741-842cb415c279'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:42.963832 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e66e7773-41a2-489d-9741-842cb415c279 admin admin] The token cache is being invalidate because project fe6ba5ebeed545748c37785b9cd087fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:31:42.964134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e66e7773-41a2-489d-9741-842cb415c279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:42.971104 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e66e7773-41a2-489d-9741-842cb415c279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:42.972406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 847/1688] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:31:42 2022] DELETE /identity/v3/projects/fe6ba5ebeed545748c37785b9cd087fe => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:31:42.980172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d03e1-210a-4b9d-a7f8-b71a80aac299 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:42.980476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d03e1-210a-4b9d-a7f8-b71a80aac299 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:42.980900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d03e1-210a-4b9d-a7f8-b71a80aac299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:43.017448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-36c103a5-74c8-43d8-83ec-b3750698e975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e8989187514c3b917b52a184fbf7d6'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:43.020633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-36c103a5-74c8-43d8-83ec-b3750698e975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e8989187514c3b917b52a184fbf7d6'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:43.024745 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:43.073776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e46d03e1-210a-4b9d-a7f8-b71a80aac299 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:43.086260 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e46d03e1-210a-4b9d-a7f8-b71a80aac299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:43.163467 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-36c103a5-74c8-43d8-83ec-b3750698e975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e8989187514c3b917b52a184fbf7d6'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:43.177484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-36c103a5-74c8-43d8-83ec-b3750698e975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e8989187514c3b917b52a184fbf7d6'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:43.219534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-36c103a5-74c8-43d8-83ec-b3750698e975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e8989187514c3b917b52a184fbf7d6'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:43.236801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 842/1689] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:31:42 2022] DELETE /identity/v3/users/54e8989187514c3b917b52a184fbf7d6 => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:43.296457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 848/1690] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:43.302879 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4dab8-6c05-49e4-859b-c39032820db6 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:43.303409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4dab8-6c05-49e4-859b-c39032820db6 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:43.303788 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4dab8-6c05-49e4-859b-c39032820db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:43.344371 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-0ab4dab8-6c05-49e4-859b-c39032820db6 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:43.348494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-0ab4dab8-6c05-49e4-859b-c39032820db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:43.532290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 843/1691] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:43.535452 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d03e1-210a-4b9d-a7f8-b71a80aac299 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:43.554709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d03e1-210a-4b9d-a7f8-b71a80aac299 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:43.567857 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4512d-efa6-44d3-8f81-626ee1be7b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:43.568470 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4512d-efa6-44d3-8f81-626ee1be7b0a admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:43.568584 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4512d-efa6-44d3-8f81-626ee1be7b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:43.568805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4512d-efa6-44d3-8f81-626ee1be7b0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:43.569538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4512d-efa6-44d3-8f81-626ee1be7b0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:31:43.569851 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4512d-efa6-44d3-8f81-626ee1be7b0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:43.571491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4512d-efa6-44d3-8f81-626ee1be7b0a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:43.635167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 849/1692] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:31:43.640906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4dab8-6c05-49e4-859b-c39032820db6 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:43.662279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4dab8-6c05-49e4-859b-c39032820db6 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:43.695320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a9f36-dc89-43f7-be91-9db8bf6dc6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:43.695320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a9f36-dc89-43f7-be91-9db8bf6dc6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:43.695320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a9f36-dc89-43f7-be91-9db8bf6dc6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:43.695320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a9f36-dc89-43f7-be91-9db8bf6dc6f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:43.704356 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a9f36-dc89-43f7-be91-9db8bf6dc6f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:43.706874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a9f36-dc89-43f7-be91-9db8bf6dc6f3 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:43.796547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47517c8a-88a6-49ea-94e7-ef3475c1097a None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:43.797000 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47517c8a-88a6-49ea-94e7-ef3475c1097a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:43.797453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47517c8a-88a6-49ea-94e7-ef3475c1097a None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:43.799290 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 850/1693] 10.222.0.33 () {54 vars in 912 bytes} [Thu Jul 28 05:31:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:43.806994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc3cc1-a0b6-4764-a355-f3d210157c43 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:43.807493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc3cc1-a0b6-4764-a355-f3d210157c43 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:43.808092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc3cc1-a0b6-4764-a355-f3d210157c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:43.887257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4ffc3cc1-a0b6-4764-a355-f3d210157c43 None None] MFA Rules not processed for user `6907d8a429404b1c92805b364900ba60`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:43.908531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4ffc3cc1-a0b6-4764-a355-f3d210157c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:43.915220 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 844/1694] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:31:43 2022] POST /identity/v3/projects => generated 365 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:43.920226 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a9f36-dc89-43f7-be91-9db8bf6dc6f3 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:44.155203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 851/1695] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jul 28 05:31:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:44.170770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a9f36-dc89-43f7-be91-9db8bf6dc6f3 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:44.186266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8365f06-a19f-42b1-a684-56caff34bbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:44.186925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8365f06-a19f-42b1-a684-56caff34bbba admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:44.187254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8365f06-a19f-42b1-a684-56caff34bbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:44.187473 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8365f06-a19f-42b1-a684-56caff34bbba admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:44.188203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8365f06-a19f-42b1-a684-56caff34bbba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:44.198781 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8365f06-a19f-42b1-a684-56caff34bbba admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:44.350896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 845/1696] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:31:43 2022] POST /identity/v3/users => generated 283 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:44.357036 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc3cc1-a0b6-4764-a355-f3d210157c43 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:44.383615 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc3cc1-a0b6-4764-a355-f3d210157c43 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:44.405202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93becdd1-f06c-48fb-b401-34383bf57e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:44.408370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8365f06-a19f-42b1-a684-56caff34bbba admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:44.411598 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f8365f06-a19f-42b1-a684-56caff34bbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:44.414721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93becdd1-f06c-48fb-b401-34383bf57e56 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:44.415935 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93becdd1-f06c-48fb-b401-34383bf57e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:44.416835 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93becdd1-f06c-48fb-b401-34383bf57e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:44.418736 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93becdd1-f06c-48fb-b401-34383bf57e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:44.433424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93becdd1-f06c-48fb-b401-34383bf57e56 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:44.449590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8365f06-a19f-42b1-a684-56caff34bbba admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:44.475606 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc2c42-db28-4788-b1df-b83d462366f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:44.480617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc2c42-db28-4788-b1df-b83d462366f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:44.481289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc2c42-db28-4788-b1df-b83d462366f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:44.482893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc2c42-db28-4788-b1df-b83d462366f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:44.489728 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 852/1697] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:44.492216 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93becdd1-f06c-48fb-b401-34383bf57e56 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:44.543206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc2c42-db28-4788-b1df-b83d462366f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:44.543206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc2c42-db28-4788-b1df-b83d462366f3 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:44.566741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93becdd1-f06c-48fb-b401-34383bf57e56 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:44.583548 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2f6d8-3bea-4634-b829-5bbfd42c1438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:44.585290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 846/1698] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:44.589285 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2f6d8-3bea-4634-b829-5bbfd42c1438 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:44.590460 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2f6d8-3bea-4634-b829-5bbfd42c1438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:44.592082 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2f6d8-3bea-4634-b829-5bbfd42c1438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:44.595651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2f6d8-3bea-4634-b829-5bbfd42c1438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:44.609510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2f6d8-3bea-4634-b829-5bbfd42c1438 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:44.653696 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 853/1699] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:44.657887 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc2c42-db28-4788-b1df-b83d462366f3 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:44.674010 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc2c42-db28-4788-b1df-b83d462366f3 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:44.679547 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ada79-02ed-4893-980e-80a7a44a5ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:44.680762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ada79-02ed-4893-980e-80a7a44a5ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:44.681236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ada79-02ed-4893-980e-80a7a44a5ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:44.681837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ada79-02ed-4893-980e-80a7a44a5ca5 admin admin] PATH_INFO: `/v3/projects/6cb3751fe87047b69a127ce3ff2c16f1/users/5aa64d53c3f1447eaddd7de46b34dea0/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:44.720352 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ada79-02ed-4893-980e-80a7a44a5ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb3751fe87047b69a127ce3ff2c16f1, user_id=5aa64d53c3f1447eaddd7de46b34dea0, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:44.720352 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ada79-02ed-4893-980e-80a7a44a5ca5 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:44.993291 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 847/1700] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:44 2022] PUT /identity/v3/projects/6cb3751fe87047b69a127ce3ff2c16f1/users/5aa64d53c3f1447eaddd7de46b34dea0/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:45.007948 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff8f40-157f-467f-9cdc-34bd51fd20f5 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:45.008671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff8f40-157f-467f-9cdc-34bd51fd20f5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:45.009105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff8f40-157f-467f-9cdc-34bd51fd20f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:45.123129 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fc09a-26e9-4b70-b073-672fc5ac8cc7 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:45.125014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fc09a-26e9-4b70-b073-672fc5ac8cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:45.125748 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fc09a-26e9-4b70-b073-672fc5ac8cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:45.147959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a5ff8f40-157f-467f-9cdc-34bd51fd20f5 None None] MFA Rules not processed for user `5aa64d53c3f1447eaddd7de46b34dea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:45.150212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a5ff8f40-157f-467f-9cdc-34bd51fd20f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:45.192827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-4f8fc09a-26e9-4b70-b073-672fc5ac8cc7 None None] MFA Rules not processed for user `22fddcc9952a459899e48a93d1d962db`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:45.197369 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4f8fc09a-26e9-4b70-b073-672fc5ac8cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:45.313311 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:45.366247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:45.380418 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 854/1701] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:45.407706 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff8f40-157f-467f-9cdc-34bd51fd20f5 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:45.434791 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 848/1702] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:31:45.460049 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fc09a-26e9-4b70-b073-672fc5ac8cc7 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:45.470467 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4f8fc09a-26e9-4b70-b073-672fc5ac8cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:45.576639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff8f40-157f-467f-9cdc-34bd51fd20f5 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:45.595314 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02179d01-eb82-4355-ba7f-ed59e3f9adfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:45.598614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02179d01-eb82-4355-ba7f-ed59e3f9adfa admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:45.599097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02179d01-eb82-4355-ba7f-ed59e3f9adfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:45.599582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02179d01-eb82-4355-ba7f-ed59e3f9adfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:45.601285 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02179d01-eb82-4355-ba7f-ed59e3f9adfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:45.606177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02179d01-eb82-4355-ba7f-ed59e3f9adfa admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:45.665069 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fc09a-26e9-4b70-b073-672fc5ac8cc7 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:45.691545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f68fb-40ac-4427-8828-cdfc12061206 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:45.691545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f68fb-40ac-4427-8828-cdfc12061206 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:45.691545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f68fb-40ac-4427-8828-cdfc12061206 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:45.691545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f68fb-40ac-4427-8828-cdfc12061206 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:45.718792 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f68fb-40ac-4427-8828-cdfc12061206 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:45.720722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f68fb-40ac-4427-8828-cdfc12061206 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:45.749962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 849/1703] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:45.768057 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 855/1704] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:31:45 2022] POST /identity/v3/projects => generated 367 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:45.772226 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f68fb-40ac-4427-8828-cdfc12061206 service nova] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:45.791504 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f68fb-40ac-4427-8828-cdfc12061206 service nova] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:45.902187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccb773-fb5a-4032-b30f-86f76fdb4a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:45.911816 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccb773-fb5a-4032-b30f-86f76fdb4a4d admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:45.911816 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccb773-fb5a-4032-b30f-86f76fdb4a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:45.911816 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccb773-fb5a-4032-b30f-86f76fdb4a4d admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:45.911816 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccb773-fb5a-4032-b30f-86f76fdb4a4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:45.913384 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccb773-fb5a-4032-b30f-86f76fdb4a4d admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:45.996006 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02179d01-eb82-4355-ba7f-ed59e3f9adfa admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:45.999307 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-02179d01-eb82-4355-ba7f-ed59e3f9adfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:46.034581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02179d01-eb82-4355-ba7f-ed59e3f9adfa admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:46.044516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 850/1705] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:31:45 2022] POST /identity/v3/users => generated 290 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:46.044516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccb773-fb5a-4032-b30f-86f76fdb4a4d admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:46.049279 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08af62-236b-48db-b83f-793465927b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:46.050231 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08af62-236b-48db-b83f-793465927b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:46.050710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08af62-236b-48db-b83f-793465927b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:46.051195 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08af62-236b-48db-b83f-793465927b8a admin admin] PATH_INFO: `/v3/projects/b6f05ed1950d4b188199aa00477d0838` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:46.054468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08af62-236b-48db-b83f-793465927b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f05ed1950d4b188199aa00477d0838)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:46.059503 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08af62-236b-48db-b83f-793465927b8a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:46.098274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccb773-fb5a-4032-b30f-86f76fdb4a4d admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:46.114767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7181c0-d364-4722-bf23-9267d47e2678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:46.115429 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7181c0-d364-4722-bf23-9267d47e2678 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:46.115714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7181c0-d364-4722-bf23-9267d47e2678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:46.116018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7181c0-d364-4722-bf23-9267d47e2678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:46.116695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7181c0-d364-4722-bf23-9267d47e2678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:46.127321 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7181c0-d364-4722-bf23-9267d47e2678 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:46.143728 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 851/1706] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:31:46.148488 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7181c0-d364-4722-bf23-9267d47e2678 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:46.172874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7181c0-d364-4722-bf23-9267d47e2678 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:46.187526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7151c3-840e-4518-ba4b-84ddeb7718aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:46.188531 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7151c3-840e-4518-ba4b-84ddeb7718aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:46.188913 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7151c3-840e-4518-ba4b-84ddeb7718aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:46.190685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7151c3-840e-4518-ba4b-84ddeb7718aa admin admin] PATH_INFO: `/v3/projects/c8b1a364d48142d99ad10cec03b2c9d9/users/54ee93549882428493abd4c89042dbd8/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:46.253769 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7b08af62-236b-48db-b83f-793465927b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f05ed1950d4b188199aa00477d0838', 'request_id': 'req-7b08af62-236b-48db-b83f-793465927b8a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:46.272901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7151c3-840e-4518-ba4b-84ddeb7718aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b1a364d48142d99ad10cec03b2c9d9, user_id=54ee93549882428493abd4c89042dbd8, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:46.279990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7151c3-840e-4518-ba4b-84ddeb7718aa admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:46.391714 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7b08af62-236b-48db-b83f-793465927b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f05ed1950d4b188199aa00477d0838', 'request_id': 'req-7b08af62-236b-48db-b83f-793465927b8a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:46.405683 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 852/1707] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:46 2022] PUT /identity/v3/projects/c8b1a364d48142d99ad10cec03b2c9d9/users/54ee93549882428493abd4c89042dbd8/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:46.407590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41561b-3e9e-4e6a-a634-7a0f00efdb8a None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:46.408507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7b08af62-236b-48db-b83f-793465927b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f05ed1950d4b188199aa00477d0838', 'request_id': 'req-7b08af62-236b-48db-b83f-793465927b8a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:46.414645 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41561b-3e9e-4e6a-a634-7a0f00efdb8a None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:46.415364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41561b-3e9e-4e6a-a634-7a0f00efdb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:46.447155 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7b08af62-236b-48db-b83f-793465927b8a admin admin] The token cache is being invalidate because project b6f05ed1950d4b188199aa00477d0838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:31:46.451733 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7b08af62-236b-48db-b83f-793465927b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:46.456465 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7b08af62-236b-48db-b83f-793465927b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:46.465747 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 856/1708] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:31:45 2022] DELETE /identity/v3/projects/b6f05ed1950d4b188199aa00477d0838 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:46.468028 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08af62-236b-48db-b83f-793465927b8a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:46.483304 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7b08af62-236b-48db-b83f-793465927b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:46.495128 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-2b41561b-3e9e-4e6a-a634-7a0f00efdb8a None None] MFA Rules not processed for user `b3c43b517c8a464c93f0ce620826ad35`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:46.500634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2b41561b-3e9e-4e6a-a634-7a0f00efdb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:46.764268 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:46.791265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 853/1709] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:46.792297 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08af62-236b-48db-b83f-793465927b8a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:46.797601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2edc3-fac6-4852-be75-767b01598f54 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:46.797997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2edc3-fac6-4852-be75-767b01598f54 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:46.800093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2edc3-fac6-4852-be75-767b01598f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:46.878191 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:46.893349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-ceb2edc3-fac6-4852-be75-767b01598f54 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:46.905733 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ceb2edc3-fac6-4852-be75-767b01598f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:47.073654 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 854/1710] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:47.078551 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb3ee1-e633-4c72-aefe-a18184c7961e None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:47.078893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb3ee1-e633-4c72-aefe-a18184c7961e None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:47.079198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb3ee1-e633-4c72-aefe-a18184c7961e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:47.095516 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c6adc-e91d-4218-9f42-11018301358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:47.099976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c6adc-e91d-4218-9f42-11018301358b admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:47.099976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c6adc-e91d-4218-9f42-11018301358b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:47.099976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c6adc-e91d-4218-9f42-11018301358b admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:47.099976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c6adc-e91d-4218-9f42-11018301358b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:47.102036 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c6adc-e91d-4218-9f42-11018301358b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:47.129173 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 857/1711] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 666 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:47.131565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e815df1-40c4-4b7f-ad95-0902014042c6 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:47.132077 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e815df1-40c4-4b7f-ad95-0902014042c6 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:47.132507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e815df1-40c4-4b7f-ad95-0902014042c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:47.195536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-81eb3ee1-e633-4c72-aefe-a18184c7961e None None] MFA Rules not processed for user `0002ebbc629b4dafb109dc94450fe1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:47.198956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-81eb3ee1-e633-4c72-aefe-a18184c7961e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:47.280683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4e815df1-40c4-4b7f-ad95-0902014042c6 None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:47.294677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4e815df1-40c4-4b7f-ad95-0902014042c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:47.352378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 855/1712] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:47.360884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4c15-2d3e-43b9-a9fd-c32a4272f225 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:47.361293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4c15-2d3e-43b9-a9fd-c32a4272f225 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:47.361689 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4c15-2d3e-43b9-a9fd-c32a4272f225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:47.409137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-d9dc4c15-2d3e-43b9-a9fd-c32a4272f225 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:47.410568 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d9dc4c15-2d3e-43b9-a9fd-c32a4272f225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:47.420078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 856/1713] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:47.421362 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc4c15-2d3e-43b9-a9fd-c32a4272f225 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:47.435825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc4c15-2d3e-43b9-a9fd-c32a4272f225 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:47.441461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30108aa-15d3-4828-a51d-464779e120cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:47.442436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30108aa-15d3-4828-a51d-464779e120cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:47.442945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30108aa-15d3-4828-a51d-464779e120cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:47.443431 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30108aa-15d3-4828-a51d-464779e120cb admin admin] PATH_INFO: `/v3/projects/c8b1a364d48142d99ad10cec03b2c9d9/users/54ee93549882428493abd4c89042dbd8/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:47.445608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 858/1714] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jul 28 05:31:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:47.446312 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30108aa-15d3-4828-a51d-464779e120cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b1a364d48142d99ad10cec03b2c9d9, user_id=54ee93549882428493abd4c89042dbd8, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:47.448923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e815df1-40c4-4b7f-ad95-0902014042c6 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:47.449618 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30108aa-15d3-4828-a51d-464779e120cb admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:47.476036 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e815df1-40c4-4b7f-ad95-0902014042c6 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:47.487931 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 857/1715] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:47 2022] PUT /identity/v3/projects/c8b1a364d48142d99ad10cec03b2c9d9/users/54ee93549882428493abd4c89042dbd8/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:47.489955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e907d62-94a6-4779-a9b8-779bf7d06b9d None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:47.490369 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e907d62-94a6-4779-a9b8-779bf7d06b9d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:47.491222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e907d62-94a6-4779-a9b8-779bf7d06b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:47.567640 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-9e907d62-94a6-4779-a9b8-779bf7d06b9d None None] MFA Rules not processed for user `54ee93549882428493abd4c89042dbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:47.569433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9e907d62-94a6-4779-a9b8-779bf7d06b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:47.641293 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ffa6e-1049-426a-9559-a4775b0a3075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:47.642028 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ffa6e-1049-426a-9559-a4775b0a3075 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:47.642319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ffa6e-1049-426a-9559-a4775b0a3075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:47.642596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ffa6e-1049-426a-9559-a4775b0a3075 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:47.645549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ffa6e-1049-426a-9559-a4775b0a3075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:31:47.645881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ffa6e-1049-426a-9559-a4775b0a3075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:47.650641 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ffa6e-1049-426a-9559-a4775b0a3075 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:47.686616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 859/1716] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:31:47.688211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ffa6e-1049-426a-9559-a4775b0a3075 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:47.698121 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-382ffa6e-1049-426a-9559-a4775b0a3075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:47.778203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 858/1717] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:47.783579 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e907d62-94a6-4779-a9b8-779bf7d06b9d None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:47.853552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e907d62-94a6-4779-a9b8-779bf7d06b9d None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:47.868408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ffa6e-1049-426a-9559-a4775b0a3075 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:47.879027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dc74b-20ef-4ab6-919d-55b8552de3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:47.883170 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dc74b-20ef-4ab6-919d-55b8552de3ac admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:47.884433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dc74b-20ef-4ab6-919d-55b8552de3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:47.884433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dc74b-20ef-4ab6-919d-55b8552de3ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:47.887030 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dc74b-20ef-4ab6-919d-55b8552de3ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:47.888354 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacdf79-ace5-44da-bfb2-33e0d2bb4899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:47.889100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacdf79-ace5-44da-bfb2-33e0d2bb4899 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:47.891376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacdf79-ace5-44da-bfb2-33e0d2bb4899 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:47.891376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacdf79-ace5-44da-bfb2-33e0d2bb4899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:47.891672 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dc74b-20ef-4ab6-919d-55b8552de3ac admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:48.012124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:48.047528 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 859/1718] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:31:47 2022] POST /identity/v3/projects => generated 387 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:48.051222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dc74b-20ef-4ab6-919d-55b8552de3ac admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:48.053921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-703dc74b-20ef-4ab6-919d-55b8552de3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:48.144171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacdf79-ace5-44da-bfb2-33e0d2bb4899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:48.149113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacdf79-ace5-44da-bfb2-33e0d2bb4899 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:48.183646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 860/1719] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:48.206662 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacdf79-ace5-44da-bfb2-33e0d2bb4899 service nova] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:48.214978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:48.218621 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fbacdf79-ace5-44da-bfb2-33e0d2bb4899 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:48.354462 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dc74b-20ef-4ab6-919d-55b8552de3ac admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:48.379807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a6b42-57b4-4488-a3df-1bb0cc6cea8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:48.380470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a6b42-57b4-4488-a3df-1bb0cc6cea8b service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:48.380768 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a6b42-57b4-4488-a3df-1bb0cc6cea8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:48.381029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a6b42-57b4-4488-a3df-1bb0cc6cea8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:48.585124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacdf79-ace5-44da-bfb2-33e0d2bb4899 service nova] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:48.683911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a6b42-57b4-4488-a3df-1bb0cc6cea8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:48.689732 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a6b42-57b4-4488-a3df-1bb0cc6cea8b service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:48.718150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 860/1720] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:48.719043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a6b42-57b4-4488-a3df-1bb0cc6cea8b service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:48.816200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:48.866867 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56dccec-8eae-41de-b112-8039987b9466 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:48.867533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56dccec-8eae-41de-b112-8039987b9466 service swift] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:48.867820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56dccec-8eae-41de-b112-8039987b9466 service swift] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:48.868101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56dccec-8eae-41de-b112-8039987b9466 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:48.891870 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:48.979223 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a6b42-57b4-4488-a3df-1bb0cc6cea8b service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:48.994227 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca466d84-784c-4acf-801e-e7ac385b90d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:48.995003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca466d84-784c-4acf-801e-e7ac385b90d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:48.996442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca466d84-784c-4acf-801e-e7ac385b90d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:48.996442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca466d84-784c-4acf-801e-e7ac385b90d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:48.997675 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca466d84-784c-4acf-801e-e7ac385b90d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:48.999834 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca466d84-784c-4acf-801e-e7ac385b90d3 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:49.124862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 861/1721] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:31:48 2022] POST /identity/v3/users => generated 294 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:49.124862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca466d84-784c-4acf-801e-e7ac385b90d3 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:49.149604 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca466d84-784c-4acf-801e-e7ac385b90d3 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:49.154938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf834b-bec1-492d-a4d2-39f5029bd007 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:49.156124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf834b-bec1-492d-a4d2-39f5029bd007 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:49.156554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf834b-bec1-492d-a4d2-39f5029bd007 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:49.158963 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf834b-bec1-492d-a4d2-39f5029bd007 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:49.164430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-27cf834b-bec1-492d-a4d2-39f5029bd007 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:49.224672 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56dccec-8eae-41de-b112-8039987b9466 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:49.229239 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56dccec-8eae-41de-b112-8039987b9466 service swift] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:49.257903 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 861/1722] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:31:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1052 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:31:49.268120 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56dccec-8eae-41de-b112-8039987b9466 service swift] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:49.298762 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56dccec-8eae-41de-b112-8039987b9466 service swift] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:49.313784 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bb3d6-8703-4806-9e11-da16fc8d7f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:49.314577 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bb3d6-8703-4806-9e11-da16fc8d7f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:49.320032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bb3d6-8703-4806-9e11-da16fc8d7f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:49.328214 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bb3d6-8703-4806-9e11-da16fc8d7f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:49.328214 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bb3d6-8703-4806-9e11-da16fc8d7f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:49.328214 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bb3d6-8703-4806-9e11-da16fc8d7f93 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:49.355679 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 862/1723] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:49.360455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bb3d6-8703-4806-9e11-da16fc8d7f93 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:49.405272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf834b-bec1-492d-a4d2-39f5029bd007 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:49.409452 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf834b-bec1-492d-a4d2-39f5029bd007 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:49.421758 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bb3d6-8703-4806-9e11-da16fc8d7f93 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:49.458917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf2e48-5e89-4d26-8eee-1c12a93d64de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:49.463283 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf2e48-5e89-4d26-8eee-1c12a93d64de admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:49.470438 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf2e48-5e89-4d26-8eee-1c12a93d64de admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:49.471799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf2e48-5e89-4d26-8eee-1c12a93d64de admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:49.474140 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf2e48-5e89-4d26-8eee-1c12a93d64de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:49.478702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf2e48-5e89-4d26-8eee-1c12a93d64de admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:49.483375 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 862/1724] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:49.586363 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 863/1725] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:49.587672 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf834b-bec1-492d-a4d2-39f5029bd007 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:49.613037 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf834b-bec1-492d-a4d2-39f5029bd007 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:49.639496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5148e7-fc58-492d-b469-db9deb84dc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:49.640604 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5148e7-fc58-492d-b469-db9deb84dc6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:49.643099 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5148e7-fc58-492d-b469-db9deb84dc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:49.644333 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5148e7-fc58-492d-b469-db9deb84dc6e admin admin] PATH_INFO: `/v3/projects/bba1406fff654502826106b0e95ab022/users/5d389477c0f549a7a8783b0cdc62bb3c/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:49.724897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5148e7-fc58-492d-b469-db9deb84dc6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba1406fff654502826106b0e95ab022, user_id=5d389477c0f549a7a8783b0cdc62bb3c, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:49.727779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5148e7-fc58-492d-b469-db9deb84dc6e admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:49.870144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 863/1726] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:49 2022] PUT /identity/v3/projects/bba1406fff654502826106b0e95ab022/users/5d389477c0f549a7a8783b0cdc62bb3c/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:49.882553 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0a6e4-d946-4cb2-abaf-b93c3cfa415b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:49.882849 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0a6e4-d946-4cb2-abaf-b93c3cfa415b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:49.883133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0a6e4-d946-4cb2-abaf-b93c3cfa415b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:50.004244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-dec0a6e4-d946-4cb2-abaf-b93c3cfa415b None None] MFA Rules not processed for user `5d389477c0f549a7a8783b0cdc62bb3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:50.011038 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-dec0a6e4-d946-4cb2-abaf-b93c3cfa415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:50.281987 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 864/1727] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:50.286171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5148e7-fc58-492d-b469-db9deb84dc6e admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:50.748943 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5148e7-fc58-492d-b469-db9deb84dc6e admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:50.799894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5c452-e93b-4c78-bdbf-b6d29f870629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:50.800602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5c452-e93b-4c78-bdbf-b6d29f870629 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:50.806354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5c452-e93b-4c78-bdbf-b6d29f870629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:50.807007 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5c452-e93b-4c78-bdbf-b6d29f870629 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:50.807773 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5c452-e93b-4c78-bdbf-b6d29f870629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:50.822412 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5c452-e93b-4c78-bdbf-b6d29f870629 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:50.865459 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:51.025540 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0b0b4-db60-49e2-957d-494fb2d67b1a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:51.025833 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0b0b4-db60-49e2-957d-494fb2d67b1a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:51.026113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0b0b4-db60-49e2-957d-494fb2d67b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:51.120972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e7f0b0b4-db60-49e2-957d-494fb2d67b1a None None] MFA Rules not processed for user `6907d8a429404b1c92805b364900ba60`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:51.120972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e7f0b0b4-db60-49e2-957d-494fb2d67b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:51.196173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 864/1728] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:31:50 2022] POST /identity/v3/projects => generated 389 bytes in 879 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:31:51.196173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5c452-e93b-4c78-bdbf-b6d29f870629 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:51.249016 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:51.359892 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 865/1729] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Jul 28 05:31:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:31:51.365170 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5c452-e93b-4c78-bdbf-b6d29f870629 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:51.377151 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4afbcc-b780-4f5e-aa3c-e347e368942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:51.378130 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4afbcc-b780-4f5e-aa3c-e347e368942a admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:51.380114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4afbcc-b780-4f5e-aa3c-e347e368942a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:51.381081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4afbcc-b780-4f5e-aa3c-e347e368942a admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:51.382371 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4afbcc-b780-4f5e-aa3c-e347e368942a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:51.390519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4afbcc-b780-4f5e-aa3c-e347e368942a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:51.405563 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0b0b4-db60-49e2-957d-494fb2d67b1a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:51.407011 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e7f0b0b4-db60-49e2-957d-494fb2d67b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:51.426074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0b0b4-db60-49e2-957d-494fb2d67b1a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:51.550274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 865/1730] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:31:51 2022] POST /identity/v3/users => generated 301 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:31:51.554770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4afbcc-b780-4f5e-aa3c-e347e368942a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:51.592509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4afbcc-b780-4f5e-aa3c-e347e368942a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:51.613639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbfd83-c4c1-43d6-8978-c8082bc4e3d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:51.614725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbfd83-c4c1-43d6-8978-c8082bc4e3d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:51.615443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbfd83-c4c1-43d6-8978-c8082bc4e3d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:51.615916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbfd83-c4c1-43d6-8978-c8082bc4e3d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:51.617084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f6974-dd61-4141-9b0b-3264742d5fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:51.617960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f6974-dd61-4141-9b0b-3264742d5fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:51.622717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f6974-dd61-4141-9b0b-3264742d5fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:51.622717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f6974-dd61-4141-9b0b-3264742d5fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:51.622717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f6974-dd61-4141-9b0b-3264742d5fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:51.622717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f6974-dd61-4141-9b0b-3264742d5fe5 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:51.646869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbfd83-c4c1-43d6-8978-c8082bc4e3d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:51.648827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbfd83-c4c1-43d6-8978-c8082bc4e3d7 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:51.686370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 866/1731] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:51.688597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 866/1732] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:51.690496 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbfd83-c4c1-43d6-8978-c8082bc4e3d7 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:51.720662 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbfd83-c4c1-43d6-8978-c8082bc4e3d7 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:51.734672 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9aa6f3-074e-4e83-8c41-eea882c26643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:51.735651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9aa6f3-074e-4e83-8c41-eea882c26643 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:51.738216 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9aa6f3-074e-4e83-8c41-eea882c26643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:51.738737 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9aa6f3-074e-4e83-8c41-eea882c26643 admin admin] PATH_INFO: `/v3/projects/0cf2b2db70724fd7a9e52dcd943f85c2/users/5a8f5150412344f993466d8577c4bac3/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:51.768013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9aa6f3-074e-4e83-8c41-eea882c26643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf2b2db70724fd7a9e52dcd943f85c2, user_id=5a8f5150412344f993466d8577c4bac3, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:51.768013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9aa6f3-074e-4e83-8c41-eea882c26643 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:51.883379 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 867/1733] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:51 2022] PUT /identity/v3/projects/0cf2b2db70724fd7a9e52dcd943f85c2/users/5a8f5150412344f993466d8577c4bac3/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:31:51.891557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f6974-dd61-4141-9b0b-3264742d5fe5 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:51.914859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f6974-dd61-4141-9b0b-3264742d5fe5 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:52.191168 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc174bb-f555-48bc-a927-d8726f880fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:52.192951 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc174bb-f555-48bc-a927-d8726f880fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:52.197967 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc174bb-f555-48bc-a927-d8726f880fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:52.198590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc174bb-f555-48bc-a927-d8726f880fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:52.202959 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc174bb-f555-48bc-a927-d8726f880fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:52.204876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc174bb-f555-48bc-a927-d8726f880fa6 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:52.228664 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 867/1734] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:31:52.231709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9aa6f3-074e-4e83-8c41-eea882c26643 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:52.247580 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9aa6f3-074e-4e83-8c41-eea882c26643 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:52.266721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f06354-d39b-40b4-be52-81e56e81aac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:52.266721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f06354-d39b-40b4-be52-81e56e81aac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:52.266721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f06354-d39b-40b4-be52-81e56e81aac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:52.266721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f06354-d39b-40b4-be52-81e56e81aac5 admin admin] PATH_INFO: `/v3/projects/0cf2b2db70724fd7a9e52dcd943f85c2/users/5a8f5150412344f993466d8577c4bac3/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:52.272296 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f06354-d39b-40b4-be52-81e56e81aac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf2b2db70724fd7a9e52dcd943f85c2, user_id=5a8f5150412344f993466d8577c4bac3, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:52.275434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f06354-d39b-40b4-be52-81e56e81aac5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:52.308895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 868/1735] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:31:52 2022] PUT /identity/v3/projects/0cf2b2db70724fd7a9e52dcd943f85c2/users/5a8f5150412344f993466d8577c4bac3/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:52.321276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5dc1a-a5d9-4a9d-90d5-b56b66889acb None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:52.321738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5dc1a-a5d9-4a9d-90d5-b56b66889acb None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:52.322093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5dc1a-a5d9-4a9d-90d5-b56b66889acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:52.406479 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-65f5dc1a-a5d9-4a9d-90d5-b56b66889acb None None] MFA Rules not processed for user `5a8f5150412344f993466d8577c4bac3`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:52.408071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-65f5dc1a-a5d9-4a9d-90d5-b56b66889acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:52.595594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:52.647480 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 868/1736] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:52.660217 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f06354-d39b-40b4-be52-81e56e81aac5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:52.664197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-44f06354-d39b-40b4-be52-81e56e81aac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:52.857402 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f06354-d39b-40b4-be52-81e56e81aac5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:52.893407 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341a510-7b96-4dcc-a793-c57f23bced82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:52.896725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341a510-7b96-4dcc-a793-c57f23bced82 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:52.899925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341a510-7b96-4dcc-a793-c57f23bced82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:52.901122 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341a510-7b96-4dcc-a793-c57f23bced82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:52.969660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341a510-7b96-4dcc-a793-c57f23bced82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:52.969660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341a510-7b96-4dcc-a793-c57f23bced82 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:53.006070 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 869/1737] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:53.502805 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5dc1a-a5d9-4a9d-90d5-b56b66889acb None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:53.668354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5dc1a-a5d9-4a9d-90d5-b56b66889acb None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:53.676371 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27f492-996e-4f6c-b857-7d8ffe22a62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:53.677188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27f492-996e-4f6c-b857-7d8ffe22a62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:53.677736 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27f492-996e-4f6c-b857-7d8ffe22a62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:53.678261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27f492-996e-4f6c-b857-7d8ffe22a62a admin admin] PATH_INFO: `/v3/users/5d389477c0f549a7a8783b0cdc62bb3c` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:53.686612 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27f492-996e-4f6c-b857-7d8ffe22a62a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d389477c0f549a7a8783b0cdc62bb3c)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:53.688946 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27f492-996e-4f6c-b857-7d8ffe22a62a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:53.967866 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1a27f492-996e-4f6c-b857-7d8ffe22a62a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d389477c0f549a7a8783b0cdc62bb3c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:53.969035 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1a27f492-996e-4f6c-b857-7d8ffe22a62a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d389477c0f549a7a8783b0cdc62bb3c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:54.055764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1a27f492-996e-4f6c-b857-7d8ffe22a62a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d389477c0f549a7a8783b0cdc62bb3c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:54.068126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1a27f492-996e-4f6c-b857-7d8ffe22a62a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d389477c0f549a7a8783b0cdc62bb3c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:54.113623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1a27f492-996e-4f6c-b857-7d8ffe22a62a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d389477c0f549a7a8783b0cdc62bb3c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:54.134540 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 869/1738] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:31:53 2022] DELETE /identity/v3/users/5d389477c0f549a7a8783b0cdc62bb3c => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:54.139597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76238597-78d4-4fde-a110-260a4249bf1e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:54.140671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76238597-78d4-4fde-a110-260a4249bf1e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:54.141092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76238597-78d4-4fde-a110-260a4249bf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:54.219407 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-76238597-78d4-4fde-a110-260a4249bf1e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:54.223432 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-76238597-78d4-4fde-a110-260a4249bf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:54.447281 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:54.506463 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 870/1739] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:54.561802 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27f492-996e-4f6c-b857-7d8ffe22a62a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:54.567975 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-1a27f492-996e-4f6c-b857-7d8ffe22a62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:54.742500 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27f492-996e-4f6c-b857-7d8ffe22a62a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:54.748880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7037e1-d79f-4c0a-a3c2-5f6c89c7cfaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:54.748880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7037e1-d79f-4c0a-a3c2-5f6c89c7cfaa service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:54.749075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7037e1-d79f-4c0a-a3c2-5f6c89c7cfaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:54.749461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7037e1-d79f-4c0a-a3c2-5f6c89c7cfaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:54.762934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7037e1-d79f-4c0a-a3c2-5f6c89c7cfaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:54.764761 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7037e1-d79f-4c0a-a3c2-5f6c89c7cfaa service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:54.780657 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 870/1740] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:55.091542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bd769-cf35-4c72-a72c-1e16a610c3fc None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:55.092995 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bd769-cf35-4c72-a72c-1e16a610c3fc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:55.093504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bd769-cf35-4c72-a72c-1e16a610c3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:55.148470 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-915bd769-cf35-4c72-a72c-1e16a610c3fc None None] MFA Rules not processed for user `22fddcc9952a459899e48a93d1d962db`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:55.149737 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-915bd769-cf35-4c72-a72c-1e16a610c3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:55.348050 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 871/1741] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:56.659067 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7037e1-d79f-4c0a-a3c2-5f6c89c7cfaa service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:56.660600 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-cf7037e1-d79f-4c0a-a3c2-5f6c89c7cfaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:56.691315 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7037e1-d79f-4c0a-a3c2-5f6c89c7cfaa service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:56.703329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383042eb-3943-45bb-bb67-e8e16ef7cfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:56.705387 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383042eb-3943-45bb-bb67-e8e16ef7cfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:56.706072 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383042eb-3943-45bb-bb67-e8e16ef7cfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:56.706569 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383042eb-3943-45bb-bb67-e8e16ef7cfc3 admin admin] PATH_INFO: `/v3/users/a25dba6dad2b4c07906e6ef7e8d6fa4c` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:56.708905 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383042eb-3943-45bb-bb67-e8e16ef7cfc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25dba6dad2b4c07906e6ef7e8d6fa4c)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:56.714096 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383042eb-3943-45bb-bb67-e8e16ef7cfc3 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:56.716684 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:56.944519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-383042eb-3943-45bb-bb67-e8e16ef7cfc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25dba6dad2b4c07906e6ef7e8d6fa4c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:56.945317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-383042eb-3943-45bb-bb67-e8e16ef7cfc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25dba6dad2b4c07906e6ef7e8d6fa4c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:57.014621 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-383042eb-3943-45bb-bb67-e8e16ef7cfc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25dba6dad2b4c07906e6ef7e8d6fa4c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:57.031962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-383042eb-3943-45bb-bb67-e8e16ef7cfc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25dba6dad2b4c07906e6ef7e8d6fa4c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:57.067807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-383042eb-3943-45bb-bb67-e8e16ef7cfc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25dba6dad2b4c07906e6ef7e8d6fa4c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:57.069837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 871/1742] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:31:56 2022] DELETE /identity/v3/users/a25dba6dad2b4c07906e6ef7e8d6fa4c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:57.074364 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb98cc7-22d3-48fd-bae0-80196ce3571e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:57.075818 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb98cc7-22d3-48fd-bae0-80196ce3571e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:57.076651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb98cc7-22d3-48fd-bae0-80196ce3571e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:57.140542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-bcb98cc7-22d3-48fd-bae0-80196ce3571e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:57.147056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bcb98cc7-22d3-48fd-bae0-80196ce3571e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:57.339467 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 872/1743] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:57.498468 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383042eb-3943-45bb-bb67-e8e16ef7cfc3 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:57.504543 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-383042eb-3943-45bb-bb67-e8e16ef7cfc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:57.813362 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383042eb-3943-45bb-bb67-e8e16ef7cfc3 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:57.822390 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad4ad7-2e49-4b9f-b691-0eb6b0732fe9 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:57.822674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad4ad7-2e49-4b9f-b691-0eb6b0732fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:57.823219 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad4ad7-2e49-4b9f-b691-0eb6b0732fe9 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:57.828512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 873/1744] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jul 28 05:31:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:57.836636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8161b-6008-4207-9a8a-edd7bb102cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:57.839891 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8161b-6008-4207-9a8a-edd7bb102cec service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:57.839891 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8161b-6008-4207-9a8a-edd7bb102cec service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:57.839891 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8161b-6008-4207-9a8a-edd7bb102cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:57.858959 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8161b-6008-4207-9a8a-edd7bb102cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:57.860524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8161b-6008-4207-9a8a-edd7bb102cec service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:57.881050 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 872/1745] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:58.002816 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad4ad7-2e49-4b9f-b691-0eb6b0732fe9 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:58.002816 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-87ad4ad7-2e49-4b9f-b691-0eb6b0732fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:58.039894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad4ad7-2e49-4b9f-b691-0eb6b0732fe9 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:58.069651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfcdc7-b85c-49e3-9d8f-6971a3392e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:58.070737 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfcdc7-b85c-49e3-9d8f-6971a3392e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:58.071892 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfcdc7-b85c-49e3-9d8f-6971a3392e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:58.072349 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfcdc7-b85c-49e3-9d8f-6971a3392e36 admin admin] PATH_INFO: `/v3/projects/bba1406fff654502826106b0e95ab022` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:58.088676 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfcdc7-b85c-49e3-9d8f-6971a3392e36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba1406fff654502826106b0e95ab022)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:58.094876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfcdc7-b85c-49e3-9d8f-6971a3392e36 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:58.296103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f0dfcdc7-b85c-49e3-9d8f-6971a3392e36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba1406fff654502826106b0e95ab022', 'request_id': 'req-f0dfcdc7-b85c-49e3-9d8f-6971a3392e36'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:58.389789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f0dfcdc7-b85c-49e3-9d8f-6971a3392e36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba1406fff654502826106b0e95ab022', 'request_id': 'req-f0dfcdc7-b85c-49e3-9d8f-6971a3392e36'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:58.406183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f0dfcdc7-b85c-49e3-9d8f-6971a3392e36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba1406fff654502826106b0e95ab022', 'request_id': 'req-f0dfcdc7-b85c-49e3-9d8f-6971a3392e36'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:58.448423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f0dfcdc7-b85c-49e3-9d8f-6971a3392e36 admin admin] The token cache is being invalidate because project bba1406fff654502826106b0e95ab022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:31:58.448766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f0dfcdc7-b85c-49e3-9d8f-6971a3392e36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:58.452397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f0dfcdc7-b85c-49e3-9d8f-6971a3392e36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:58.456028 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 874/1746] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:31:57 2022] DELETE /identity/v3/projects/bba1406fff654502826106b0e95ab022 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:58.460075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8161b-6008-4207-9a8a-edd7bb102cec service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:58.483866 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8161b-6008-4207-9a8a-edd7bb102cec service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:58.645381 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dface8-668c-44ea-b58a-005a04347dea None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:58.646163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dface8-668c-44ea-b58a-005a04347dea None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:58.646871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dface8-668c-44ea-b58a-005a04347dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:58.667587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c453864-ad97-4ae8-9c5e-707646f11c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:58.667587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c453864-ad97-4ae8-9c5e-707646f11c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:58.667587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c453864-ad97-4ae8-9c5e-707646f11c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:58.667587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c453864-ad97-4ae8-9c5e-707646f11c7e admin admin] PATH_INFO: `/v3/users/5a8f5150412344f993466d8577c4bac3` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:58.667966 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c453864-ad97-4ae8-9c5e-707646f11c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a8f5150412344f993466d8577c4bac3)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:58.667966 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c453864-ad97-4ae8-9c5e-707646f11c7e admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:58.717139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-88dface8-668c-44ea-b58a-005a04347dea None None] MFA Rules not processed for user `99d8c709e6f4462c98c055cb03eebf42`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:58.718432 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-88dface8-668c-44ea-b58a-005a04347dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:58.762395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:58.800476 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:58.977697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 875/1747] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jul 28 05:31:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:59.017611 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9c453864-ad97-4ae8-9c5e-707646f11c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a8f5150412344f993466d8577c4bac3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:59.020082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9c453864-ad97-4ae8-9c5e-707646f11c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a8f5150412344f993466d8577c4bac3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:59.143209 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9c453864-ad97-4ae8-9c5e-707646f11c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a8f5150412344f993466d8577c4bac3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:59.164230 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9c453864-ad97-4ae8-9c5e-707646f11c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a8f5150412344f993466d8577c4bac3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:59.253395 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9c453864-ad97-4ae8-9c5e-707646f11c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a8f5150412344f993466d8577c4bac3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:31:59.284675 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 873/1748] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:31:58 2022] DELETE /identity/v3/users/5a8f5150412344f993466d8577c4bac3 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:31:59.495295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dface8-668c-44ea-b58a-005a04347dea None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:59.497341 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-88dface8-668c-44ea-b58a-005a04347dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:59.535497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dface8-668c-44ea-b58a-005a04347dea None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:59.698483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bd9e7-8433-4f31-b657-0ef1e7c04d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:59.701911 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bd9e7-8433-4f31-b657-0ef1e7c04d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:59.702300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bd9e7-8433-4f31-b657-0ef1e7c04d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:59.702720 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bd9e7-8433-4f31-b657-0ef1e7c04d1d admin admin] PATH_INFO: `/v3/users/5aa64d53c3f1447eaddd7de46b34dea0` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:59.706407 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bd9e7-8433-4f31-b657-0ef1e7c04d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aa64d53c3f1447eaddd7de46b34dea0)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:59.711647 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bd9e7-8433-4f31-b657-0ef1e7c04d1d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:59.809901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d340b17-4c6e-41bd-8a7d-0ef8cc0e3f4e None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:59.811031 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d340b17-4c6e-41bd-8a7d-0ef8cc0e3f4e None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:59.811031 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d340b17-4c6e-41bd-8a7d-0ef8cc0e3f4e None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:59.819290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 874/1749] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jul 28 05:31:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:59.937668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02760-cbf0-41a4-8ac9-69034d645c57 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:59.937960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02760-cbf0-41a4-8ac9-69034d645c57 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:59.938244 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02760-cbf0-41a4-8ac9-69034d645c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:00.011303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-4ef02760-cbf0-41a4-8ac9-69034d645c57 None None] MFA Rules not processed for user `99d8c709e6f4462c98c055cb03eebf42`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:00.014818 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-020bd9e7-8433-4f31-b657-0ef1e7c04d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aa64d53c3f1447eaddd7de46b34dea0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:00.017000 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-020bd9e7-8433-4f31-b657-0ef1e7c04d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aa64d53c3f1447eaddd7de46b34dea0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:00.018337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4ef02760-cbf0-41a4-8ac9-69034d645c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:00.103222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-020bd9e7-8433-4f31-b657-0ef1e7c04d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aa64d53c3f1447eaddd7de46b34dea0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:00.136342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-020bd9e7-8433-4f31-b657-0ef1e7c04d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aa64d53c3f1447eaddd7de46b34dea0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:00.141224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-020bd9e7-8433-4f31-b657-0ef1e7c04d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aa64d53c3f1447eaddd7de46b34dea0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:00.178484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 876/1750] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:31:59 2022] DELETE /identity/v3/users/5aa64d53c3f1447eaddd7de46b34dea0 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:00.180694 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67868640-5fbf-4dc4-aa89-40f4f4e79b0a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:00.181988 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67868640-5fbf-4dc4-aa89-40f4f4e79b0a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:00.183239 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67868640-5fbf-4dc4-aa89-40f4f4e79b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:00.218250 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 875/1751] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jul 28 05:31:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:32:00.224515 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-67868640-5fbf-4dc4-aa89-40f4f4e79b0a None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:00.226136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-67868640-5fbf-4dc4-aa89-40f4f4e79b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:00.292173 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:00.400487 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 877/1752] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:00.575593 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02760-cbf0-41a4-8ac9-69034d645c57 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:00.578947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4ef02760-cbf0-41a4-8ac9-69034d645c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:00.664183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67868640-5fbf-4dc4-aa89-40f4f4e79b0a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:00.666957 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-67868640-5fbf-4dc4-aa89-40f4f4e79b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:00.690931 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02760-cbf0-41a4-8ac9-69034d645c57 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:00.826439 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:00.852731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339b11e-7a24-445a-bf22-de5146433906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:00.853392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339b11e-7a24-445a-bf22-de5146433906 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:00.853718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339b11e-7a24-445a-bf22-de5146433906 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:00.853995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339b11e-7a24-445a-bf22-de5146433906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:00.880487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339b11e-7a24-445a-bf22-de5146433906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:00.882231 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339b11e-7a24-445a-bf22-de5146433906 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:00.916426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67868640-5fbf-4dc4-aa89-40f4f4e79b0a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:00.916662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 876/1753] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:00.934986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ad1c3-84a3-47e2-8b7f-6180a1381ec9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:00.934986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ad1c3-84a3-47e2-8b7f-6180a1381ec9 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:00.934986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ad1c3-84a3-47e2-8b7f-6180a1381ec9 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:00.934986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ad1c3-84a3-47e2-8b7f-6180a1381ec9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:00.939260 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a41ad1c3-84a3-47e2-8b7f-6180a1381ec9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:00.968409 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ad1c3-84a3-47e2-8b7f-6180a1381ec9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:00.970111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ad1c3-84a3-47e2-8b7f-6180a1381ec9 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:01.004815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 878/1754] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:01.401771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339b11e-7a24-445a-bf22-de5146433906 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:01.403607 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-a339b11e-7a24-445a-bf22-de5146433906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:01.453631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339b11e-7a24-445a-bf22-de5146433906 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:01.481064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54a150-914d-4339-892a-9e0b7336c147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:01.481796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54a150-914d-4339-892a-9e0b7336c147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:01.482092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54a150-914d-4339-892a-9e0b7336c147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:01.482341 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54a150-914d-4339-892a-9e0b7336c147 admin admin] PATH_INFO: `/v3/projects/9a0165a9056f47e7a337a04041d4064e` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:01.490445 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54a150-914d-4339-892a-9e0b7336c147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0165a9056f47e7a337a04041d4064e)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:01.492476 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54a150-914d-4339-892a-9e0b7336c147 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:01.773396 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-0f54a150-914d-4339-892a-9e0b7336c147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0165a9056f47e7a337a04041d4064e', 'request_id': 'req-0f54a150-914d-4339-892a-9e0b7336c147'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:01.908293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-0f54a150-914d-4339-892a-9e0b7336c147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0165a9056f47e7a337a04041d4064e', 'request_id': 'req-0f54a150-914d-4339-892a-9e0b7336c147'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:01.917378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-0f54a150-914d-4339-892a-9e0b7336c147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0165a9056f47e7a337a04041d4064e', 'request_id': 'req-0f54a150-914d-4339-892a-9e0b7336c147'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:01.953186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-0f54a150-914d-4339-892a-9e0b7336c147 admin admin] The token cache is being invalidate because project 9a0165a9056f47e7a337a04041d4064e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:01.953515 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-0f54a150-914d-4339-892a-9e0b7336c147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:01.958137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-0f54a150-914d-4339-892a-9e0b7336c147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:01.963671 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 877/1755] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:01 2022] DELETE /identity/v3/projects/9a0165a9056f47e7a337a04041d4064e => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:01.969422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96ab15-bc35-49d2-9f22-347fe8ad533d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:01.970144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96ab15-bc35-49d2-9f22-347fe8ad533d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:01.970144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96ab15-bc35-49d2-9f22-347fe8ad533d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:02.014032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ba96ab15-bc35-49d2-9f22-347fe8ad533d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:02.015315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ba96ab15-bc35-49d2-9f22-347fe8ad533d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:02.177895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 879/1756] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:02.186082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3ff07-49c2-4044-809a-f052194103d5 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:02.186312 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3ff07-49c2-4044-809a-f052194103d5 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:02.186591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3ff07-49c2-4044-809a-f052194103d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:02.224503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-19e3ff07-49c2-4044-809a-f052194103d5 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:02.225820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-19e3ff07-49c2-4044-809a-f052194103d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:02.259855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 878/1757] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:02.264802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96ab15-bc35-49d2-9f22-347fe8ad533d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:02.276058 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96ab15-bc35-49d2-9f22-347fe8ad533d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:02.300854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6708a-ed79-43f4-9b13-51201753f621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:02.301747 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6708a-ed79-43f4-9b13-51201753f621 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:02.302194 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6708a-ed79-43f4-9b13-51201753f621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:02.302616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6708a-ed79-43f4-9b13-51201753f621 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:02.303500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6708a-ed79-43f4-9b13-51201753f621 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:32:02.303814 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6708a-ed79-43f4-9b13-51201753f621 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:02.305482 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6708a-ed79-43f4-9b13-51201753f621 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:02.344388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 880/1758] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:32:02.354393 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3ff07-49c2-4044-809a-f052194103d5 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:02.392618 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3ff07-49c2-4044-809a-f052194103d5 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:02.398644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf9682-1ab3-4bea-9a0f-163eb5afd8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:02.399613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf9682-1ab3-4bea-9a0f-163eb5afd8fc admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:02.401856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf9682-1ab3-4bea-9a0f-163eb5afd8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:02.403506 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf9682-1ab3-4bea-9a0f-163eb5afd8fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:02.404428 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf9682-1ab3-4bea-9a0f-163eb5afd8fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:02.406621 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf9682-1ab3-4bea-9a0f-163eb5afd8fc admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:02.506030 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 879/1759] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:02 2022] POST /identity/v3/projects => generated 403 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:02.506952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6708a-ed79-43f4-9b13-51201753f621 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:02.553045 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6708a-ed79-43f4-9b13-51201753f621 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:02.563403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf9682-1ab3-4bea-9a0f-163eb5afd8fc admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:02.565406 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f7cf9682-1ab3-4bea-9a0f-163eb5afd8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:02.687800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:02.719961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d140b-fd4f-4282-8248-d07905b97da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:02.720789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d140b-fd4f-4282-8248-d07905b97da9 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:02.722427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d140b-fd4f-4282-8248-d07905b97da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:02.723247 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d140b-fd4f-4282-8248-d07905b97da9 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:02.724723 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d140b-fd4f-4282-8248-d07905b97da9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:02.732547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d140b-fd4f-4282-8248-d07905b97da9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:02.773971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf9682-1ab3-4bea-9a0f-163eb5afd8fc admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:02.787723 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f869bc-cb37-499f-80eb-e33e0ec9dcf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:02.788274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f869bc-cb37-499f-80eb-e33e0ec9dcf9 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:02.788665 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f869bc-cb37-499f-80eb-e33e0ec9dcf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:02.789193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f869bc-cb37-499f-80eb-e33e0ec9dcf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:02.800882 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-67f869bc-cb37-499f-80eb-e33e0ec9dcf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:02.826811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f869bc-cb37-499f-80eb-e33e0ec9dcf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:02.828599 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f869bc-cb37-499f-80eb-e33e0ec9dcf9 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:02.842608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 881/1760] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:02 2022] POST /identity/v3/users => generated 302 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:32:02.844049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d140b-fd4f-4282-8248-d07905b97da9 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:02.848719 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-497d140b-fd4f-4282-8248-d07905b97da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:02.869283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 880/1761] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:02.872952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f869bc-cb37-499f-80eb-e33e0ec9dcf9 service nova] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:02.898224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d140b-fd4f-4282-8248-d07905b97da9 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:02.904874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f869bc-cb37-499f-80eb-e33e0ec9dcf9 service nova] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:02.914230 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371bb1c-2b98-43b0-8807-0c2b167b7490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:02.914955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371bb1c-2b98-43b0-8807-0c2b167b7490 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:02.915247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371bb1c-2b98-43b0-8807-0c2b167b7490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:02.915527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371bb1c-2b98-43b0-8807-0c2b167b7490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:02.916238 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371bb1c-2b98-43b0-8807-0c2b167b7490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:02.922572 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371bb1c-2b98-43b0-8807-0c2b167b7490 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:02.936980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e618137-2512-448c-bf57-90b3e66aba9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:02.938370 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e618137-2512-448c-bf57-90b3e66aba9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:02.938659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e618137-2512-448c-bf57-90b3e66aba9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:02.941078 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e618137-2512-448c-bf57-90b3e66aba9a admin admin] PATH_INFO: `/v3/projects/0cf2b2db70724fd7a9e52dcd943f85c2` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:02.945737 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e618137-2512-448c-bf57-90b3e66aba9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf2b2db70724fd7a9e52dcd943f85c2)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:02.950866 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 881/1762] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:02.951199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e618137-2512-448c-bf57-90b3e66aba9a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:02.957360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371bb1c-2b98-43b0-8807-0c2b167b7490 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:02.975857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371bb1c-2b98-43b0-8807-0c2b167b7490 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:02.990833 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bf2a4-ac2d-4c95-be06-7cb7fa0ff98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:02.992164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bf2a4-ac2d-4c95-be06-7cb7fa0ff98b admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:02.992595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bf2a4-ac2d-4c95-be06-7cb7fa0ff98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:02.993029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bf2a4-ac2d-4c95-be06-7cb7fa0ff98b admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:02.994412 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2bf2a4-ac2d-4c95-be06-7cb7fa0ff98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:02.999194 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2bf2a4-ac2d-4c95-be06-7cb7fa0ff98b admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:03.028414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 882/1763] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:03.033434 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bf2a4-ac2d-4c95-be06-7cb7fa0ff98b admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:03.055952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bf2a4-ac2d-4c95-be06-7cb7fa0ff98b admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:03.075495 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52c3dd-2be5-4749-89d4-62f3099d20f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:03.079150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c3dd-2be5-4749-89d4-62f3099d20f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:03.079519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c3dd-2be5-4749-89d4-62f3099d20f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:03.079834 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c3dd-2be5-4749-89d4-62f3099d20f4 admin admin] PATH_INFO: `/v3/projects/d4e5ebe2bfbf452b9777dd2dbd2dd71b/users/3192cc9698f642839f3a1383e555c267/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:03.092140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:03.119651 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52c3dd-2be5-4749-89d4-62f3099d20f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4e5ebe2bfbf452b9777dd2dbd2dd71b, user_id=3192cc9698f642839f3a1383e555c267, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:03.127513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52c3dd-2be5-4749-89d4-62f3099d20f4 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:03.223902 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 883/1764] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:03 2022] PUT /identity/v3/projects/d4e5ebe2bfbf452b9777dd2dbd2dd71b/users/3192cc9698f642839f3a1383e555c267/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:32:03.238173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75283760-ac20-493c-8c40-c89b023d877d None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:03.238173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75283760-ac20-493c-8c40-c89b023d877d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:03.238173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75283760-ac20-493c-8c40-c89b023d877d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:03.264300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0e618137-2512-448c-bf57-90b3e66aba9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf2b2db70724fd7a9e52dcd943f85c2', 'request_id': 'req-0e618137-2512-448c-bf57-90b3e66aba9a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:03.294154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-75283760-ac20-493c-8c40-c89b023d877d None None] MFA Rules not processed for user `3192cc9698f642839f3a1383e555c267`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:03.298278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-75283760-ac20-493c-8c40-c89b023d877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:03.336657 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0e618137-2512-448c-bf57-90b3e66aba9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf2b2db70724fd7a9e52dcd943f85c2', 'request_id': 'req-0e618137-2512-448c-bf57-90b3e66aba9a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:03.369182 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0e618137-2512-448c-bf57-90b3e66aba9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf2b2db70724fd7a9e52dcd943f85c2', 'request_id': 'req-0e618137-2512-448c-bf57-90b3e66aba9a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:03.417569 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0e618137-2512-448c-bf57-90b3e66aba9a admin admin] The token cache is being invalidate because project 0cf2b2db70724fd7a9e52dcd943f85c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:03.426199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0e618137-2512-448c-bf57-90b3e66aba9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:03.427181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0e618137-2512-448c-bf57-90b3e66aba9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:03.435068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 882/1765] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:02 2022] DELETE /identity/v3/projects/0cf2b2db70724fd7a9e52dcd943f85c2 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:03.442838 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee47457-a570-42bb-a666-db2e8d20d9cc None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:03.443590 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee47457-a570-42bb-a666-db2e8d20d9cc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:03.444068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee47457-a570-42bb-a666-db2e8d20d9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:03.477749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9ee47457-a570-42bb-a666-db2e8d20d9cc None None] MFA Rules not processed for user `0002ebbc629b4dafb109dc94450fe1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:03.479390 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9ee47457-a570-42bb-a666-db2e8d20d9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:03.504229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 884/1766] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:03.507400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4013cc7-6bb7-4b39-b92a-c593ca159242 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:03.507400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4013cc7-6bb7-4b39-b92a-c593ca159242 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:03.507400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4013cc7-6bb7-4b39-b92a-c593ca159242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:03.627077 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e4013cc7-6bb7-4b39-b92a-c593ca159242 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:03.634310 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e4013cc7-6bb7-4b39-b92a-c593ca159242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:03.651052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 883/1767] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:03.655252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee47457-a570-42bb-a666-db2e8d20d9cc None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:03.659613 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9ee47457-a570-42bb-a666-db2e8d20d9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:03.835065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 885/1768] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:03.846565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3cb0b-1134-4006-b1b1-ee53902b7414 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:03.847204 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3cb0b-1134-4006-b1b1-ee53902b7414 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:03.847695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3cb0b-1134-4006-b1b1-ee53902b7414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:03.852225 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee47457-a570-42bb-a666-db2e8d20d9cc None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:03.874315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadc2f3-c8c1-41d2-add0-6ca90bb70721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:03.874977 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadc2f3-c8c1-41d2-add0-6ca90bb70721 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:03.875264 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadc2f3-c8c1-41d2-add0-6ca90bb70721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:03.875545 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadc2f3-c8c1-41d2-add0-6ca90bb70721 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:03.876240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadc2f3-c8c1-41d2-add0-6ca90bb70721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:03.878721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadc2f3-c8c1-41d2-add0-6ca90bb70721 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:03.894068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:03.900662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e9e3cb0b-1134-4006-b1b1-ee53902b7414 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:03.903309 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e9e3cb0b-1134-4006-b1b1-ee53902b7414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:03.943260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 886/1769] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:03.947279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3cb0b-1134-4006-b1b1-ee53902b7414 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:03.971102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3cb0b-1134-4006-b1b1-ee53902b7414 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:04.008007 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8b81c-c170-448b-b6ea-34e122ced5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:04.008516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8b81c-c170-448b-b6ea-34e122ced5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:04.008829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8b81c-c170-448b-b6ea-34e122ced5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:04.009181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8b81c-c170-448b-b6ea-34e122ced5e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:04.030089 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8b81c-c170-448b-b6ea-34e122ced5e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:32:04.035661 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8b81c-c170-448b-b6ea-34e122ced5e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:04.045943 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8b81c-c170-448b-b6ea-34e122ced5e8 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:04.095214 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 887/1770] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:32:04.099838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8b81c-c170-448b-b6ea-34e122ced5e8 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:04.148695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8b81c-c170-448b-b6ea-34e122ced5e8 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:04.171668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57ea41-8cce-46af-9067-d6c178b04d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:04.172457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57ea41-8cce-46af-9067-d6c178b04d06 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:04.174435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57ea41-8cce-46af-9067-d6c178b04d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:04.174751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57ea41-8cce-46af-9067-d6c178b04d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:04.177217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57ea41-8cce-46af-9067-d6c178b04d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:04.179232 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57ea41-8cce-46af-9067-d6c178b04d06 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:04.567576 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 884/1771] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:03 2022] POST /identity/v3/projects => generated 403 bytes in 913 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:04.569257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadc2f3-c8c1-41d2-add0-6ca90bb70721 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:04.571174 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 888/1772] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:04 2022] POST /identity/v3/projects => generated 385 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:04.576584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57ea41-8cce-46af-9067-d6c178b04d06 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:04.756711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadc2f3-c8c1-41d2-add0-6ca90bb70721 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:04.771623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094fde6-8983-4da6-accf-3c8294b190af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:04.775442 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094fde6-8983-4da6-accf-3c8294b190af admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:04.776501 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094fde6-8983-4da6-accf-3c8294b190af admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:04.777923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094fde6-8983-4da6-accf-3c8294b190af admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:04.783116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094fde6-8983-4da6-accf-3c8294b190af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:04.786434 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57ea41-8cce-46af-9067-d6c178b04d06 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:04.788681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094fde6-8983-4da6-accf-3c8294b190af admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:04.792525 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc6bc9-6349-4c44-9d6c-e797c90ed4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:04.794208 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc6bc9-6349-4c44-9d6c-e797c90ed4cf admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:04.794653 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc6bc9-6349-4c44-9d6c-e797c90ed4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:04.794846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc6bc9-6349-4c44-9d6c-e797c90ed4cf admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:04.796097 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc6bc9-6349-4c44-9d6c-e797c90ed4cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:04.798792 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc6bc9-6349-4c44-9d6c-e797c90ed4cf admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:04.969795 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 885/1773] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:04 2022] POST /identity/v3/users => generated 308 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:04.972412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094fde6-8983-4da6-accf-3c8294b190af admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:04.977025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 889/1774] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:04 2022] POST /identity/v3/users => generated 293 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:04.985397 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc6bc9-6349-4c44-9d6c-e797c90ed4cf admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:04.999157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094fde6-8983-4da6-accf-3c8294b190af admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:05.014069 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f15993-1664-40b6-a01b-e0ca9fa1ffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:05.014599 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc6bc9-6349-4c44-9d6c-e797c90ed4cf admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:05.015096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f15993-1664-40b6-a01b-e0ca9fa1ffa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:05.016441 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f15993-1664-40b6-a01b-e0ca9fa1ffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:05.016839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f15993-1664-40b6-a01b-e0ca9fa1ffa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:05.017528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f15993-1664-40b6-a01b-e0ca9fa1ffa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:05.023626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f15993-1664-40b6-a01b-e0ca9fa1ffa1 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:05.025444 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea1c6b-05f5-4ca0-a228-53dad0efc2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:05.026774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea1c6b-05f5-4ca0-a228-53dad0efc2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:05.027994 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea1c6b-05f5-4ca0-a228-53dad0efc2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:05.028522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea1c6b-05f5-4ca0-a228-53dad0efc2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:05.029451 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea1c6b-05f5-4ca0-a228-53dad0efc2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:05.039101 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea1c6b-05f5-4ca0-a228-53dad0efc2f1 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:05.064485 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 886/1775] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:05.067051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f15993-1664-40b6-a01b-e0ca9fa1ffa1 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:05.080511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 890/1776] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:05.087211 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea1c6b-05f5-4ca0-a228-53dad0efc2f1 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:05.112646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea1c6b-05f5-4ca0-a228-53dad0efc2f1 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:05.116159 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f15993-1664-40b6-a01b-e0ca9fa1ffa1 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:05.119116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cce95-be7b-4667-bd5a-07aa3c30994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:05.124425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cce95-be7b-4667-bd5a-07aa3c30994d admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:05.124425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cce95-be7b-4667-bd5a-07aa3c30994d admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:05.124425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cce95-be7b-4667-bd5a-07aa3c30994d admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:05.124425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cce95-be7b-4667-bd5a-07aa3c30994d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:05.124425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cce95-be7b-4667-bd5a-07aa3c30994d admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:05.124870 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f9dbc-45d4-4532-add7-d29e01c8e9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:05.125553 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f9dbc-45d4-4532-add7-d29e01c8e9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:05.159803 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f9dbc-45d4-4532-add7-d29e01c8e9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:05.160265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f9dbc-45d4-4532-add7-d29e01c8e9ac admin admin] PATH_INFO: `/v3/projects/dce1b1ac1e3b40988a94efa1cd73a4ff/users/445336bb52c94bb69ae98f42cec25591/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:05.162229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 891/1777] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:05.163422 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cce95-be7b-4667-bd5a-07aa3c30994d admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:05.166067 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-da9cce95-be7b-4667-bd5a-07aa3c30994d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:05.173948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:05.217698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cce95-be7b-4667-bd5a-07aa3c30994d admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:05.229557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:05.237908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:05.237908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:05.237908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca admin admin] PATH_INFO: `/v3/projects/6cb3751fe87047b69a127ce3ff2c16f1` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:05.239043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb3751fe87047b69a127ce3ff2c16f1)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:05.243836 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:05.244893 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f9dbc-45d4-4532-add7-d29e01c8e9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce1b1ac1e3b40988a94efa1cd73a4ff, user_id=445336bb52c94bb69ae98f42cec25591, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:05.250859 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f9dbc-45d4-4532-add7-d29e01c8e9ac admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:05.378733 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 887/1778] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:05 2022] PUT /identity/v3/projects/dce1b1ac1e3b40988a94efa1cd73a4ff/users/445336bb52c94bb69ae98f42cec25591/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:32:05.380695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f9dbc-45d4-4532-add7-d29e01c8e9ac admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:05.482124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb3751fe87047b69a127ce3ff2c16f1', 'request_id': 'req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:05.517911 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f9dbc-45d4-4532-add7-d29e01c8e9ac admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:05.565113 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb3751fe87047b69a127ce3ff2c16f1', 'request_id': 'req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:05.572084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb3751fe87047b69a127ce3ff2c16f1', 'request_id': 'req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:05.607087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca admin admin] The token cache is being invalidate because project 6cb3751fe87047b69a127ce3ff2c16f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:05.607506 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:05.609610 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:05.614697 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 892/1779] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:05 2022] DELETE /identity/v3/projects/6cb3751fe87047b69a127ce3ff2c16f1 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:05.614697 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:05.618453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:05.702822 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b490e-b916-469a-8be7-d358bcd2c0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:05.705880 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b490e-b916-469a-8be7-d358bcd2c0c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:05.705880 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b490e-b916-469a-8be7-d358bcd2c0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:05.705880 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b490e-b916-469a-8be7-d358bcd2c0c6 admin admin] PATH_INFO: `/v3/projects/228efd104adf410185b7c88e5b449d2a/users/1f017fb813ba4b459d7575de342e36a0/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:05.741909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b490e-b916-469a-8be7-d358bcd2c0c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=228efd104adf410185b7c88e5b449d2a, user_id=1f017fb813ba4b459d7575de342e36a0, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:05.744548 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b490e-b916-469a-8be7-d358bcd2c0c6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:05.779280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bc8d3-7cff-4204-85cd-3c1ae3b76eca admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:05.793252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea9d32-644f-4e1e-b09c-39f3e257b9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:05.794531 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea9d32-644f-4e1e-b09c-39f3e257b9fc admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:05.795052 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea9d32-644f-4e1e-b09c-39f3e257b9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:05.795541 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea9d32-644f-4e1e-b09c-39f3e257b9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:05.797372 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea9d32-644f-4e1e-b09c-39f3e257b9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:05.800788 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea9d32-644f-4e1e-b09c-39f3e257b9fc admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:05.819968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 893/1780] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:05.821173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea9d32-644f-4e1e-b09c-39f3e257b9fc admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:05.823402 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-95ea9d32-644f-4e1e-b09c-39f3e257b9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:05.839169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea9d32-644f-4e1e-b09c-39f3e257b9fc admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:05.845894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d073231-8a01-4d68-8ac5-dfc11901248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:05.847181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d073231-8a01-4d68-8ac5-dfc11901248c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:05.847181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d073231-8a01-4d68-8ac5-dfc11901248c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:05.847380 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d073231-8a01-4d68-8ac5-dfc11901248c admin admin] PATH_INFO: `/v3/users/54ee93549882428493abd4c89042dbd8` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:05.848773 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d073231-8a01-4d68-8ac5-dfc11901248c admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ee93549882428493abd4c89042dbd8)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:05.851040 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d073231-8a01-4d68-8ac5-dfc11901248c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:05.853006 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:05.862473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 888/1781] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:05 2022] PUT /identity/v3/projects/228efd104adf410185b7c88e5b449d2a/users/1f017fb813ba4b459d7575de342e36a0/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:05.870993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b490e-b916-469a-8be7-d358bcd2c0c6 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:05.997780 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b490e-b916-469a-8be7-d358bcd2c0c6 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:06.003899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33819011-79ca-4074-aef5-4849c13da0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:06.004358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33819011-79ca-4074-aef5-4849c13da0a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:06.005848 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33819011-79ca-4074-aef5-4849c13da0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:06.005848 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33819011-79ca-4074-aef5-4849c13da0a8 admin admin] PATH_INFO: `/v3/projects/dce1b1ac1e3b40988a94efa1cd73a4ff/users/445336bb52c94bb69ae98f42cec25591/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:06.007921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33819011-79ca-4074-aef5-4849c13da0a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce1b1ac1e3b40988a94efa1cd73a4ff, user_id=445336bb52c94bb69ae98f42cec25591, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:06.015659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33819011-79ca-4074-aef5-4849c13da0a8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:06.039467 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 889/1782] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:05 2022] PUT /identity/v3/projects/dce1b1ac1e3b40988a94efa1cd73a4ff/users/445336bb52c94bb69ae98f42cec25591/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:06.039467 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bd30f-c7c1-40a3-8ee3-5ecb190257d1 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:06.039467 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bd30f-c7c1-40a3-8ee3-5ecb190257d1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:06.039467 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bd30f-c7c1-40a3-8ee3-5ecb190257d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:06.068273 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c00bd30f-c7c1-40a3-8ee3-5ecb190257d1 None None] MFA Rules not processed for user `1f017fb813ba4b459d7575de342e36a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:06.071283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:06.072138 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c00bd30f-c7c1-40a3-8ee3-5ecb190257d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:06.097139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4d073231-8a01-4d68-8ac5-dfc11901248c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ee93549882428493abd4c89042dbd8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:06.098237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4d073231-8a01-4d68-8ac5-dfc11901248c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ee93549882428493abd4c89042dbd8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:06.155576 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 890/1783] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:06.156941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6d510-f6b5-4b2e-9634-25c3a4a959b3 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:06.157236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6d510-f6b5-4b2e-9634-25c3a4a959b3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:06.157606 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6d510-f6b5-4b2e-9634-25c3a4a959b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:06.188818 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-89d6d510-f6b5-4b2e-9634-25c3a4a959b3 None None] MFA Rules not processed for user `445336bb52c94bb69ae98f42cec25591`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:06.190152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-89d6d510-f6b5-4b2e-9634-25c3a4a959b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:06.227950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4d073231-8a01-4d68-8ac5-dfc11901248c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ee93549882428493abd4c89042dbd8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:06.238319 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4d073231-8a01-4d68-8ac5-dfc11901248c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ee93549882428493abd4c89042dbd8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:06.255217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4d073231-8a01-4d68-8ac5-dfc11901248c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ee93549882428493abd4c89042dbd8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:06.274478 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 894/1784] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:05 2022] DELETE /identity/v3/users/54ee93549882428493abd4c89042dbd8 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:06.275506 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d073231-8a01-4d68-8ac5-dfc11901248c admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:06.277896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4d073231-8a01-4d68-8ac5-dfc11901248c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:06.287196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 891/1785] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:06 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:06.300804 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6d510-f6b5-4b2e-9634-25c3a4a959b3 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:06.302554 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-89d6d510-f6b5-4b2e-9634-25c3a4a959b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:06.387870 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d073231-8a01-4d68-8ac5-dfc11901248c admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:06.403031 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7faab-3dd0-4622-a322-f1630c37ba8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:06.403692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7faab-3dd0-4622-a322-f1630c37ba8f admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:06.407008 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7faab-3dd0-4622-a322-f1630c37ba8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:06.407008 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7faab-3dd0-4622-a322-f1630c37ba8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:06.407008 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7faab-3dd0-4622-a322-f1630c37ba8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:06.407489 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7faab-3dd0-4622-a322-f1630c37ba8f admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:06.426496 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6d510-f6b5-4b2e-9634-25c3a4a959b3 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:06.489265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883d894-a662-4d73-a5ad-ac884987123f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:06.490146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883d894-a662-4d73-a5ad-ac884987123f service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:06.490530 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883d894-a662-4d73-a5ad-ac884987123f service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:06.490930 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883d894-a662-4d73-a5ad-ac884987123f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:06.507843 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 895/1786] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:06 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:06.509834 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7faab-3dd0-4622-a322-f1630c37ba8f admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:06.570060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:06.573173 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883d894-a662-4d73-a5ad-ac884987123f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:06.574559 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883d894-a662-4d73-a5ad-ac884987123f service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:06.587171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 892/1787] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:06 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:32:06.623813 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7faab-3dd0-4622-a322-f1630c37ba8f admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:06.629161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04863cd8-e919-46bc-b44e-94cc09903589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:06.629864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04863cd8-e919-46bc-b44e-94cc09903589 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:06.630279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04863cd8-e919-46bc-b44e-94cc09903589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:06.633145 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04863cd8-e919-46bc-b44e-94cc09903589 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:06.634089 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04863cd8-e919-46bc-b44e-94cc09903589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:06.636203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04863cd8-e919-46bc-b44e-94cc09903589 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:06.743812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 896/1788] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:06 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:06.747582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883d894-a662-4d73-a5ad-ac884987123f service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:06.759671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883d894-a662-4d73-a5ad-ac884987123f service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:06.764922 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c81ef-8abf-4f5a-9186-5ae45988eb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:06.765753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c81ef-8abf-4f5a-9186-5ae45988eb99 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:06.766028 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c81ef-8abf-4f5a-9186-5ae45988eb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:06.766792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c81ef-8abf-4f5a-9186-5ae45988eb99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:06.767065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c81ef-8abf-4f5a-9186-5ae45988eb99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:06.768724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c81ef-8abf-4f5a-9186-5ae45988eb99 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:06.781511 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 893/1789] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:32:06.792413 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04863cd8-e919-46bc-b44e-94cc09903589 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:06.795289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-04863cd8-e919-46bc-b44e-94cc09903589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:06.797334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c81ef-8abf-4f5a-9186-5ae45988eb99 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:06.825507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04863cd8-e919-46bc-b44e-94cc09903589 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:06.838362 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25c68f-1384-4be6-ae99-a6204914a591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:06.838762 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c81ef-8abf-4f5a-9186-5ae45988eb99 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:06.840877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25c68f-1384-4be6-ae99-a6204914a591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:06.841164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25c68f-1384-4be6-ae99-a6204914a591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:06.841443 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25c68f-1384-4be6-ae99-a6204914a591 admin admin] PATH_INFO: `/v3/users/3192cc9698f642839f3a1383e555c267` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:06.843977 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25c68f-1384-4be6-ae99-a6204914a591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3192cc9698f642839f3a1383e555c267)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:06.849693 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25c68f-1384-4be6-ae99-a6204914a591 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:06.863047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfed5e9-e88b-4825-be61-037af025757b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:06.863842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfed5e9-e88b-4825-be61-037af025757b admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:06.864130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfed5e9-e88b-4825-be61-037af025757b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:06.864414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfed5e9-e88b-4825-be61-037af025757b admin admin] PATH_INFO: `/v3/projects/788aa35f988b4c4e8b4a164b9579a357/users/777231debfca47dc830d69cafc9e5cff/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:06.884573 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfed5e9-e88b-4825-be61-037af025757b admin admin] RBAC: Authorizing `identity:create_grant(project_id=788aa35f988b4c4e8b4a164b9579a357, user_id=777231debfca47dc830d69cafc9e5cff, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:06.888589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfed5e9-e88b-4825-be61-037af025757b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:07.064844 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 894/1790] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:06 2022] PUT /identity/v3/projects/788aa35f988b4c4e8b4a164b9579a357/users/777231debfca47dc830d69cafc9e5cff/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:07.069074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfed5e9-e88b-4825-be61-037af025757b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:07.131931 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ce25c68f-1384-4be6-ae99-a6204914a591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3192cc9698f642839f3a1383e555c267'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:07.134458 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ce25c68f-1384-4be6-ae99-a6204914a591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3192cc9698f642839f3a1383e555c267'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:07.142283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:07.194387 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfed5e9-e88b-4825-be61-037af025757b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:07.209518 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ceb75-4466-4d9c-aaef-1eef878a896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:07.211160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ceb75-4466-4d9c-aaef-1eef878a896b admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:07.212078 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ceb75-4466-4d9c-aaef-1eef878a896b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:07.213227 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ceb75-4466-4d9c-aaef-1eef878a896b admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:07.216245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ceb75-4466-4d9c-aaef-1eef878a896b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:07.219198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ceb75-4466-4d9c-aaef-1eef878a896b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:07.232313 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 895/1791] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:07.235987 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ceb75-4466-4d9c-aaef-1eef878a896b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:07.238355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-118ceb75-4466-4d9c-aaef-1eef878a896b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:07.252761 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ceb75-4466-4d9c-aaef-1eef878a896b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:07.260017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb92af1-d2c7-4077-b5ef-fd74fff8f214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:07.260701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb92af1-d2c7-4077-b5ef-fd74fff8f214 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:07.260980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb92af1-d2c7-4077-b5ef-fd74fff8f214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:07.262004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb92af1-d2c7-4077-b5ef-fd74fff8f214 admin admin] PATH_INFO: `/v3/projects/788aa35f988b4c4e8b4a164b9579a357/users/777231debfca47dc830d69cafc9e5cff/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:07.264261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb92af1-d2c7-4077-b5ef-fd74fff8f214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=788aa35f988b4c4e8b4a164b9579a357, user_id=777231debfca47dc830d69cafc9e5cff, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:07.267325 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb92af1-d2c7-4077-b5ef-fd74fff8f214 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:07.280972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 896/1792] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:07 2022] PUT /identity/v3/projects/788aa35f988b4c4e8b4a164b9579a357/users/777231debfca47dc830d69cafc9e5cff/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:32:07.299184 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ce25c68f-1384-4be6-ae99-a6204914a591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3192cc9698f642839f3a1383e555c267'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:07.299334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef429f-377f-40fc-8ac2-ea4f2fe81edc None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:07.299334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef429f-377f-40fc-8ac2-ea4f2fe81edc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:07.299334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef429f-377f-40fc-8ac2-ea4f2fe81edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:07.299700 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ce25c68f-1384-4be6-ae99-a6204914a591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3192cc9698f642839f3a1383e555c267'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:07.320082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ce25c68f-1384-4be6-ae99-a6204914a591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3192cc9698f642839f3a1383e555c267'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:07.330092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 897/1793] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:06 2022] DELETE /identity/v3/users/3192cc9698f642839f3a1383e555c267 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:07.335302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e3ef429f-377f-40fc-8ac2-ea4f2fe81edc None None] MFA Rules not processed for user `777231debfca47dc830d69cafc9e5cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:07.336679 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e3ef429f-377f-40fc-8ac2-ea4f2fe81edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:07.340783 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25c68f-1384-4be6-ae99-a6204914a591 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:07.343336 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ce25c68f-1384-4be6-ae99-a6204914a591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:07.444823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25c68f-1384-4be6-ae99-a6204914a591 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:07.448094 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 897/1794] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:07.453057 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e5f01-fab4-4531-b36c-28d3842c7257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:07.453057 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e5f01-fab4-4531-b36c-28d3842c7257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:07.453057 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e5f01-fab4-4531-b36c-28d3842c7257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:07.453057 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e5f01-fab4-4531-b36c-28d3842c7257 admin admin] PATH_INFO: `/v3/projects/c8b1a364d48142d99ad10cec03b2c9d9` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:07.453368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d4802-081d-4bc0-9168-f24eb75f2325 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:07.453368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:07.453543 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e5f01-fab4-4531-b36c-28d3842c7257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b1a364d48142d99ad10cec03b2c9d9)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:07.453617 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d4802-081d-4bc0-9168-f24eb75f2325 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:07.453617 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d4802-081d-4bc0-9168-f24eb75f2325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:07.454796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e5f01-fab4-4531-b36c-28d3842c7257 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:07.474210 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-431d4802-081d-4bc0-9168-f24eb75f2325 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:07.475505 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-431d4802-081d-4bc0-9168-f24eb75f2325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:07.484515 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 898/1795] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:07.485153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d4802-081d-4bc0-9168-f24eb75f2325 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:07.486416 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-431d4802-081d-4bc0-9168-f24eb75f2325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:07.547508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d4802-081d-4bc0-9168-f24eb75f2325 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:07.551158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544768c2-8631-4165-9ebb-ff3df131ff6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:07.551779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544768c2-8631-4165-9ebb-ff3df131ff6f service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:07.552063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544768c2-8631-4165-9ebb-ff3df131ff6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:07.552340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544768c2-8631-4165-9ebb-ff3df131ff6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:07.562157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544768c2-8631-4165-9ebb-ff3df131ff6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:07.564955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544768c2-8631-4165-9ebb-ff3df131ff6f service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:07.573312 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 899/1796] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:07.574302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544768c2-8631-4165-9ebb-ff3df131ff6f service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:07.575816 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-544768c2-8631-4165-9ebb-ff3df131ff6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:07.580202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-063e5f01-fab4-4531-b36c-28d3842c7257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b1a364d48142d99ad10cec03b2c9d9', 'request_id': 'req-063e5f01-fab4-4531-b36c-28d3842c7257'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:07.645257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544768c2-8631-4165-9ebb-ff3df131ff6f service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:07.668826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-063e5f01-fab4-4531-b36c-28d3842c7257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b1a364d48142d99ad10cec03b2c9d9', 'request_id': 'req-063e5f01-fab4-4531-b36c-28d3842c7257'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:07.676491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-063e5f01-fab4-4531-b36c-28d3842c7257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b1a364d48142d99ad10cec03b2c9d9', 'request_id': 'req-063e5f01-fab4-4531-b36c-28d3842c7257'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:07.690067 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-063e5f01-fab4-4531-b36c-28d3842c7257 admin admin] The token cache is being invalidate because project c8b1a364d48142d99ad10cec03b2c9d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:07.690503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-063e5f01-fab4-4531-b36c-28d3842c7257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:07.691180 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-063e5f01-fab4-4531-b36c-28d3842c7257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:07.692898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 898/1797] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:07 2022] DELETE /identity/v3/projects/c8b1a364d48142d99ad10cec03b2c9d9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:07.698913 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6dc7e-bdf9-4860-b578-b945abf3a99c None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:07.699198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6dc7e-bdf9-4860-b578-b945abf3a99c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:07.699592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6dc7e-bdf9-4860-b578-b945abf3a99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:07.706668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc0bfd-df20-4104-9c8b-d79f58fdd7df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:07.707747 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc0bfd-df20-4104-9c8b-d79f58fdd7df service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:07.709130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc0bfd-df20-4104-9c8b-d79f58fdd7df service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:07.709623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc0bfd-df20-4104-9c8b-d79f58fdd7df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:07.712160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ebfc0bfd-df20-4104-9c8b-d79f58fdd7df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:07.720845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-29d6dc7e-bdf9-4860-b578-b945abf3a99c None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:07.722078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-29d6dc7e-bdf9-4860-b578-b945abf3a99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:07.783840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc0bfd-df20-4104-9c8b-d79f58fdd7df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:07.785234 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc0bfd-df20-4104-9c8b-d79f58fdd7df service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:07.791254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 899/1798] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:07.799621 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854e2f7-a0a7-4ac3-a089-72090b1341ad None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:07.799904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854e2f7-a0a7-4ac3-a089-72090b1341ad None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:07.800213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854e2f7-a0a7-4ac3-a089-72090b1341ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:07.803442 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 900/1799] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:07.827344 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-0854e2f7-a0a7-4ac3-a089-72090b1341ad None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:07.828313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-0854e2f7-a0a7-4ac3-a089-72090b1341ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:07.849239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 900/1800] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:32:07.849980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc0bfd-df20-4104-9c8b-d79f58fdd7df service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:07.863349 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc0bfd-df20-4104-9c8b-d79f58fdd7df service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:07.870406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c926714-f9a6-408f-8317-d7a0e236566d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:07.871485 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c926714-f9a6-408f-8317-d7a0e236566d admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:07.872128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c926714-f9a6-408f-8317-d7a0e236566d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:07.872591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c926714-f9a6-408f-8317-d7a0e236566d admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:07.873584 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c926714-f9a6-408f-8317-d7a0e236566d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:32:07.874147 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c926714-f9a6-408f-8317-d7a0e236566d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:07.876344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c926714-f9a6-408f-8317-d7a0e236566d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:07.911174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 901/1801] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:32:07.915628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854e2f7-a0a7-4ac3-a089-72090b1341ad None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:07.928322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854e2f7-a0a7-4ac3-a089-72090b1341ad None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:07.933656 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0bb78-86f6-4caa-b923-e2f148e11457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:07.934511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0bb78-86f6-4caa-b923-e2f148e11457 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:07.934858 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0bb78-86f6-4caa-b923-e2f148e11457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:07.935348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0bb78-86f6-4caa-b923-e2f148e11457 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:07.935952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0bb78-86f6-4caa-b923-e2f148e11457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:07.937929 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0bb78-86f6-4caa-b923-e2f148e11457 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:08.049663 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c926714-f9a6-408f-8317-d7a0e236566d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:08.057563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 901/1802] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:07 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:08.064132 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c926714-f9a6-408f-8317-d7a0e236566d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:08.141885 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e449a-4d46-4f03-9261-dcc9bb8e4d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:08.142676 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e449a-4d46-4f03-9261-dcc9bb8e4d3c admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:08.143058 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e449a-4d46-4f03-9261-dcc9bb8e4d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:08.143429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e449a-4d46-4f03-9261-dcc9bb8e4d3c admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:08.144200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e449a-4d46-4f03-9261-dcc9bb8e4d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:08.148289 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e449a-4d46-4f03-9261-dcc9bb8e4d3c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:08.158095 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:08.245242 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:08.255793 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 902/1803] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:08 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:08.257096 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0bb78-86f6-4caa-b923-e2f148e11457 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:08.274849 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0bb78-86f6-4caa-b923-e2f148e11457 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:08.293907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cc449-2b55-47b5-bb29-4dc4054a35ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:08.294659 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cc449-2b55-47b5-bb29-4dc4054a35ae admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:08.295019 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cc449-2b55-47b5-bb29-4dc4054a35ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:08.295371 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cc449-2b55-47b5-bb29-4dc4054a35ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:08.296568 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cc449-2b55-47b5-bb29-4dc4054a35ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:08.298343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cc449-2b55-47b5-bb29-4dc4054a35ae admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:08.315078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 902/1804] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:08.318874 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e449a-4d46-4f03-9261-dcc9bb8e4d3c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:08.335920 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e449a-4d46-4f03-9261-dcc9bb8e4d3c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:08.338750 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08519d-44bb-494a-9a98-608869638d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:08.339376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08519d-44bb-494a-9a98-608869638d75 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:08.340216 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08519d-44bb-494a-9a98-608869638d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:08.340552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08519d-44bb-494a-9a98-608869638d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:08.341284 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08519d-44bb-494a-9a98-608869638d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:08.342918 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08519d-44bb-494a-9a98-608869638d75 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:08.354113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 903/1805] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:08.359056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cc449-2b55-47b5-bb29-4dc4054a35ae admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:08.369700 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cc449-2b55-47b5-bb29-4dc4054a35ae admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:08.376016 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f9b95-ebc6-45d8-b7ae-d198c3d6dfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:08.377334 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f9b95-ebc6-45d8-b7ae-d198c3d6dfac admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:08.377668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f9b95-ebc6-45d8-b7ae-d198c3d6dfac admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:08.377950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f9b95-ebc6-45d8-b7ae-d198c3d6dfac admin admin] PATH_INFO: `/v3/projects/8a73af8e42ce4297848ab4111d14c437/users/47bde6fbf26443b6afd62a671a5a6620/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:08.394626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f9b95-ebc6-45d8-b7ae-d198c3d6dfac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a73af8e42ce4297848ab4111d14c437, user_id=47bde6fbf26443b6afd62a671a5a6620, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:08.397367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f9b95-ebc6-45d8-b7ae-d198c3d6dfac admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:08.443499 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08519d-44bb-494a-9a98-608869638d75 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:08.445596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ae08519d-44bb-494a-9a98-608869638d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:08.467113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08519d-44bb-494a-9a98-608869638d75 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:08.471106 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fed15-eeb7-410b-b481-7b7a2bc5af34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:08.471911 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fed15-eeb7-410b-b481-7b7a2bc5af34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:08.472196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fed15-eeb7-410b-b481-7b7a2bc5af34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:08.472471 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fed15-eeb7-410b-b481-7b7a2bc5af34 admin admin] PATH_INFO: `/v3/projects/d4e5ebe2bfbf452b9777dd2dbd2dd71b` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:08.473657 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fed15-eeb7-410b-b481-7b7a2bc5af34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4e5ebe2bfbf452b9777dd2dbd2dd71b)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:08.475547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fed15-eeb7-410b-b481-7b7a2bc5af34 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:08.492316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 903/1806] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:08 2022] PUT /identity/v3/projects/8a73af8e42ce4297848ab4111d14c437/users/47bde6fbf26443b6afd62a671a5a6620/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:32:08.498818 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43b9fd-175e-4686-be28-4b6e5153f477 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:08.499353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43b9fd-175e-4686-be28-4b6e5153f477 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:08.499632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43b9fd-175e-4686-be28-4b6e5153f477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:08.519708 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-be43b9fd-175e-4686-be28-4b6e5153f477 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:08.520603 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-be43b9fd-175e-4686-be28-4b6e5153f477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:08.579572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c70fed15-eeb7-410b-b481-7b7a2bc5af34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4e5ebe2bfbf452b9777dd2dbd2dd71b', 'request_id': 'req-c70fed15-eeb7-410b-b481-7b7a2bc5af34'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:08.593518 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 904/1807] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:08.600559 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43b9fd-175e-4686-be28-4b6e5153f477 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:08.602097 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-be43b9fd-175e-4686-be28-4b6e5153f477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:08.659520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43b9fd-175e-4686-be28-4b6e5153f477 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:08.673073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c70fed15-eeb7-410b-b481-7b7a2bc5af34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4e5ebe2bfbf452b9777dd2dbd2dd71b', 'request_id': 'req-c70fed15-eeb7-410b-b481-7b7a2bc5af34'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:08.680138 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c70fed15-eeb7-410b-b481-7b7a2bc5af34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4e5ebe2bfbf452b9777dd2dbd2dd71b', 'request_id': 'req-c70fed15-eeb7-410b-b481-7b7a2bc5af34'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:08.691589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c70fed15-eeb7-410b-b481-7b7a2bc5af34 admin admin] The token cache is being invalidate because project d4e5ebe2bfbf452b9777dd2dbd2dd71b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:08.692154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c70fed15-eeb7-410b-b481-7b7a2bc5af34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:08.693035 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c70fed15-eeb7-410b-b481-7b7a2bc5af34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:08.695090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 904/1808] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:08 2022] DELETE /identity/v3/projects/d4e5ebe2bfbf452b9777dd2dbd2dd71b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:32:08.703630 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fed15-eeb7-410b-b481-7b7a2bc5af34 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:08.709030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c70fed15-eeb7-410b-b481-7b7a2bc5af34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:08.724556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd49cad-634c-4bd2-a040-afefb934ed3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:08.725295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd49cad-634c-4bd2-a040-afefb934ed3e service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:08.725745 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd49cad-634c-4bd2-a040-afefb934ed3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:08.726077 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd49cad-634c-4bd2-a040-afefb934ed3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:08.728162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7bd49cad-634c-4bd2-a040-afefb934ed3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:08.789704 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fed15-eeb7-410b-b481-7b7a2bc5af34 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:08.796052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df698c-ac4f-4d27-ba8c-a5df30b67ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:08.796644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df698c-ac4f-4d27-ba8c-a5df30b67ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:08.796928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df698c-ac4f-4d27-ba8c-a5df30b67ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:08.797206 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df698c-ac4f-4d27-ba8c-a5df30b67ab9 admin admin] PATH_INFO: `/v3/users/445336bb52c94bb69ae98f42cec25591` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:08.798428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df698c-ac4f-4d27-ba8c-a5df30b67ab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=445336bb52c94bb69ae98f42cec25591)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:08.800390 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df698c-ac4f-4d27-ba8c-a5df30b67ab9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:08.809636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd49cad-634c-4bd2-a040-afefb934ed3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:08.811242 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd49cad-634c-4bd2-a040-afefb934ed3e service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:08.821117 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 905/1809] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:32:08.889501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd49cad-634c-4bd2-a040-afefb934ed3e service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:08.891595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7bd49cad-634c-4bd2-a040-afefb934ed3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:08.898900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:08.914814 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd49cad-634c-4bd2-a040-afefb934ed3e service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:08.923469 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce42dc1-19a0-4a50-849b-60b0ad056db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:08.924595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce42dc1-19a0-4a50-849b-60b0ad056db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:08.925093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce42dc1-19a0-4a50-849b-60b0ad056db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:08.925643 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce42dc1-19a0-4a50-849b-60b0ad056db9 admin admin] PATH_INFO: `/v3/users/1f017fb813ba4b459d7575de342e36a0` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:08.928601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce42dc1-19a0-4a50-849b-60b0ad056db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f017fb813ba4b459d7575de342e36a0)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:08.931585 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce42dc1-19a0-4a50-849b-60b0ad056db9 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:08.995634 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-77df698c-ac4f-4d27-ba8c-a5df30b67ab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445336bb52c94bb69ae98f42cec25591'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:08.996915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-77df698c-ac4f-4d27-ba8c-a5df30b67ab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445336bb52c94bb69ae98f42cec25591'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:09.116063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-77df698c-ac4f-4d27-ba8c-a5df30b67ab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445336bb52c94bb69ae98f42cec25591'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:09.138201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-77df698c-ac4f-4d27-ba8c-a5df30b67ab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445336bb52c94bb69ae98f42cec25591'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:09.139052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-77df698c-ac4f-4d27-ba8c-a5df30b67ab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445336bb52c94bb69ae98f42cec25591'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:09.164411 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 905/1810] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:08 2022] DELETE /identity/v3/users/445336bb52c94bb69ae98f42cec25591 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:32:09.205108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7ce42dc1-19a0-4a50-849b-60b0ad056db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f017fb813ba4b459d7575de342e36a0'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:09.206078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7ce42dc1-19a0-4a50-849b-60b0ad056db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f017fb813ba4b459d7575de342e36a0'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:09.367271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:09.368152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7ce42dc1-19a0-4a50-849b-60b0ad056db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f017fb813ba4b459d7575de342e36a0'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:09.377688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7ce42dc1-19a0-4a50-849b-60b0ad056db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f017fb813ba4b459d7575de342e36a0'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:09.399234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7ce42dc1-19a0-4a50-849b-60b0ad056db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f017fb813ba4b459d7575de342e36a0'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:09.412004 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 906/1811] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:08 2022] DELETE /identity/v3/users/1f017fb813ba4b459d7575de342e36a0 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:32:09.416632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b0990-936c-4ee0-ba9e-3053889a09c0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:09.416924 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b0990-936c-4ee0-ba9e-3053889a09c0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:09.417195 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b0990-936c-4ee0-ba9e-3053889a09c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:09.440151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a45b0990-936c-4ee0-ba9e-3053889a09c0 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:09.442595 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a45b0990-936c-4ee0-ba9e-3053889a09c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:09.519960 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 906/1812] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:09.548206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce42dc1-19a0-4a50-849b-60b0ad056db9 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:09.549825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7ce42dc1-19a0-4a50-849b-60b0ad056db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:09.623761 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:09.644574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce42dc1-19a0-4a50-849b-60b0ad056db9 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:09.648400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62b4fc-1698-44fe-8dd0-69da11b22f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:09.649149 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62b4fc-1698-44fe-8dd0-69da11b22f86 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:09.649579 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62b4fc-1698-44fe-8dd0-69da11b22f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:09.649863 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62b4fc-1698-44fe-8dd0-69da11b22f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:09.660112 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62b4fc-1698-44fe-8dd0-69da11b22f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:09.661747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62b4fc-1698-44fe-8dd0-69da11b22f86 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:09.699801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 907/1813] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:10.073862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:10.414132 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b0990-936c-4ee0-ba9e-3053889a09c0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:10.416214 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a45b0990-936c-4ee0-ba9e-3053889a09c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:10.433398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b0990-936c-4ee0-ba9e-3053889a09c0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:10.440773 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f952a-b6d7-482a-b844-0fbdeece5a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:10.441449 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f952a-b6d7-482a-b844-0fbdeece5a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:10.441763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f952a-b6d7-482a-b844-0fbdeece5a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:10.442090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f952a-b6d7-482a-b844-0fbdeece5a83 admin admin] PATH_INFO: `/v3/projects/dce1b1ac1e3b40988a94efa1cd73a4ff` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:10.443279 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f952a-b6d7-482a-b844-0fbdeece5a83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dce1b1ac1e3b40988a94efa1cd73a4ff)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:10.445316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f952a-b6d7-482a-b844-0fbdeece5a83 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:10.562788 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1a4f952a-b6d7-482a-b844-0fbdeece5a83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dce1b1ac1e3b40988a94efa1cd73a4ff', 'request_id': 'req-1a4f952a-b6d7-482a-b844-0fbdeece5a83'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:10.628436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1a4f952a-b6d7-482a-b844-0fbdeece5a83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dce1b1ac1e3b40988a94efa1cd73a4ff', 'request_id': 'req-1a4f952a-b6d7-482a-b844-0fbdeece5a83'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:10.647357 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1a4f952a-b6d7-482a-b844-0fbdeece5a83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dce1b1ac1e3b40988a94efa1cd73a4ff', 'request_id': 'req-1a4f952a-b6d7-482a-b844-0fbdeece5a83'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:10.662855 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1a4f952a-b6d7-482a-b844-0fbdeece5a83 admin admin] The token cache is being invalidate because project dce1b1ac1e3b40988a94efa1cd73a4ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:10.663139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1a4f952a-b6d7-482a-b844-0fbdeece5a83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:10.664604 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1a4f952a-b6d7-482a-b844-0fbdeece5a83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:10.670051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 907/1814] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:10 2022] DELETE /identity/v3/projects/dce1b1ac1e3b40988a94efa1cd73a4ff => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:10.672201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6b85a-1c07-4a06-8f10-6531b9483294 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:10.672492 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6b85a-1c07-4a06-8f10-6531b9483294 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:10.672806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6b85a-1c07-4a06-8f10-6531b9483294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:10.711507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-59a6b85a-1c07-4a06-8f10-6531b9483294 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:10.713131 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-59a6b85a-1c07-4a06-8f10-6531b9483294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:10.829334 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 908/1815] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:10.838238 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b452a4-3953-4d77-86d8-03bcf8511702 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:10.838530 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b452a4-3953-4d77-86d8-03bcf8511702 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:10.839010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b452a4-3953-4d77-86d8-03bcf8511702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:10.902693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-99b452a4-3953-4d77-86d8-03bcf8511702 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:10.906184 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-99b452a4-3953-4d77-86d8-03bcf8511702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:10.923467 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 908/1816] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:10.927149 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6b85a-1c07-4a06-8f10-6531b9483294 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:10.942952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6b85a-1c07-4a06-8f10-6531b9483294 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:10.948449 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244cb49-faaf-4d37-b0ca-eaa19bbca80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:10.949704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244cb49-faaf-4d37-b0ca-eaa19bbca80c admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:10.950144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244cb49-faaf-4d37-b0ca-eaa19bbca80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:10.950429 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244cb49-faaf-4d37-b0ca-eaa19bbca80c admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:10.951304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244cb49-faaf-4d37-b0ca-eaa19bbca80c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:32:10.951619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244cb49-faaf-4d37-b0ca-eaa19bbca80c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:10.953262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244cb49-faaf-4d37-b0ca-eaa19bbca80c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:10.967416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 909/1817] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:32:10.971604 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b452a4-3953-4d77-86d8-03bcf8511702 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:10.986536 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b452a4-3953-4d77-86d8-03bcf8511702 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:10.994340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28182593-7d99-418c-80e2-e4e1714031ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:10.995517 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28182593-7d99-418c-80e2-e4e1714031ca admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:10.997599 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28182593-7d99-418c-80e2-e4e1714031ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:10.998596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28182593-7d99-418c-80e2-e4e1714031ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:11.005590 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28182593-7d99-418c-80e2-e4e1714031ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:11.005590 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28182593-7d99-418c-80e2-e4e1714031ca admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:11.153812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244cb49-faaf-4d37-b0ca-eaa19bbca80c admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:11.159401 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 909/1818] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:10 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:11.176105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244cb49-faaf-4d37-b0ca-eaa19bbca80c admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:11.277090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28182593-7d99-418c-80e2-e4e1714031ca admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:11.280435 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-28182593-7d99-418c-80e2-e4e1714031ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:11.325818 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43722b3-9899-4887-97a9-9d1c24cea34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:11.325818 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43722b3-9899-4887-97a9-9d1c24cea34c admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:11.325818 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43722b3-9899-4887-97a9-9d1c24cea34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:11.325818 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43722b3-9899-4887-97a9-9d1c24cea34c admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:11.329522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43722b3-9899-4887-97a9-9d1c24cea34c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:11.335042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43722b3-9899-4887-97a9-9d1c24cea34c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:11.392071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:11.423637 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28182593-7d99-418c-80e2-e4e1714031ca admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:11.430029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4416229-a2b7-4bbd-bf0c-923996219019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:11.430950 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4416229-a2b7-4bbd-bf0c-923996219019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:11.431380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4416229-a2b7-4bbd-bf0c-923996219019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:11.431798 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4416229-a2b7-4bbd-bf0c-923996219019 admin admin] PATH_INFO: `/v3/projects/228efd104adf410185b7c88e5b449d2a` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:11.433621 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4416229-a2b7-4bbd-bf0c-923996219019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=228efd104adf410185b7c88e5b449d2a)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:11.435876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4416229-a2b7-4bbd-bf0c-923996219019 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:11.476286 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 910/1819] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:11 2022] POST /identity/v3/users => generated 284 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:32:11.484927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43722b3-9899-4887-97a9-9d1c24cea34c admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:11.499423 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43722b3-9899-4887-97a9-9d1c24cea34c admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:11.505257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085534d5-2dbe-4cb9-b562-f19234a12909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:11.507795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085534d5-2dbe-4cb9-b562-f19234a12909 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:11.507795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085534d5-2dbe-4cb9-b562-f19234a12909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:11.507795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085534d5-2dbe-4cb9-b562-f19234a12909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:11.507795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085534d5-2dbe-4cb9-b562-f19234a12909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:11.509557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085534d5-2dbe-4cb9-b562-f19234a12909 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:11.536862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 911/1820] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:11.538137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085534d5-2dbe-4cb9-b562-f19234a12909 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:11.549756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085534d5-2dbe-4cb9-b562-f19234a12909 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:11.562316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b4416229-a2b7-4bbd-bf0c-923996219019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228efd104adf410185b7c88e5b449d2a', 'request_id': 'req-b4416229-a2b7-4bbd-bf0c-923996219019'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:11.590881 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:11.624840 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62758d1-b904-4c70-a6dd-eaafe3204a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:11.626282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62758d1-b904-4c70-a6dd-eaafe3204a3d admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:11.626677 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62758d1-b904-4c70-a6dd-eaafe3204a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:11.627056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62758d1-b904-4c70-a6dd-eaafe3204a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:11.628133 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62758d1-b904-4c70-a6dd-eaafe3204a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:11.630013 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62758d1-b904-4c70-a6dd-eaafe3204a3d admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:11.633447 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b4416229-a2b7-4bbd-bf0c-923996219019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228efd104adf410185b7c88e5b449d2a', 'request_id': 'req-b4416229-a2b7-4bbd-bf0c-923996219019'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:11.642531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b4416229-a2b7-4bbd-bf0c-923996219019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228efd104adf410185b7c88e5b449d2a', 'request_id': 'req-b4416229-a2b7-4bbd-bf0c-923996219019'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:11.647244 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 912/1821] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:11.647244 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4c5e0-a498-4d7f-9132-f37054679610 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:11.647921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4c5e0-a498-4d7f-9132-f37054679610 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:11.647921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4c5e0-a498-4d7f-9132-f37054679610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:11.664233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b4416229-a2b7-4bbd-bf0c-923996219019 admin admin] The token cache is being invalidate because project 228efd104adf410185b7c88e5b449d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:11.664534 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b4416229-a2b7-4bbd-bf0c-923996219019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:11.665298 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b4416229-a2b7-4bbd-bf0c-923996219019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:11.667483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 910/1822] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:11 2022] DELETE /identity/v3/projects/228efd104adf410185b7c88e5b449d2a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:11.668575 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4416229-a2b7-4bbd-bf0c-923996219019 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:11.670251 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b4416229-a2b7-4bbd-bf0c-923996219019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:11.685417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4416229-a2b7-4bbd-bf0c-923996219019 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:11.688943 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-39e4c5e0-a498-4d7f-9132-f37054679610 None None] MFA Rules not processed for user `47bde6fbf26443b6afd62a671a5a6620`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:11.690505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-39e4c5e0-a498-4d7f-9132-f37054679610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:11.691234 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e3845-be4d-40a0-8e5f-3dba9fbd066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:11.692011 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3845-be4d-40a0-8e5f-3dba9fbd066d admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:11.692572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3845-be4d-40a0-8e5f-3dba9fbd066d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:11.693168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3845-be4d-40a0-8e5f-3dba9fbd066d admin admin] PATH_INFO: `/v3/projects/1e529fb91c0b46d3ac140da0349f8778/users/5ad83712c11e479fb7d0778c3f2c3dba/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:11.724149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e3845-be4d-40a0-8e5f-3dba9fbd066d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e529fb91c0b46d3ac140da0349f8778, user_id=5ad83712c11e479fb7d0778c3f2c3dba, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:11.727211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e3845-be4d-40a0-8e5f-3dba9fbd066d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:11.782383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 913/1823] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:11.784932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4c5e0-a498-4d7f-9132-f37054679610 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:11.787015 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-39e4c5e0-a498-4d7f-9132-f37054679610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:11.804338 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4c5e0-a498-4d7f-9132-f37054679610 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:11.811811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b23a95-df5b-49da-9094-1c3e25759ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:11.812505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b23a95-df5b-49da-9094-1c3e25759ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:11.812865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b23a95-df5b-49da-9094-1c3e25759ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:11.814010 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b23a95-df5b-49da-9094-1c3e25759ac3 admin admin] PATH_INFO: `/v3/users/777231debfca47dc830d69cafc9e5cff` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:11.814744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b23a95-df5b-49da-9094-1c3e25759ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=777231debfca47dc830d69cafc9e5cff)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:11.816766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b23a95-df5b-49da-9094-1c3e25759ac3 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:11.866149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 911/1824] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:11 2022] PUT /identity/v3/projects/1e529fb91c0b46d3ac140da0349f8778/users/5ad83712c11e479fb7d0778c3f2c3dba/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:11.867369 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e3845-be4d-40a0-8e5f-3dba9fbd066d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:11.869195 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-788e3845-be4d-40a0-8e5f-3dba9fbd066d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:11.954574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e3845-be4d-40a0-8e5f-3dba9fbd066d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:11.972409 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c44ea1-c7f2-4601-a825-24c7a4dc2fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:11.973498 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c44ea1-c7f2-4601-a825-24c7a4dc2fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:11.973867 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c44ea1-c7f2-4601-a825-24c7a4dc2fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:11.974218 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c44ea1-c7f2-4601-a825-24c7a4dc2fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:11.976034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c44ea1-c7f2-4601-a825-24c7a4dc2fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:11.979497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c44ea1-c7f2-4601-a825-24c7a4dc2fe5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:12.047015 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-34b23a95-df5b-49da-9094-1c3e25759ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777231debfca47dc830d69cafc9e5cff'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:12.047711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-34b23a95-df5b-49da-9094-1c3e25759ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777231debfca47dc830d69cafc9e5cff'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:12.085865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 912/1825] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:11 2022] POST /identity/v3/projects => generated 373 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:12.085865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f628a-03ed-4e86-8a82-3457c4ab701c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:12.085865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f628a-03ed-4e86-8a82-3457c4ab701c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:12.085865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f628a-03ed-4e86-8a82-3457c4ab701c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:12.117857 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6c3f628a-03ed-4e86-8a82-3457c4ab701c None None] MFA Rules not processed for user `5ad83712c11e479fb7d0778c3f2c3dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:12.119790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6c3f628a-03ed-4e86-8a82-3457c4ab701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:12.192004 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-34b23a95-df5b-49da-9094-1c3e25759ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777231debfca47dc830d69cafc9e5cff'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:12.204714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-34b23a95-df5b-49da-9094-1c3e25759ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777231debfca47dc830d69cafc9e5cff'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:12.225594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-34b23a95-df5b-49da-9094-1c3e25759ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777231debfca47dc830d69cafc9e5cff'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:12.233279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 914/1826] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:11 2022] DELETE /identity/v3/users/777231debfca47dc830d69cafc9e5cff => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:12.236932 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 913/1827] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:12.238770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b23a95-df5b-49da-9094-1c3e25759ac3 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:12.240433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-34b23a95-df5b-49da-9094-1c3e25759ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:12.250320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f628a-03ed-4e86-8a82-3457c4ab701c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:12.254885 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6c3f628a-03ed-4e86-8a82-3457c4ab701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:12.406963 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b23a95-df5b-49da-9094-1c3e25759ac3 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:12.417783 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3738c-5881-4db9-a28e-218c88f25b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:12.418568 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3738c-5881-4db9-a28e-218c88f25b7f admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:12.418959 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3738c-5881-4db9-a28e-218c88f25b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:12.419376 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3738c-5881-4db9-a28e-218c88f25b7f admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:12.420179 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3738c-5881-4db9-a28e-218c88f25b7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:12.422460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3738c-5881-4db9-a28e-218c88f25b7f admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:12.429604 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f628a-03ed-4e86-8a82-3457c4ab701c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:12.435690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f46672-d79c-4a98-a7cc-b76917c90f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:12.436103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f46672-d79c-4a98-a7cc-b76917c90f2e admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:12.436388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f46672-d79c-4a98-a7cc-b76917c90f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:12.436666 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f46672-d79c-4a98-a7cc-b76917c90f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:12.437496 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f46672-d79c-4a98-a7cc-b76917c90f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:12.439392 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f46672-d79c-4a98-a7cc-b76917c90f2e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:12.580133 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 915/1828] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:12 2022] POST /identity/v3/users => generated 293 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:12.582679 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 914/1829] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:12 2022] POST /identity/v3/projects => generated 369 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:12.584008 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3738c-5881-4db9-a28e-218c88f25b7f admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:12.586607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f46672-d79c-4a98-a7cc-b76917c90f2e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:12.599525 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3738c-5881-4db9-a28e-218c88f25b7f admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:12.671159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015564a-5827-4131-b0a9-444f9d5abfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:12.672801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015564a-5827-4131-b0a9-444f9d5abfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:12.673270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015564a-5827-4131-b0a9-444f9d5abfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:12.673403 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f46672-d79c-4a98-a7cc-b76917c90f2e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:12.674766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015564a-5827-4131-b0a9-444f9d5abfe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:12.675582 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:12.676173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015564a-5827-4131-b0a9-444f9d5abfe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:12.678204 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015564a-5827-4131-b0a9-444f9d5abfe2 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:12.679240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2187497-dcbe-42d0-bd95-845c25f88f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:12.680572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2187497-dcbe-42d0-bd95-845c25f88f7c admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:12.680572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2187497-dcbe-42d0-bd95-845c25f88f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:12.680572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2187497-dcbe-42d0-bd95-845c25f88f7c admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:12.681234 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2187497-dcbe-42d0-bd95-845c25f88f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:12.683891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2187497-dcbe-42d0-bd95-845c25f88f7c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:12.690451 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 916/1830] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:12.694938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015564a-5827-4131-b0a9-444f9d5abfe2 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:12.705595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015564a-5827-4131-b0a9-444f9d5abfe2 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:12.710580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b55ef-fc98-4dd9-ab4c-49f3bbf2bfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:12.711267 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b55ef-fc98-4dd9-ab4c-49f3bbf2bfe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:12.711545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b55ef-fc98-4dd9-ab4c-49f3bbf2bfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:12.712005 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b55ef-fc98-4dd9-ab4c-49f3bbf2bfe2 admin admin] PATH_INFO: `/v3/projects/5fee5ccd0a2e4a6baa670eca18e3a4fc/users/8d005ff9284b4b2db6e1374f8273eb19/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:12.729167 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b55ef-fc98-4dd9-ab4c-49f3bbf2bfe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fee5ccd0a2e4a6baa670eca18e3a4fc, user_id=8d005ff9284b4b2db6e1374f8273eb19, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:12.732727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b55ef-fc98-4dd9-ab4c-49f3bbf2bfe2 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:12.777154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 915/1831] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:12 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:12.781316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2187497-dcbe-42d0-bd95-845c25f88f7c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:12.791789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2187497-dcbe-42d0-bd95-845c25f88f7c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:12.797101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946a194-1cf0-4071-b570-efe924ef3351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:12.797746 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946a194-1cf0-4071-b570-efe924ef3351 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:12.798141 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946a194-1cf0-4071-b570-efe924ef3351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:12.798587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946a194-1cf0-4071-b570-efe924ef3351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:12.799333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946a194-1cf0-4071-b570-efe924ef3351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:12.800943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946a194-1cf0-4071-b570-efe924ef3351 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:12.812615 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 917/1832] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:12 2022] PUT /identity/v3/projects/5fee5ccd0a2e4a6baa670eca18e3a4fc/users/8d005ff9284b4b2db6e1374f8273eb19/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:32:12.815310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 916/1833] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:32:12.817928 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b55ef-fc98-4dd9-ab4c-49f3bbf2bfe2 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:12.819678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946a194-1cf0-4071-b570-efe924ef3351 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:12.830941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946a194-1cf0-4071-b570-efe924ef3351 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:12.918405 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b55ef-fc98-4dd9-ab4c-49f3bbf2bfe2 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:12.923509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579b078-69cd-4329-88fd-a4d7c6bfb496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:12.924143 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579b078-69cd-4329-88fd-a4d7c6bfb496 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:12.924424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579b078-69cd-4329-88fd-a4d7c6bfb496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:12.924696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579b078-69cd-4329-88fd-a4d7c6bfb496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:12.925396 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579b078-69cd-4329-88fd-a4d7c6bfb496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:12.927203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579b078-69cd-4329-88fd-a4d7c6bfb496 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:12.937446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:12.943424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 918/1834] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:12.947172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158464f3-bb31-4424-8cc8-0a65fd0aa82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:12.947172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158464f3-bb31-4424-8cc8-0a65fd0aa82f admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:12.947172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158464f3-bb31-4424-8cc8-0a65fd0aa82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:12.947172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158464f3-bb31-4424-8cc8-0a65fd0aa82f admin admin] PATH_INFO: `/v3/projects/a6b7819334f6496fbc8cb2b1ecf07e76/users/e33efbda5d70414887429ef15e79b7c6/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:12.947540 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579b078-69cd-4329-88fd-a4d7c6bfb496 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:12.955317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579b078-69cd-4329-88fd-a4d7c6bfb496 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:12.960684 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cba57-e93c-4c10-9e72-872c49b0f0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:12.961398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158464f3-bb31-4424-8cc8-0a65fd0aa82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b7819334f6496fbc8cb2b1ecf07e76, user_id=e33efbda5d70414887429ef15e79b7c6, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:12.961536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cba57-e93c-4c10-9e72-872c49b0f0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:12.961902 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cba57-e93c-4c10-9e72-872c49b0f0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:12.962188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cba57-e93c-4c10-9e72-872c49b0f0a4 admin admin] PATH_INFO: `/v3/projects/5fee5ccd0a2e4a6baa670eca18e3a4fc/users/8d005ff9284b4b2db6e1374f8273eb19/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:12.964098 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158464f3-bb31-4424-8cc8-0a65fd0aa82f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:12.965268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cba57-e93c-4c10-9e72-872c49b0f0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fee5ccd0a2e4a6baa670eca18e3a4fc, user_id=8d005ff9284b4b2db6e1374f8273eb19, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:12.968150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cba57-e93c-4c10-9e72-872c49b0f0a4 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:12.982624 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 919/1835] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:12 2022] PUT /identity/v3/projects/5fee5ccd0a2e4a6baa670eca18e3a4fc/users/8d005ff9284b4b2db6e1374f8273eb19/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:13.039564 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 917/1836] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:12 2022] PUT /identity/v3/projects/a6b7819334f6496fbc8cb2b1ecf07e76/users/e33efbda5d70414887429ef15e79b7c6/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:13.043622 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cba57-e93c-4c10-9e72-872c49b0f0a4 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:13.131340 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cba57-e93c-4c10-9e72-872c49b0f0a4 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:13.208351 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3c995-a1d2-48bb-8dd1-5ec469bd9d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:13.210520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3c995-a1d2-48bb-8dd1-5ec469bd9d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:13.210520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3c995-a1d2-48bb-8dd1-5ec469bd9d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:13.210520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3c995-a1d2-48bb-8dd1-5ec469bd9d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:13.210903 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3c995-a1d2-48bb-8dd1-5ec469bd9d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:13.212358 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3c995-a1d2-48bb-8dd1-5ec469bd9d11 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:13.238795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 920/1837] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:13.239901 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158464f3-bb31-4424-8cc8-0a65fd0aa82f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:13.275761 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3c995-a1d2-48bb-8dd1-5ec469bd9d11 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:13.280327 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158464f3-bb31-4424-8cc8-0a65fd0aa82f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:13.282560 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6cc3c995-a1d2-48bb-8dd1-5ec469bd9d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:13.325414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5d327-86b7-4212-80dd-00bcbdc18117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:13.325414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5d327-86b7-4212-80dd-00bcbdc18117 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:13.325414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5d327-86b7-4212-80dd-00bcbdc18117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:13.325414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5d327-86b7-4212-80dd-00bcbdc18117 admin admin] PATH_INFO: `/v3/projects/a6b7819334f6496fbc8cb2b1ecf07e76/users/e33efbda5d70414887429ef15e79b7c6/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:13.328870 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5d327-86b7-4212-80dd-00bcbdc18117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b7819334f6496fbc8cb2b1ecf07e76, user_id=e33efbda5d70414887429ef15e79b7c6, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:13.332091 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5d327-86b7-4212-80dd-00bcbdc18117 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:13.339141 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3c995-a1d2-48bb-8dd1-5ec469bd9d11 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:13.358594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fd0d8-5289-441e-8579-d0755e18483e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:13.359306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fd0d8-5289-441e-8579-d0755e18483e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:13.359679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fd0d8-5289-441e-8579-d0755e18483e admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:13.359869 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fd0d8-5289-441e-8579-d0755e18483e admin admin] PATH_INFO: `/v3/projects/788aa35f988b4c4e8b4a164b9579a357` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:13.367203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fd0d8-5289-441e-8579-d0755e18483e admin admin] RBAC: Authorizing `identity:delete_project(project_id=788aa35f988b4c4e8b4a164b9579a357)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:13.369140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fd0d8-5289-441e-8579-d0755e18483e admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:13.369798 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 918/1838] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:13 2022] PUT /identity/v3/projects/a6b7819334f6496fbc8cb2b1ecf07e76/users/e33efbda5d70414887429ef15e79b7c6/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:32:13.380785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1137d2-8398-43fe-98b6-968ef1d70d68 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:13.381150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1137d2-8398-43fe-98b6-968ef1d70d68 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:13.386233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1137d2-8398-43fe-98b6-968ef1d70d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:13.444402 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-bc1137d2-8398-43fe-98b6-968ef1d70d68 None None] MFA Rules not processed for user `e33efbda5d70414887429ef15e79b7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:13.445671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bc1137d2-8398-43fe-98b6-968ef1d70d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:13.539480 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-238fd0d8-5289-441e-8579-d0755e18483e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '788aa35f988b4c4e8b4a164b9579a357', 'request_id': 'req-238fd0d8-5289-441e-8579-d0755e18483e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:13.571886 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 919/1839] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:32:13.573018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1137d2-8398-43fe-98b6-968ef1d70d68 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:13.574813 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bc1137d2-8398-43fe-98b6-968ef1d70d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:13.617946 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-238fd0d8-5289-441e-8579-d0755e18483e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '788aa35f988b4c4e8b4a164b9579a357', 'request_id': 'req-238fd0d8-5289-441e-8579-d0755e18483e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:13.648878 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-238fd0d8-5289-441e-8579-d0755e18483e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '788aa35f988b4c4e8b4a164b9579a357', 'request_id': 'req-238fd0d8-5289-441e-8579-d0755e18483e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:13.690494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1137d2-8398-43fe-98b6-968ef1d70d68 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:13.711626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-238fd0d8-5289-441e-8579-d0755e18483e admin admin] The token cache is being invalidate because project 788aa35f988b4c4e8b4a164b9579a357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:13.712225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-238fd0d8-5289-441e-8579-d0755e18483e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:13.715101 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-238fd0d8-5289-441e-8579-d0755e18483e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:13.717168 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 921/1840] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:13 2022] DELETE /identity/v3/projects/788aa35f988b4c4e8b4a164b9579a357 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:13.723161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f38b33-8737-4c67-bdac-2dbcd9362368 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:13.723678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f38b33-8737-4c67-bdac-2dbcd9362368 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:13.724137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f38b33-8737-4c67-bdac-2dbcd9362368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:13.778874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-45f38b33-8737-4c67-bdac-2dbcd9362368 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:13.780298 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-45f38b33-8737-4c67-bdac-2dbcd9362368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:13.788531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc3529-91a8-4005-8f85-dba517a79354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:13.790146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc3529-91a8-4005-8f85-dba517a79354 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:13.790578 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc3529-91a8-4005-8f85-dba517a79354 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:13.791986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc3529-91a8-4005-8f85-dba517a79354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:13.798749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8ddc3529-91a8-4005-8f85-dba517a79354 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:13.906986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 922/1841] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:13.914882 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31519deb-c1db-4ae6-b2fd-0e92f6c7af51 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:13.915194 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31519deb-c1db-4ae6-b2fd-0e92f6c7af51 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:13.915455 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31519deb-c1db-4ae6-b2fd-0e92f6c7af51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:13.946799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc3529-91a8-4005-8f85-dba517a79354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:13.948263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc3529-91a8-4005-8f85-dba517a79354 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:13.953577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-31519deb-c1db-4ae6-b2fd-0e92f6c7af51 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:13.954876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-31519deb-c1db-4ae6-b2fd-0e92f6c7af51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:13.966307 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 920/1842] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:13 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:13.977245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 923/1843] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:13.981855 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc3529-91a8-4005-8f85-dba517a79354 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:14.010922 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc3529-91a8-4005-8f85-dba517a79354 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:14.013092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b815a8-a495-4122-b847-51dd3d47067c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:14.013851 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b815a8-a495-4122-b847-51dd3d47067c admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:14.014203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b815a8-a495-4122-b847-51dd3d47067c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:14.014546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b815a8-a495-4122-b847-51dd3d47067c admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:14.015472 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b815a8-a495-4122-b847-51dd3d47067c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:32:14.015752 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b815a8-a495-4122-b847-51dd3d47067c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:14.017627 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b815a8-a495-4122-b847-51dd3d47067c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:14.031858 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 921/1844] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:32:14.036141 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31519deb-c1db-4ae6-b2fd-0e92f6c7af51 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:14.046570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31519deb-c1db-4ae6-b2fd-0e92f6c7af51 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:14.051740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55723a17-db06-46be-b826-8dd67bbaaca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:14.053501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55723a17-db06-46be-b826-8dd67bbaaca4 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:14.053501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55723a17-db06-46be-b826-8dd67bbaaca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:14.053501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55723a17-db06-46be-b826-8dd67bbaaca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:14.053797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55723a17-db06-46be-b826-8dd67bbaaca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:14.055561 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55723a17-db06-46be-b826-8dd67bbaaca4 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:14.144053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b815a8-a495-4122-b847-51dd3d47067c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:14.147049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-06b815a8-a495-4122-b847-51dd3d47067c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:14.160060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 924/1845] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:14 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:14.164465 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55723a17-db06-46be-b826-8dd67bbaaca4 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:14.164609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b815a8-a495-4122-b847-51dd3d47067c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:14.255569 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de12ed5-e8a3-463c-9b05-9dd432ba8f30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:14.256219 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de12ed5-e8a3-463c-9b05-9dd432ba8f30 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:14.256506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de12ed5-e8a3-463c-9b05-9dd432ba8f30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:14.256804 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de12ed5-e8a3-463c-9b05-9dd432ba8f30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:14.263793 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3de12ed5-e8a3-463c-9b05-9dd432ba8f30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:14.286531 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55723a17-db06-46be-b826-8dd67bbaaca4 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:14.305107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955ec0f-4262-4b83-9404-4042704b3b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:14.305876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955ec0f-4262-4b83-9404-4042704b3b72 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:14.306162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955ec0f-4262-4b83-9404-4042704b3b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:14.313674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955ec0f-4262-4b83-9404-4042704b3b72 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:14.313674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955ec0f-4262-4b83-9404-4042704b3b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:14.313674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955ec0f-4262-4b83-9404-4042704b3b72 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:14.364171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de12ed5-e8a3-463c-9b05-9dd432ba8f30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:14.365321 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de12ed5-e8a3-463c-9b05-9dd432ba8f30 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:14.378138 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 922/1846] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:32:14.395849 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 925/1847] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:14 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:14.400735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de12ed5-e8a3-463c-9b05-9dd432ba8f30 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:14.413322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de12ed5-e8a3-463c-9b05-9dd432ba8f30 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:14.428264 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871b802-89be-428a-8452-04c72c99f269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:14.429081 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871b802-89be-428a-8452-04c72c99f269 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:14.429522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871b802-89be-428a-8452-04c72c99f269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:14.429899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871b802-89be-428a-8452-04c72c99f269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:14.430955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871b802-89be-428a-8452-04c72c99f269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:14.433861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871b802-89be-428a-8452-04c72c99f269 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:14.445998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 923/1848] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:14.450424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955ec0f-4262-4b83-9404-4042704b3b72 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:14.468074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955ec0f-4262-4b83-9404-4042704b3b72 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:14.482370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918781ca-69b8-4e86-a0cb-024451a92c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:14.484508 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918781ca-69b8-4e86-a0cb-024451a92c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:14.485289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918781ca-69b8-4e86-a0cb-024451a92c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:14.487684 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918781ca-69b8-4e86-a0cb-024451a92c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:14.488450 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918781ca-69b8-4e86-a0cb-024451a92c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:14.492918 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918781ca-69b8-4e86-a0cb-024451a92c11 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:14.507398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 926/1849] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:14.511916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871b802-89be-428a-8452-04c72c99f269 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:14.524562 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871b802-89be-428a-8452-04c72c99f269 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:14.534137 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2991b6b-8325-4f22-9219-62add748c995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:14.534727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2991b6b-8325-4f22-9219-62add748c995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:14.535020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2991b6b-8325-4f22-9219-62add748c995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:14.535301 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2991b6b-8325-4f22-9219-62add748c995 admin admin] PATH_INFO: `/v3/projects/d82b2965218e443b8f14ae34931d7be2/users/e41db3e0a4cb482cb68ad10a652a10e8/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:14.556666 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2991b6b-8325-4f22-9219-62add748c995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82b2965218e443b8f14ae34931d7be2, user_id=e41db3e0a4cb482cb68ad10a652a10e8, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:14.562268 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2991b6b-8325-4f22-9219-62add748c995 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:14.690487 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 924/1850] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:14 2022] PUT /identity/v3/projects/d82b2965218e443b8f14ae34931d7be2/users/e41db3e0a4cb482cb68ad10a652a10e8/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:14.702163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:14.704346 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba894f-1db4-486a-b17c-5248ccc258c7 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:14.704923 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba894f-1db4-486a-b17c-5248ccc258c7 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:14.705545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba894f-1db4-486a-b17c-5248ccc258c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:14.747915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-abba894f-1db4-486a-b17c-5248ccc258c7 None None] MFA Rules not processed for user `e41db3e0a4cb482cb68ad10a652a10e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:14.747915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-abba894f-1db4-486a-b17c-5248ccc258c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:14.823090 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 927/1851] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:14.839849 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2991b6b-8325-4f22-9219-62add748c995 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:14.846401 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a2991b6b-8325-4f22-9219-62add748c995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:14.946403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee27e6-b00c-4b71-8c89-6e7febbdc0fe None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:14.946930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee27e6-b00c-4b71-8c89-6e7febbdc0fe None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:14.947369 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee27e6-b00c-4b71-8c89-6e7febbdc0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:14.950428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2991b6b-8325-4f22-9219-62add748c995 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:14.955213 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e05866-20ef-45c2-bf27-c5013e07dd01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628ef75fa7194253bcf6cd6c85211738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:14.955994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e05866-20ef-45c2-bf27-c5013e07dd01 service glance] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:14.956376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e05866-20ef-45c2-bf27-c5013e07dd01 service glance] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:14.957068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e05866-20ef-45c2-bf27-c5013e07dd01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:14.980694 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e05866-20ef-45c2-bf27-c5013e07dd01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:14.982342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e05866-20ef-45c2-bf27-c5013e07dd01 service glance] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:14.994376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 925/1852] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:15.045007 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-d8ee27e6-b00c-4b71-8c89-6e7febbdc0fe None None] MFA Rules not processed for user `8d005ff9284b4b2db6e1374f8273eb19`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:15.046467 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d8ee27e6-b00c-4b71-8c89-6e7febbdc0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:15.146138 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:15.209725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 928/1853] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:15.308398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e05866-20ef-45c2-bf27-c5013e07dd01 service glance] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:15.439037 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e05866-20ef-45c2-bf27-c5013e07dd01 service glance] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:15.443842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df535de2-19a4-4a30-bed9-67cd0a1858d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:15.444711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df535de2-19a4-4a30-bed9-67cd0a1858d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:15.445187 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df535de2-19a4-4a30-bed9-67cd0a1858d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:15.445665 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df535de2-19a4-4a30-bed9-67cd0a1858d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:15.450055 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-df535de2-19a4-4a30-bed9-67cd0a1858d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:15.524621 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df535de2-19a4-4a30-bed9-67cd0a1858d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:15.526354 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df535de2-19a4-4a30-bed9-67cd0a1858d5 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:15.537332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 926/1854] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:15.571445 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:15.953718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:15.962430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637aa64-3f80-41b1-a3fe-682c98d13a75 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:15.962430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637aa64-3f80-41b1-a3fe-682c98d13a75 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:15.969129 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637aa64-3f80-41b1-a3fe-682c98d13a75 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:15.969129 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 929/1855] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jul 28 05:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:32:15.975523 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592adaff-8eeb-488e-8870-5568ff3f2d87 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:15.975884 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592adaff-8eeb-488e-8870-5568ff3f2d87 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:15.976236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592adaff-8eeb-488e-8870-5568ff3f2d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:15.996505 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-592adaff-8eeb-488e-8870-5568ff3f2d87 None None] MFA Rules not processed for user `99d8c709e6f4462c98c055cb03eebf42`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:15.997969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-592adaff-8eeb-488e-8870-5568ff3f2d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:16.146956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 927/1856] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jul 28 05:32:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:16.370611 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637aa64-3f80-41b1-a3fe-682c98d13a75 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:16.372465 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-3637aa64-3f80-41b1-a3fe-682c98d13a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:16.396432 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637aa64-3f80-41b1-a3fe-682c98d13a75 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:16.404692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d2c79-f8dd-4f25-ad0d-b25f2beda588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:16.405461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d2c79-f8dd-4f25-ad0d-b25f2beda588 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:16.406299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d2c79-f8dd-4f25-ad0d-b25f2beda588 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:16.407032 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d2c79-f8dd-4f25-ad0d-b25f2beda588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:16.442014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d2c79-f8dd-4f25-ad0d-b25f2beda588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:16.443771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d2c79-f8dd-4f25-ad0d-b25f2beda588 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:16.458289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 930/1857] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:17.506113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592adaff-8eeb-488e-8870-5568ff3f2d87 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:17.526519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592adaff-8eeb-488e-8870-5568ff3f2d87 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:17.531997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1361c-a6d2-42b2-9221-d7b1a8e885e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:17.533793 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1361c-a6d2-42b2-9221-d7b1a8e885e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:17.534097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1361c-a6d2-42b2-9221-d7b1a8e885e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:17.534401 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1361c-a6d2-42b2-9221-d7b1a8e885e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:17.550282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1361c-a6d2-42b2-9221-d7b1a8e885e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:17.557047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:17.557047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1361c-a6d2-42b2-9221-d7b1a8e885e6 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:17.598084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 928/1858] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:18.006332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:18.982585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:20.069704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d2c79-f8dd-4f25-ad0d-b25f2beda588 service nova] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:20.074191 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-df8d2c79-f8dd-4f25-ad0d-b25f2beda588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:20.191239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d2c79-f8dd-4f25-ad0d-b25f2beda588 service nova] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:20.196850 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8099c-3b58-40d9-8449-9edca34ebdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:20.197837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8099c-3b58-40d9-8449-9edca34ebdca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:20.198996 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8099c-3b58-40d9-8449-9edca34ebdca admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:20.199422 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8099c-3b58-40d9-8449-9edca34ebdca admin admin] PATH_INFO: `/v3/users/5ad83712c11e479fb7d0778c3f2c3dba` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:20.201460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8099c-3b58-40d9-8449-9edca34ebdca admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ad83712c11e479fb7d0778c3f2c3dba)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:20.204457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8099c-3b58-40d9-8449-9edca34ebdca admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:20.408759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f0c8099c-3b58-40d9-8449-9edca34ebdca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ad83712c11e479fb7d0778c3f2c3dba'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:20.409425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f0c8099c-3b58-40d9-8449-9edca34ebdca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ad83712c11e479fb7d0778c3f2c3dba'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:20.472698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f0c8099c-3b58-40d9-8449-9edca34ebdca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ad83712c11e479fb7d0778c3f2c3dba'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:20.480510 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f0c8099c-3b58-40d9-8449-9edca34ebdca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ad83712c11e479fb7d0778c3f2c3dba'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:20.498487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f0c8099c-3b58-40d9-8449-9edca34ebdca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ad83712c11e479fb7d0778c3f2c3dba'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:20.505513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 931/1859] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:20 2022] DELETE /identity/v3/users/5ad83712c11e479fb7d0778c3f2c3dba => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:20.509954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a53b20-6f6c-4f29-8583-ddb3dcd2cdd3 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:20.511832 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a53b20-6f6c-4f29-8583-ddb3dcd2cdd3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:20.511832 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a53b20-6f6c-4f29-8583-ddb3dcd2cdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:20.531974 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-83a53b20-6f6c-4f29-8583-ddb3dcd2cdd3 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:20.533129 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-83a53b20-6f6c-4f29-8583-ddb3dcd2cdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:20.597198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 929/1860] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:20.606856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8099c-3b58-40d9-8449-9edca34ebdca admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:20.608331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f0c8099c-3b58-40d9-8449-9edca34ebdca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:20.623672 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:20.668598 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8099c-3b58-40d9-8449-9edca34ebdca admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:20.672313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4d73a-24ad-4e86-98af-4756bcba233a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:20.676264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4d73a-24ad-4e86-98af-4756bcba233a service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:20.676264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4d73a-24ad-4e86-98af-4756bcba233a service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:20.676264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4d73a-24ad-4e86-98af-4756bcba233a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:20.683704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4d73a-24ad-4e86-98af-4756bcba233a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:20.685134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4d73a-24ad-4e86-98af-4756bcba233a service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:20.695572 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 932/1861] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:21.131963 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a53b20-6f6c-4f29-8583-ddb3dcd2cdd3 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:21.133846 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-83a53b20-6f6c-4f29-8583-ddb3dcd2cdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:21.149660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a53b20-6f6c-4f29-8583-ddb3dcd2cdd3 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:21.157533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165f0c1-7690-4a41-ab86-861f61a43ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:21.158509 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165f0c1-7690-4a41-ab86-861f61a43ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:21.158845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165f0c1-7690-4a41-ab86-861f61a43ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:21.159123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165f0c1-7690-4a41-ab86-861f61a43ee2 admin admin] PATH_INFO: `/v3/projects/1e529fb91c0b46d3ac140da0349f8778` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:21.160713 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165f0c1-7690-4a41-ab86-861f61a43ee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e529fb91c0b46d3ac140da0349f8778)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:21.162469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165f0c1-7690-4a41-ab86-861f61a43ee2 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:21.287587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1165f0c1-7690-4a41-ab86-861f61a43ee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e529fb91c0b46d3ac140da0349f8778', 'request_id': 'req-1165f0c1-7690-4a41-ab86-861f61a43ee2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:21.347444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1165f0c1-7690-4a41-ab86-861f61a43ee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e529fb91c0b46d3ac140da0349f8778', 'request_id': 'req-1165f0c1-7690-4a41-ab86-861f61a43ee2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:21.356446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1165f0c1-7690-4a41-ab86-861f61a43ee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e529fb91c0b46d3ac140da0349f8778', 'request_id': 'req-1165f0c1-7690-4a41-ab86-861f61a43ee2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:21.378031 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1165f0c1-7690-4a41-ab86-861f61a43ee2 admin admin] The token cache is being invalidate because project 1e529fb91c0b46d3ac140da0349f8778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:21.378569 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1165f0c1-7690-4a41-ab86-861f61a43ee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:21.381197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1165f0c1-7690-4a41-ab86-861f61a43ee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:21.384283 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 930/1862] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:21 2022] DELETE /identity/v3/projects/1e529fb91c0b46d3ac140da0349f8778 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:21.389806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4d73a-24ad-4e86-98af-4756bcba233a service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:21.405090 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4d73a-24ad-4e86-98af-4756bcba233a service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:21.500706 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7435122-b9c8-4530-a2ac-fc6aef70e728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:21.501360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7435122-b9c8-4530-a2ac-fc6aef70e728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:21.501845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7435122-b9c8-4530-a2ac-fc6aef70e728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:21.503117 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7435122-b9c8-4530-a2ac-fc6aef70e728 admin admin] PATH_INFO: `/v3/users/e33efbda5d70414887429ef15e79b7c6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:21.504449 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7435122-b9c8-4530-a2ac-fc6aef70e728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e33efbda5d70414887429ef15e79b7c6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:21.506572 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7435122-b9c8-4530-a2ac-fc6aef70e728 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:21.702081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e7435122-b9c8-4530-a2ac-fc6aef70e728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e33efbda5d70414887429ef15e79b7c6'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:21.702851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e7435122-b9c8-4530-a2ac-fc6aef70e728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e33efbda5d70414887429ef15e79b7c6'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:21.772016 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e7435122-b9c8-4530-a2ac-fc6aef70e728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e33efbda5d70414887429ef15e79b7c6'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:21.782868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e7435122-b9c8-4530-a2ac-fc6aef70e728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e33efbda5d70414887429ef15e79b7c6'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:21.802959 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e7435122-b9c8-4530-a2ac-fc6aef70e728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e33efbda5d70414887429ef15e79b7c6'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:21.811784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 933/1863] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:21 2022] DELETE /identity/v3/users/e33efbda5d70414887429ef15e79b7c6 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:22.226815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165f0c1-7690-4a41-ab86-861f61a43ee2 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:22.227429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1165f0c1-7690-4a41-ab86-861f61a43ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:22.240504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165f0c1-7690-4a41-ab86-861f61a43ee2 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:22.279310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:22.304105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc3412-80e9-4a62-8975-116f2ec9bf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:22.304762 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc3412-80e9-4a62-8975-116f2ec9bf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:22.307043 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc3412-80e9-4a62-8975-116f2ec9bf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:22.307043 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc3412-80e9-4a62-8975-116f2ec9bf39 admin admin] PATH_INFO: `/v3/projects/a6b7819334f6496fbc8cb2b1ecf07e76` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:22.307043 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc3412-80e9-4a62-8975-116f2ec9bf39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b7819334f6496fbc8cb2b1ecf07e76)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:22.308463 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc3412-80e9-4a62-8975-116f2ec9bf39 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:22.423359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-83dc3412-80e9-4a62-8975-116f2ec9bf39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b7819334f6496fbc8cb2b1ecf07e76', 'request_id': 'req-83dc3412-80e9-4a62-8975-116f2ec9bf39'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:22.490456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-83dc3412-80e9-4a62-8975-116f2ec9bf39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b7819334f6496fbc8cb2b1ecf07e76', 'request_id': 'req-83dc3412-80e9-4a62-8975-116f2ec9bf39'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:22.500760 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-83dc3412-80e9-4a62-8975-116f2ec9bf39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b7819334f6496fbc8cb2b1ecf07e76', 'request_id': 'req-83dc3412-80e9-4a62-8975-116f2ec9bf39'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:22.520970 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-83dc3412-80e9-4a62-8975-116f2ec9bf39 admin admin] The token cache is being invalidate because project a6b7819334f6496fbc8cb2b1ecf07e76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:22.521261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-83dc3412-80e9-4a62-8975-116f2ec9bf39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:22.521960 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-83dc3412-80e9-4a62-8975-116f2ec9bf39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:22.524394 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 931/1864] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:22 2022] DELETE /identity/v3/projects/a6b7819334f6496fbc8cb2b1ecf07e76 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:22.530940 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b485dba-8168-4db1-bc20-fc2990583f60 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:22.531934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b485dba-8168-4db1-bc20-fc2990583f60 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:22.532372 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b485dba-8168-4db1-bc20-fc2990583f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:22.553584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-9b485dba-8168-4db1-bc20-fc2990583f60 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:22.554817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9b485dba-8168-4db1-bc20-fc2990583f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:22.595034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:22.629814 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 934/1865] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:22.635211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e872ac-849d-4e08-9964-8ff76eacb2a9 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:22.635334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e872ac-849d-4e08-9964-8ff76eacb2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:22.635617 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e872ac-849d-4e08-9964-8ff76eacb2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:22.658399 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a5e872ac-849d-4e08-9964-8ff76eacb2a9 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:22.659642 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a5e872ac-849d-4e08-9964-8ff76eacb2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:22.667943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 932/1866] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:22.674695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b485dba-8168-4db1-bc20-fc2990583f60 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:22.687878 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b485dba-8168-4db1-bc20-fc2990583f60 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:22.700702 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9728ad-43d6-4a2b-9b76-8374ef197338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:22.700991 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9728ad-43d6-4a2b-9b76-8374ef197338 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:22.701652 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9728ad-43d6-4a2b-9b76-8374ef197338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:22.701993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9728ad-43d6-4a2b-9b76-8374ef197338 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:22.702772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9728ad-43d6-4a2b-9b76-8374ef197338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:32:22.703033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9728ad-43d6-4a2b-9b76-8374ef197338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:22.704810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9728ad-43d6-4a2b-9b76-8374ef197338 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:22.732543 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 935/1867] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:32:22.734414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e872ac-849d-4e08-9964-8ff76eacb2a9 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:22.761954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e872ac-849d-4e08-9964-8ff76eacb2a9 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:22.761954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ee4f9-bdd1-41dc-a1cd-5fc03859eb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:22.761954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ee4f9-bdd1-41dc-a1cd-5fc03859eb9d admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:22.761954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ee4f9-bdd1-41dc-a1cd-5fc03859eb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:22.762570 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ee4f9-bdd1-41dc-a1cd-5fc03859eb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:22.762570 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ee4f9-bdd1-41dc-a1cd-5fc03859eb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:22.762570 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ee4f9-bdd1-41dc-a1cd-5fc03859eb9d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:22.893682 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 933/1868] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:22 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:22.898277 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9728ad-43d6-4a2b-9b76-8374ef197338 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:22.912266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9728ad-43d6-4a2b-9b76-8374ef197338 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:22.976579 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133a75a-04e8-485f-b727-6aaedd519140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:22.977158 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133a75a-04e8-485f-b727-6aaedd519140 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:22.977438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133a75a-04e8-485f-b727-6aaedd519140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:22.977743 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133a75a-04e8-485f-b727-6aaedd519140 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:22.978549 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133a75a-04e8-485f-b727-6aaedd519140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:22.981660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133a75a-04e8-485f-b727-6aaedd519140 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:23.085740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 936/1869] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:22 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:23.090152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ee4f9-bdd1-41dc-a1cd-5fc03859eb9d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:23.106774 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ee4f9-bdd1-41dc-a1cd-5fc03859eb9d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:23.112934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475a226-29b3-4057-bc75-17f91816afd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:23.113688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475a226-29b3-4057-bc75-17f91816afd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:23.113978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475a226-29b3-4057-bc75-17f91816afd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:23.114258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475a226-29b3-4057-bc75-17f91816afd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:23.115731 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475a226-29b3-4057-bc75-17f91816afd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:23.117697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475a226-29b3-4057-bc75-17f91816afd0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:23.130059 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 934/1870] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:23.134335 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133a75a-04e8-485f-b727-6aaedd519140 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:23.145373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133a75a-04e8-485f-b727-6aaedd519140 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:23.155043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62b48b-93bd-4323-a0f9-1714e5f4b6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:23.155835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62b48b-93bd-4323-a0f9-1714e5f4b6bb admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:23.156127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62b48b-93bd-4323-a0f9-1714e5f4b6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:23.156408 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62b48b-93bd-4323-a0f9-1714e5f4b6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:23.157272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62b48b-93bd-4323-a0f9-1714e5f4b6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:23.158971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62b48b-93bd-4323-a0f9-1714e5f4b6bb admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:23.171699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 937/1871] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:23.175795 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475a226-29b3-4057-bc75-17f91816afd0 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:23.188978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475a226-29b3-4057-bc75-17f91816afd0 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:23.194140 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cc340-f886-46c9-ab1c-c21f948e929c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:23.194950 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cc340-f886-46c9-ab1c-c21f948e929c admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:23.195252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cc340-f886-46c9-ab1c-c21f948e929c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:23.195625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cc340-f886-46c9-ab1c-c21f948e929c admin admin] PATH_INFO: `/v3/projects/8cb9a0a06da241ffa8d2b24286a67328/users/dae20bc5a67d42ecbe20532b8afd31e5/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:23.222218 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cc340-f886-46c9-ab1c-c21f948e929c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb9a0a06da241ffa8d2b24286a67328, user_id=dae20bc5a67d42ecbe20532b8afd31e5, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:23.226307 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cc340-f886-46c9-ab1c-c21f948e929c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:23.317513 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 935/1872] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:23 2022] PUT /identity/v3/projects/8cb9a0a06da241ffa8d2b24286a67328/users/dae20bc5a67d42ecbe20532b8afd31e5/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:23.318003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee40ff7-189e-4541-ae92-c33dd6c5bde3 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:23.318003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee40ff7-189e-4541-ae92-c33dd6c5bde3 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:23.318283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee40ff7-189e-4541-ae92-c33dd6c5bde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:23.373408 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-fee40ff7-189e-4541-ae92-c33dd6c5bde3 None None] MFA Rules not processed for user `dae20bc5a67d42ecbe20532b8afd31e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:23.374842 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-fee40ff7-189e-4541-ae92-c33dd6c5bde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:23.541634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 938/1873] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:23.548553 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cc340-f886-46c9-ab1c-c21f948e929c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:23.657270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cc340-f886-46c9-ab1c-c21f948e929c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:23.664191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6d7e9-00aa-4318-a6e9-c97a903e0d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:23.665438 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6d7e9-00aa-4318-a6e9-c97a903e0d18 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:23.665896 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6d7e9-00aa-4318-a6e9-c97a903e0d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:23.666340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6d7e9-00aa-4318-a6e9-c97a903e0d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:23.667109 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6d7e9-00aa-4318-a6e9-c97a903e0d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:23.670253 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6d7e9-00aa-4318-a6e9-c97a903e0d18 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:23.686056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:23.784059 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 936/1874] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:23 2022] POST /identity/v3/projects => generated 375 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:23.788349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee40ff7-189e-4541-ae92-c33dd6c5bde3 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:23.804157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee40ff7-189e-4541-ae92-c33dd6c5bde3 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:23.841323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:23.876360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105cc5d-13dc-4043-89bd-a51b3f55896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:23.877008 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105cc5d-13dc-4043-89bd-a51b3f55896a admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:23.877288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105cc5d-13dc-4043-89bd-a51b3f55896a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:23.877666 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105cc5d-13dc-4043-89bd-a51b3f55896a admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:23.878461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105cc5d-13dc-4043-89bd-a51b3f55896a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:23.881218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105cc5d-13dc-4043-89bd-a51b3f55896a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:23.980493 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 939/1875] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:23 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:23.984296 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6d7e9-00aa-4318-a6e9-c97a903e0d18 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:24.002384 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6d7e9-00aa-4318-a6e9-c97a903e0d18 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:24.008788 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11f8ce-71a7-4c69-8da2-6f95a9840f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:24.009568 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11f8ce-71a7-4c69-8da2-6f95a9840f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:24.009904 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11f8ce-71a7-4c69-8da2-6f95a9840f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:24.010190 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11f8ce-71a7-4c69-8da2-6f95a9840f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:24.011695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11f8ce-71a7-4c69-8da2-6f95a9840f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:24.013382 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11f8ce-71a7-4c69-8da2-6f95a9840f79 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:24.029860 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 937/1876] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:24.031555 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105cc5d-13dc-4043-89bd-a51b3f55896a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:24.044862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105cc5d-13dc-4043-89bd-a51b3f55896a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:24.054026 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac2da3-edd2-4725-be17-a7af3cfbf834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:24.060679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac2da3-edd2-4725-be17-a7af3cfbf834 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:24.060679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac2da3-edd2-4725-be17-a7af3cfbf834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:24.060679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac2da3-edd2-4725-be17-a7af3cfbf834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:24.060679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac2da3-edd2-4725-be17-a7af3cfbf834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:24.060679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac2da3-edd2-4725-be17-a7af3cfbf834 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:24.078826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 940/1877] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:24.080182 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11f8ce-71a7-4c69-8da2-6f95a9840f79 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:24.096564 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11f8ce-71a7-4c69-8da2-6f95a9840f79 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:24.102540 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7539d8-070a-4a7b-aaa0-946acc1965ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:24.103448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7539d8-070a-4a7b-aaa0-946acc1965ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:24.103795 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7539d8-070a-4a7b-aaa0-946acc1965ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:24.104105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7539d8-070a-4a7b-aaa0-946acc1965ca admin admin] PATH_INFO: `/v3/projects/899ab6e1c6b34fcfa2a5b1161d5ba6be/users/662a856e7dda45818c45a19839f97ec2/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:24.121702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7539d8-070a-4a7b-aaa0-946acc1965ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=899ab6e1c6b34fcfa2a5b1161d5ba6be, user_id=662a856e7dda45818c45a19839f97ec2, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:24.124712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7539d8-070a-4a7b-aaa0-946acc1965ca admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:24.232034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 938/1878] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:24 2022] PUT /identity/v3/projects/899ab6e1c6b34fcfa2a5b1161d5ba6be/users/662a856e7dda45818c45a19839f97ec2/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:24.242103 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b645b-3aa0-4490-9bf5-a445f0c37fbc None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:24.242417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b645b-3aa0-4490-9bf5-a445f0c37fbc None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:24.242741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b645b-3aa0-4490-9bf5-a445f0c37fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:24.279779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-817b645b-3aa0-4490-9bf5-a445f0c37fbc None None] MFA Rules not processed for user `662a856e7dda45818c45a19839f97ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:24.281037 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-817b645b-3aa0-4490-9bf5-a445f0c37fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:24.380675 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 941/1879] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:24.385054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7539d8-070a-4a7b-aaa0-946acc1965ca admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:24.519223 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7539d8-070a-4a7b-aaa0-946acc1965ca admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:24.524945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0a3c4-3e39-4585-a4e7-9889f8ed9531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:24.525865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0a3c4-3e39-4585-a4e7-9889f8ed9531 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:24.526346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0a3c4-3e39-4585-a4e7-9889f8ed9531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:24.527067 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0a3c4-3e39-4585-a4e7-9889f8ed9531 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:24.527769 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0a3c4-3e39-4585-a4e7-9889f8ed9531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:24.529799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0a3c4-3e39-4585-a4e7-9889f8ed9531 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:24.640074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 939/1880] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:24 2022] POST /identity/v3/projects => generated 377 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:32:24.641108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b645b-3aa0-4490-9bf5-a445f0c37fbc None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:24.654594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b645b-3aa0-4490-9bf5-a445f0c37fbc None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:24.757052 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0b596-cde2-4089-9669-50cc8b27cddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:24.771989 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0b596-cde2-4089-9669-50cc8b27cddb admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:24.771989 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0b596-cde2-4089-9669-50cc8b27cddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:24.771989 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0b596-cde2-4089-9669-50cc8b27cddb admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:24.771989 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0b596-cde2-4089-9669-50cc8b27cddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:24.771989 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0b596-cde2-4089-9669-50cc8b27cddb admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:24.842682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 942/1881] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:24 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:24.846900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0a3c4-3e39-4585-a4e7-9889f8ed9531 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:24.857848 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0a3c4-3e39-4585-a4e7-9889f8ed9531 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:24.865626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7638a-2088-47f0-92fb-a2ef3c1f32e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:24.866419 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7638a-2088-47f0-92fb-a2ef3c1f32e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:24.866795 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7638a-2088-47f0-92fb-a2ef3c1f32e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:24.867820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7638a-2088-47f0-92fb-a2ef3c1f32e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:24.867946 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7638a-2088-47f0-92fb-a2ef3c1f32e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:24.869778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7638a-2088-47f0-92fb-a2ef3c1f32e7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:24.882891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 940/1882] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:24.887665 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0b596-cde2-4089-9669-50cc8b27cddb admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:24.899229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0b596-cde2-4089-9669-50cc8b27cddb admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:24.905725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a05de7-c6f4-48c3-a8ee-14068f0cab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:24.906664 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a05de7-c6f4-48c3-a8ee-14068f0cab37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:24.907015 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a05de7-c6f4-48c3-a8ee-14068f0cab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:24.907372 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a05de7-c6f4-48c3-a8ee-14068f0cab37 admin admin] PATH_INFO: `/v3/projects/fc5d27a414c5473bac8fc506d612ae0b/users/37786b73b4a746d9a32820f288277988/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:24.937442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a05de7-c6f4-48c3-a8ee-14068f0cab37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5d27a414c5473bac8fc506d612ae0b, user_id=37786b73b4a746d9a32820f288277988, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:24.941295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a05de7-c6f4-48c3-a8ee-14068f0cab37 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:25.019925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 943/1883] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:24 2022] PUT /identity/v3/projects/fc5d27a414c5473bac8fc506d612ae0b/users/37786b73b4a746d9a32820f288277988/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:25.023996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7638a-2088-47f0-92fb-a2ef3c1f32e7 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:25.035454 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7638a-2088-47f0-92fb-a2ef3c1f32e7 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:25.103548 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec601c5d-3ce1-4b9f-ad5c-233096b16ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:25.104602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec601c5d-3ce1-4b9f-ad5c-233096b16ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:25.105057 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec601c5d-3ce1-4b9f-ad5c-233096b16ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:25.105496 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec601c5d-3ce1-4b9f-ad5c-233096b16ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:25.106644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec601c5d-3ce1-4b9f-ad5c-233096b16ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:25.108424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec601c5d-3ce1-4b9f-ad5c-233096b16ca3 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:25.123055 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 941/1884] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:25.124295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a05de7-c6f4-48c3-a8ee-14068f0cab37 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:25.133437 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:25.138468 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a05de7-c6f4-48c3-a8ee-14068f0cab37 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:25.144104 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177903b-0374-4bef-9909-e55b1ea03a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:25.144882 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177903b-0374-4bef-9909-e55b1ea03a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:25.145240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177903b-0374-4bef-9909-e55b1ea03a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:25.146399 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177903b-0374-4bef-9909-e55b1ea03a68 admin admin] PATH_INFO: `/v3/projects/fc5d27a414c5473bac8fc506d612ae0b/users/37786b73b4a746d9a32820f288277988/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:25.148585 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177903b-0374-4bef-9909-e55b1ea03a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5d27a414c5473bac8fc506d612ae0b, user_id=37786b73b4a746d9a32820f288277988, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:25.151153 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177903b-0374-4bef-9909-e55b1ea03a68 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:25.176731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 944/1885] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:25 2022] PUT /identity/v3/projects/fc5d27a414c5473bac8fc506d612ae0b/users/37786b73b4a746d9a32820f288277988/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:25.179192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4732-beb1-4c35-8376-69bf4e243ae1 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:25.179533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4732-beb1-4c35-8376-69bf4e243ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:25.179819 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4732-beb1-4c35-8376-69bf4e243ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:25.227656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8cdb4732-beb1-4c35-8376-69bf4e243ae1 None None] MFA Rules not processed for user `37786b73b4a746d9a32820f288277988`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:25.232045 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8cdb4732-beb1-4c35-8376-69bf4e243ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:25.247926 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:25.366662 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 942/1886] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:25.381639 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177903b-0374-4bef-9909-e55b1ea03a68 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:25.383610 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7177903b-0374-4bef-9909-e55b1ea03a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:25.477948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177903b-0374-4bef-9909-e55b1ea03a68 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:25.490668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e78c23-da6b-4638-b964-47bf05be8230 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:25.491577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e78c23-da6b-4638-b964-47bf05be8230 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:25.491927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e78c23-da6b-4638-b964-47bf05be8230 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:25.492680 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e78c23-da6b-4638-b964-47bf05be8230 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:25.619513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e78c23-da6b-4638-b964-47bf05be8230 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:25.623367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e78c23-da6b-4638-b964-47bf05be8230 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:25.651328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 945/1887] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:27.914663 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4732-beb1-4c35-8376-69bf4e243ae1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:27.916202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8cdb4732-beb1-4c35-8376-69bf4e243ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:27.929206 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4732-beb1-4c35-8376-69bf4e243ae1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:27.933119 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6995c-5f17-4a71-b079-a399417cc213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:27.933690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6995c-5f17-4a71-b079-a399417cc213 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:27.934220 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6995c-5f17-4a71-b079-a399417cc213 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:27.934483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6995c-5f17-4a71-b079-a399417cc213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:28.014314 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6995c-5f17-4a71-b079-a399417cc213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:28.015989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6995c-5f17-4a71-b079-a399417cc213 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:28.031793 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 943/1888] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:29.429048 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e78c23-da6b-4638-b964-47bf05be8230 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:29.438502 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e78c23-da6b-4638-b964-47bf05be8230 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:29.442342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79149219-95dd-4f21-a73a-94214dddfdb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:29.442964 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79149219-95dd-4f21-a73a-94214dddfdb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:29.443247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79149219-95dd-4f21-a73a-94214dddfdb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:29.443528 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79149219-95dd-4f21-a73a-94214dddfdb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:29.455329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79149219-95dd-4f21-a73a-94214dddfdb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:29.456751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79149219-95dd-4f21-a73a-94214dddfdb0 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:29.468586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 946/1889] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:34.106767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6995c-5f17-4a71-b079-a399417cc213 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:34.171034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6995c-5f17-4a71-b079-a399417cc213 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:34.175622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41143703-4e64-488a-a2ef-00ec13674fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:34.176392 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143703-4e64-488a-a2ef-00ec13674fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:34.176681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143703-4e64-488a-a2ef-00ec13674fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:34.176966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143703-4e64-488a-a2ef-00ec13674fe4 admin admin] PATH_INFO: `/v3/users/dae20bc5a67d42ecbe20532b8afd31e5` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:34.178346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41143703-4e64-488a-a2ef-00ec13674fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dae20bc5a67d42ecbe20532b8afd31e5)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:34.180280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41143703-4e64-488a-a2ef-00ec13674fe4 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:34.379157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-41143703-4e64-488a-a2ef-00ec13674fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dae20bc5a67d42ecbe20532b8afd31e5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:34.379995 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-41143703-4e64-488a-a2ef-00ec13674fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dae20bc5a67d42ecbe20532b8afd31e5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:34.381897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:34.495616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-41143703-4e64-488a-a2ef-00ec13674fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dae20bc5a67d42ecbe20532b8afd31e5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:34.508846 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-41143703-4e64-488a-a2ef-00ec13674fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dae20bc5a67d42ecbe20532b8afd31e5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:34.509577 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-41143703-4e64-488a-a2ef-00ec13674fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dae20bc5a67d42ecbe20532b8afd31e5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:34.522995 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 944/1890] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:34 2022] DELETE /identity/v3/users/dae20bc5a67d42ecbe20532b8afd31e5 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:34.528150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf98c8c-be05-4b68-8ea5-b66db2f761c9 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:34.528612 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf98c8c-be05-4b68-8ea5-b66db2f761c9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:34.528779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf98c8c-be05-4b68-8ea5-b66db2f761c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:34.548128 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-6cf98c8c-be05-4b68-8ea5-b66db2f761c9 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:34.549266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6cf98c8c-be05-4b68-8ea5-b66db2f761c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:34.607014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 947/1891] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:34.616716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41143703-4e64-488a-a2ef-00ec13674fe4 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:34.618209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-41143703-4e64-488a-a2ef-00ec13674fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:34.676009 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41143703-4e64-488a-a2ef-00ec13674fe4 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:34.679589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4eb2e7-4c5a-4408-8adb-e6288dcd271e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:34.680222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4eb2e7-4c5a-4408-8adb-e6288dcd271e service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:34.680497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4eb2e7-4c5a-4408-8adb-e6288dcd271e service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:34.682229 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4eb2e7-4c5a-4408-8adb-e6288dcd271e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:34.690437 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4eb2e7-4c5a-4408-8adb-e6288dcd271e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:34.691872 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4eb2e7-4c5a-4408-8adb-e6288dcd271e service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:34.701586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 945/1892] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:34.751362 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9a65d-d4df-40e0-87ae-dc417d3927a5 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:34.751644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9a65d-d4df-40e0-87ae-dc417d3927a5 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:34.751924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9a65d-d4df-40e0-87ae-dc417d3927a5 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:34.753287 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 948/1893] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jul 28 05:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:32:34.763775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f0c0e-2434-4e07-ae1e-91541eb9f5cb None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:34.764068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f0c0e-2434-4e07-ae1e-91541eb9f5cb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:34.764518 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f0c0e-2434-4e07-ae1e-91541eb9f5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:34.785720 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-0e4f0c0e-2434-4e07-ae1e-91541eb9f5cb None None] MFA Rules not processed for user `3aae5b2e7bf74805b04d01df47693ded`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:34.787022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0e4f0c0e-2434-4e07-ae1e-91541eb9f5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:34.856824 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 946/1894] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jul 28 05:32:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:34.883086 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9a65d-d4df-40e0-87ae-dc417d3927a5 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:34.885202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-0bb9a65d-d4df-40e0-87ae-dc417d3927a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:34.916030 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9a65d-d4df-40e0-87ae-dc417d3927a5 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:34.928958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1a501-016c-473a-8168-cef144702408 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aae5b2e7bf74805b04d01df47693ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:34.930950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1a501-016c-473a-8168-cef144702408 service placement] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:34.931401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1a501-016c-473a-8168-cef144702408 service placement] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:34.931697 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1a501-016c-473a-8168-cef144702408 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:34.945921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1a501-016c-473a-8168-cef144702408 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:34.948863 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1a501-016c-473a-8168-cef144702408 service placement] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:34.961172 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 949/1895] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:35.166473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f0c0e-2434-4e07-ae1e-91541eb9f5cb None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:35.169079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0e4f0c0e-2434-4e07-ae1e-91541eb9f5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:35.190837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f0c0e-2434-4e07-ae1e-91541eb9f5cb None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:35.197360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02ba70-8288-4a5f-8cb6-3d78d5716364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:35.197360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02ba70-8288-4a5f-8cb6-3d78d5716364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:35.197360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02ba70-8288-4a5f-8cb6-3d78d5716364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:35.197360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02ba70-8288-4a5f-8cb6-3d78d5716364 admin admin] PATH_INFO: `/v3/projects/8cb9a0a06da241ffa8d2b24286a67328` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:35.199163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02ba70-8288-4a5f-8cb6-3d78d5716364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cb9a0a06da241ffa8d2b24286a67328)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:35.201076 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02ba70-8288-4a5f-8cb6-3d78d5716364 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:35.344345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0f02ba70-8288-4a5f-8cb6-3d78d5716364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cb9a0a06da241ffa8d2b24286a67328', 'request_id': 'req-0f02ba70-8288-4a5f-8cb6-3d78d5716364'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:35.410265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0f02ba70-8288-4a5f-8cb6-3d78d5716364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cb9a0a06da241ffa8d2b24286a67328', 'request_id': 'req-0f02ba70-8288-4a5f-8cb6-3d78d5716364'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:35.415398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:35.423707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0f02ba70-8288-4a5f-8cb6-3d78d5716364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cb9a0a06da241ffa8d2b24286a67328', 'request_id': 'req-0f02ba70-8288-4a5f-8cb6-3d78d5716364'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:35.443934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0f02ba70-8288-4a5f-8cb6-3d78d5716364 admin admin] The token cache is being invalidate because project 8cb9a0a06da241ffa8d2b24286a67328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:35.444536 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0f02ba70-8288-4a5f-8cb6-3d78d5716364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:35.445745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0f02ba70-8288-4a5f-8cb6-3d78d5716364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:35.451762 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 947/1896] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:35 2022] DELETE /identity/v3/projects/8cb9a0a06da241ffa8d2b24286a67328 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:35.455919 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1a501-016c-473a-8168-cef144702408 service placement] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:35.467858 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1a501-016c-473a-8168-cef144702408 service placement] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:35.490327 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:35.534941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d526e25-7b94-4c92-86cd-868f36c810c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:35.535598 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d526e25-7b94-4c92-86cd-868f36c810c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:35.535883 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d526e25-7b94-4c92-86cd-868f36c810c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:35.536158 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d526e25-7b94-4c92-86cd-868f36c810c2 admin admin] PATH_INFO: `/v3/users/662a856e7dda45818c45a19839f97ec2` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:35.537461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d526e25-7b94-4c92-86cd-868f36c810c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=662a856e7dda45818c45a19839f97ec2)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:35.539826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d526e25-7b94-4c92-86cd-868f36c810c2 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:35.596047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa933f-ce2b-41b8-a3d5-d5c3d3a5fad9 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:35.596488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa933f-ce2b-41b8-a3d5-d5c3d3a5fad9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:35.596753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa933f-ce2b-41b8-a3d5-d5c3d3a5fad9 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:35.598397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 948/1897] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jul 28 05:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:32:35.607331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b061733-ea33-47af-9fed-8267d549d09d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:35.607732 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b061733-ea33-47af-9fed-8267d549d09d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:35.608131 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b061733-ea33-47af-9fed-8267d549d09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:35.628625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-0b061733-ea33-47af-9fed-8267d549d09d None None] MFA Rules not processed for user `3aae5b2e7bf74805b04d01df47693ded`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:35.630119 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0b061733-ea33-47af-9fed-8267d549d09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:35.710977 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 949/1898] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jul 28 05:32:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:32:35.724071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b061733-ea33-47af-9fed-8267d549d09d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:35.725514 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0b061733-ea33-47af-9fed-8267d549d09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:35.740864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b061733-ea33-47af-9fed-8267d549d09d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:35.746825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b378dc-e544-4325-ae33-f1acb9af2143 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aae5b2e7bf74805b04d01df47693ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:35.747449 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b378dc-e544-4325-ae33-f1acb9af2143 service placement] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:35.747735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b378dc-e544-4325-ae33-f1acb9af2143 service placement] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:35.748020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b378dc-e544-4325-ae33-f1acb9af2143 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:35.758038 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b378dc-e544-4325-ae33-f1acb9af2143 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:35.759611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b378dc-e544-4325-ae33-f1acb9af2143 service placement] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:35.770763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 950/1899] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:32:35.783704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-3d526e25-7b94-4c92-86cd-868f36c810c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662a856e7dda45818c45a19839f97ec2'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:35.784661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b378dc-e544-4325-ae33-f1acb9af2143 service placement] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:35.785234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-3d526e25-7b94-4c92-86cd-868f36c810c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662a856e7dda45818c45a19839f97ec2'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:35.786153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-62b378dc-e544-4325-ae33-f1acb9af2143 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:35.803484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b378dc-e544-4325-ae33-f1acb9af2143 service placement] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:35.808041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb7a16-08a7-4b61-9932-497bf8d1f124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:35.808684 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb7a16-08a7-4b61-9932-497bf8d1f124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:35.808968 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb7a16-08a7-4b61-9932-497bf8d1f124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:35.809243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb7a16-08a7-4b61-9932-497bf8d1f124 admin admin] PATH_INFO: `/v3/users/47bde6fbf26443b6afd62a671a5a6620` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:35.810462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb7a16-08a7-4b61-9932-497bf8d1f124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47bde6fbf26443b6afd62a671a5a6620)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:35.812435 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb7a16-08a7-4b61-9932-497bf8d1f124 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:35.883842 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-3d526e25-7b94-4c92-86cd-868f36c810c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662a856e7dda45818c45a19839f97ec2'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:35.891766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-3d526e25-7b94-4c92-86cd-868f36c810c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662a856e7dda45818c45a19839f97ec2'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:35.905634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-3d526e25-7b94-4c92-86cd-868f36c810c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662a856e7dda45818c45a19839f97ec2'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:35.912540 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 950/1900] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:35 2022] DELETE /identity/v3/users/662a856e7dda45818c45a19839f97ec2 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:36.070278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6ceb7a16-08a7-4b61-9932-497bf8d1f124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47bde6fbf26443b6afd62a671a5a6620'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:36.071015 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6ceb7a16-08a7-4b61-9932-497bf8d1f124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47bde6fbf26443b6afd62a671a5a6620'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:36.153109 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6ceb7a16-08a7-4b61-9932-497bf8d1f124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47bde6fbf26443b6afd62a671a5a6620'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:36.166427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6ceb7a16-08a7-4b61-9932-497bf8d1f124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47bde6fbf26443b6afd62a671a5a6620'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:36.167244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6ceb7a16-08a7-4b61-9932-497bf8d1f124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47bde6fbf26443b6afd62a671a5a6620'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:36.181765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 951/1901] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:35 2022] DELETE /identity/v3/users/47bde6fbf26443b6afd62a671a5a6620 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:36.432363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d526e25-7b94-4c92-86cd-868f36c810c2 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:36.432472 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb7a16-08a7-4b61-9932-497bf8d1f124 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:36.432570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-3d526e25-7b94-4c92-86cd-868f36c810c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:36.432644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6ceb7a16-08a7-4b61-9932-497bf8d1f124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:36.486956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:36.508035 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb7a16-08a7-4b61-9932-497bf8d1f124 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:36.513383 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4597f-52bc-413e-9325-4be888113cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:36.514212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4597f-52bc-413e-9325-4be888113cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:36.514501 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4597f-52bc-413e-9325-4be888113cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:36.514776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4597f-52bc-413e-9325-4be888113cce admin admin] PATH_INFO: `/v3/projects/899ab6e1c6b34fcfa2a5b1161d5ba6be` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:36.516020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4597f-52bc-413e-9325-4be888113cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=899ab6e1c6b34fcfa2a5b1161d5ba6be)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:36.518068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4597f-52bc-413e-9325-4be888113cce admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:36.518204 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d526e25-7b94-4c92-86cd-868f36c810c2 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:36.523054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:36.528504 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:36.528504 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:36.528504 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3 admin admin] PATH_INFO: `/v3/projects/8a73af8e42ce4297848ab4111d14c437` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:36.528504 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a73af8e42ce4297848ab4111d14c437)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:36.529028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:36.674571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:36.679916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8dd4597f-52bc-413e-9325-4be888113cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '899ab6e1c6b34fcfa2a5b1161d5ba6be', 'request_id': 'req-8dd4597f-52bc-413e-9325-4be888113cce'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:36.680952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a73af8e42ce4297848ab4111d14c437', 'request_id': 'req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:36.769706 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8dd4597f-52bc-413e-9325-4be888113cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '899ab6e1c6b34fcfa2a5b1161d5ba6be', 'request_id': 'req-8dd4597f-52bc-413e-9325-4be888113cce'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:36.777928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8dd4597f-52bc-413e-9325-4be888113cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '899ab6e1c6b34fcfa2a5b1161d5ba6be', 'request_id': 'req-8dd4597f-52bc-413e-9325-4be888113cce'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:36.789529 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8dd4597f-52bc-413e-9325-4be888113cce admin admin] The token cache is being invalidate because project 899ab6e1c6b34fcfa2a5b1161d5ba6be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:36.789820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8dd4597f-52bc-413e-9325-4be888113cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:36.790474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8dd4597f-52bc-413e-9325-4be888113cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:36.792712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 952/1902] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:36 2022] DELETE /identity/v3/projects/899ab6e1c6b34fcfa2a5b1161d5ba6be => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:36.796262 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4597f-52bc-413e-9325-4be888113cce admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:36.797654 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8dd4597f-52bc-413e-9325-4be888113cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:36.803676 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a73af8e42ce4297848ab4111d14c437', 'request_id': 'req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:36.813910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a73af8e42ce4297848ab4111d14c437', 'request_id': 'req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:36.826426 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3 admin admin] The token cache is being invalidate because project 8a73af8e42ce4297848ab4111d14c437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:36.826713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:36.827356 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:36.829536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 951/1903] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:36 2022] DELETE /identity/v3/projects/8a73af8e42ce4297848ab4111d14c437 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:36.835473 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:36.836847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:36.863228 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4597f-52bc-413e-9325-4be888113cce admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:36.910373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2ed3f-5008-4a3f-a8e1-ff64733b5cf3 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:36.921182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc88104-daeb-4569-8aa6-cbbe2179680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:36.921879 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc88104-daeb-4569-8aa6-cbbe2179680e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:36.922195 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc88104-daeb-4569-8aa6-cbbe2179680e admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:36.922477 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc88104-daeb-4569-8aa6-cbbe2179680e admin admin] PATH_INFO: `/v3/users/8d005ff9284b4b2db6e1374f8273eb19` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:36.922689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1656b68-b887-43e6-9569-ae281b35eb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:36.923378 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1656b68-b887-43e6-9569-ae281b35eb9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:36.923661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1656b68-b887-43e6-9569-ae281b35eb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:36.923763 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc88104-daeb-4569-8aa6-cbbe2179680e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d005ff9284b4b2db6e1374f8273eb19)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:36.923938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1656b68-b887-43e6-9569-ae281b35eb9d admin admin] PATH_INFO: `/v3/users/37786b73b4a746d9a32820f288277988` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:36.925366 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1656b68-b887-43e6-9569-ae281b35eb9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=37786b73b4a746d9a32820f288277988)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:36.925711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc88104-daeb-4569-8aa6-cbbe2179680e admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:36.927500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1656b68-b887-43e6-9569-ae281b35eb9d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:37.092271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-acc88104-daeb-4569-8aa6-cbbe2179680e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d005ff9284b4b2db6e1374f8273eb19'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.093067 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-acc88104-daeb-4569-8aa6-cbbe2179680e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d005ff9284b4b2db6e1374f8273eb19'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.108909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f1656b68-b887-43e6-9569-ae281b35eb9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37786b73b4a746d9a32820f288277988'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.109594 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f1656b68-b887-43e6-9569-ae281b35eb9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37786b73b4a746d9a32820f288277988'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.147108 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:37.169809 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-acc88104-daeb-4569-8aa6-cbbe2179680e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d005ff9284b4b2db6e1374f8273eb19'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.179010 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-acc88104-daeb-4569-8aa6-cbbe2179680e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d005ff9284b4b2db6e1374f8273eb19'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.190602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-acc88104-daeb-4569-8aa6-cbbe2179680e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d005ff9284b4b2db6e1374f8273eb19'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.196509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 952/1904] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:36 2022] DELETE /identity/v3/users/8d005ff9284b4b2db6e1374f8273eb19 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:32:37.197280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc88104-daeb-4569-8aa6-cbbe2179680e admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:37.199265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-acc88104-daeb-4569-8aa6-cbbe2179680e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:37.251841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:37.265136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f1656b68-b887-43e6-9569-ae281b35eb9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37786b73b4a746d9a32820f288277988'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.275144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc88104-daeb-4569-8aa6-cbbe2179680e admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:37.276534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37ecf3-9ef1-41ea-896a-0895fe549487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:37.277217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37ecf3-9ef1-41ea-896a-0895fe549487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:37.277531 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37ecf3-9ef1-41ea-896a-0895fe549487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:37.277820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37ecf3-9ef1-41ea-896a-0895fe549487 admin admin] PATH_INFO: `/v3/users/e41db3e0a4cb482cb68ad10a652a10e8` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:37.279220 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37ecf3-9ef1-41ea-896a-0895fe549487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41db3e0a4cb482cb68ad10a652a10e8)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:37.281188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37ecf3-9ef1-41ea-896a-0895fe549487 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:37.287114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f1656b68-b887-43e6-9569-ae281b35eb9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37786b73b4a746d9a32820f288277988'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.287861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f1656b68-b887-43e6-9569-ae281b35eb9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37786b73b4a746d9a32820f288277988'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.301085 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 953/1905] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:36 2022] DELETE /identity/v3/users/37786b73b4a746d9a32820f288277988 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:37.456536 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1656b68-b887-43e6-9569-ae281b35eb9d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:37.458122 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f1656b68-b887-43e6-9569-ae281b35eb9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:37.506437 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5a37ecf3-9ef1-41ea-896a-0895fe549487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41db3e0a4cb482cb68ad10a652a10e8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.507151 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5a37ecf3-9ef1-41ea-896a-0895fe549487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41db3e0a4cb482cb68ad10a652a10e8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.562184 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1656b68-b887-43e6-9569-ae281b35eb9d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:37.569854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ab508-60d1-49e3-bfa7-c501c631c991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:37.570653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ab508-60d1-49e3-bfa7-c501c631c991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:37.571006 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ab508-60d1-49e3-bfa7-c501c631c991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:37.571359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ab508-60d1-49e3-bfa7-c501c631c991 admin admin] PATH_INFO: `/v3/projects/5fee5ccd0a2e4a6baa670eca18e3a4fc` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:37.572754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ab508-60d1-49e3-bfa7-c501c631c991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fee5ccd0a2e4a6baa670eca18e3a4fc)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:37.575153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ab508-60d1-49e3-bfa7-c501c631c991 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:37.581764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5a37ecf3-9ef1-41ea-896a-0895fe549487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41db3e0a4cb482cb68ad10a652a10e8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.598060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5a37ecf3-9ef1-41ea-896a-0895fe549487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41db3e0a4cb482cb68ad10a652a10e8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.630813 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5a37ecf3-9ef1-41ea-896a-0895fe549487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41db3e0a4cb482cb68ad10a652a10e8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.640001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 953/1906] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:37 2022] DELETE /identity/v3/users/e41db3e0a4cb482cb68ad10a652a10e8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:37.644332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96352fcb-5292-46d0-a85f-8c778fd4eb1d None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:37.644680 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96352fcb-5292-46d0-a85f-8c778fd4eb1d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:37.644972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96352fcb-5292-46d0-a85f-8c778fd4eb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:37.664939 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-96352fcb-5292-46d0-a85f-8c778fd4eb1d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:37.666456 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-96352fcb-5292-46d0-a85f-8c778fd4eb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:37.716796 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-064ab508-60d1-49e3-bfa7-c501c631c991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fee5ccd0a2e4a6baa670eca18e3a4fc', 'request_id': 'req-064ab508-60d1-49e3-bfa7-c501c631c991'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.730222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 954/1907] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:37.739886 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96352fcb-5292-46d0-a85f-8c778fd4eb1d None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:37.741256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-96352fcb-5292-46d0-a85f-8c778fd4eb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:37.804199 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96352fcb-5292-46d0-a85f-8c778fd4eb1d None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:37.810123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-064ab508-60d1-49e3-bfa7-c501c631c991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fee5ccd0a2e4a6baa670eca18e3a4fc', 'request_id': 'req-064ab508-60d1-49e3-bfa7-c501c631c991'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.819019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-064ab508-60d1-49e3-bfa7-c501c631c991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fee5ccd0a2e4a6baa670eca18e3a4fc', 'request_id': 'req-064ab508-60d1-49e3-bfa7-c501c631c991'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.829639 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:37.840330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-064ab508-60d1-49e3-bfa7-c501c631c991 admin admin] The token cache is being invalidate because project 5fee5ccd0a2e4a6baa670eca18e3a4fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:37.840655 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-064ab508-60d1-49e3-bfa7-c501c631c991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.841283 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-064ab508-60d1-49e3-bfa7-c501c631c991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:37.847192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 954/1908] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:37 2022] DELETE /identity/v3/projects/5fee5ccd0a2e4a6baa670eca18e3a4fc => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:32:37.847192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ab508-60d1-49e3-bfa7-c501c631c991 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:37.847192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-064ab508-60d1-49e3-bfa7-c501c631c991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:37.863867 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6637063-d0ed-4e84-9b06-9d09627e7071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:37.864501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6637063-d0ed-4e84-9b06-9d09627e7071 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:37.864794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6637063-d0ed-4e84-9b06-9d09627e7071 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:37.865074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6637063-d0ed-4e84-9b06-9d09627e7071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:37.866857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f6637063-d0ed-4e84-9b06-9d09627e7071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:37.879078 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:37.913981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ab508-60d1-49e3-bfa7-c501c631c991 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:37.919579 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629527a-29bd-4757-b6a1-26b89d1ef395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:37.920285 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629527a-29bd-4757-b6a1-26b89d1ef395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:37.920658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629527a-29bd-4757-b6a1-26b89d1ef395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:37.920944 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629527a-29bd-4757-b6a1-26b89d1ef395 admin admin] PATH_INFO: `/v3/projects/fc5d27a414c5473bac8fc506d612ae0b` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:37.922134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629527a-29bd-4757-b6a1-26b89d1ef395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5d27a414c5473bac8fc506d612ae0b)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:37.924205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629527a-29bd-4757-b6a1-26b89d1ef395 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:37.931355 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6637063-d0ed-4e84-9b06-9d09627e7071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:37.933495 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6637063-d0ed-4e84-9b06-9d09627e7071 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:37.943568 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 955/1909] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:32:37.944988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14253c76-b239-48c9-9367-902fc6bc1cd8 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:37.945392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14253c76-b239-48c9-9367-902fc6bc1cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:37.945663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14253c76-b239-48c9-9367-902fc6bc1cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:37.966539 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-14253c76-b239-48c9-9367-902fc6bc1cd8 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:37.967799 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-14253c76-b239-48c9-9367-902fc6bc1cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:37.976062 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 956/1910] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:37.985943 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c2a5e-3408-4420-92f8-0911d363a18b None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:37.986234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c2a5e-3408-4420-92f8-0911d363a18b None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:37.986533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c2a5e-3408-4420-92f8-0911d363a18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.006781 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e39c2a5e-3408-4420-92f8-0911d363a18b None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:38.008010 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e39c2a5e-3408-4420-92f8-0911d363a18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:38.017697 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 957/1911] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:32:38.021981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c2a5e-3408-4420-92f8-0911d363a18b None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:38.030547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1629527a-29bd-4757-b6a1-26b89d1ef395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5d27a414c5473bac8fc506d612ae0b', 'request_id': 'req-1629527a-29bd-4757-b6a1-26b89d1ef395'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:38.033794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c2a5e-3408-4420-92f8-0911d363a18b None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:38.095943 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f56fa-9af8-4b58-af48-17478cafec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:38.096571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f56fa-9af8-4b58-af48-17478cafec19 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.096855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f56fa-9af8-4b58-af48-17478cafec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.097134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f56fa-9af8-4b58-af48-17478cafec19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.097861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f56fa-9af8-4b58-af48-17478cafec19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:32:38.098174 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f56fa-9af8-4b58-af48-17478cafec19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:38.099850 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f56fa-9af8-4b58-af48-17478cafec19 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:38.111201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 958/1912] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:32:38.115385 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f56fa-9af8-4b58-af48-17478cafec19 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:38.124940 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f56fa-9af8-4b58-af48-17478cafec19 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:38.129560 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0afdb-b6cd-4882-881d-014c1989c4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:38.130136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0afdb-b6cd-4882-881d-014c1989c4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.130419 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0afdb-b6cd-4882-881d-014c1989c4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.130695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0afdb-b6cd-4882-881d-014c1989c4a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.131343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0afdb-b6cd-4882-881d-014c1989c4a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:38.133172 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0afdb-b6cd-4882-881d-014c1989c4a0 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:38.152762 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1629527a-29bd-4757-b6a1-26b89d1ef395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5d27a414c5473bac8fc506d612ae0b', 'request_id': 'req-1629527a-29bd-4757-b6a1-26b89d1ef395'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:38.159434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1629527a-29bd-4757-b6a1-26b89d1ef395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5d27a414c5473bac8fc506d612ae0b', 'request_id': 'req-1629527a-29bd-4757-b6a1-26b89d1ef395'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:38.169647 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1629527a-29bd-4757-b6a1-26b89d1ef395 admin admin] The token cache is being invalidate because project fc5d27a414c5473bac8fc506d612ae0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:38.169938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1629527a-29bd-4757-b6a1-26b89d1ef395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:38.170581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-1629527a-29bd-4757-b6a1-26b89d1ef395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:38.172114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 955/1913] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:37 2022] DELETE /identity/v3/projects/fc5d27a414c5473bac8fc506d612ae0b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:38.176716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32033309-acf7-4a5b-b4c3-52caa1daefae None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.177004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32033309-acf7-4a5b-b4c3-52caa1daefae None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.177283 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32033309-acf7-4a5b-b4c3-52caa1daefae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.196762 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-32033309-acf7-4a5b-b4c3-52caa1daefae None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:38.198405 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-32033309-acf7-4a5b-b4c3-52caa1daefae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:38.206883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 956/1914] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:38.215177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9c30b-4233-461f-95c3-a2dceae1a7f2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.215890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9c30b-4233-461f-95c3-a2dceae1a7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.215890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9c30b-4233-461f-95c3-a2dceae1a7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.236093 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3be9c30b-4233-461f-95c3-a2dceae1a7f2 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:38.237378 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3be9c30b-4233-461f-95c3-a2dceae1a7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:38.241518 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 959/1915] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:38 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:32:38.245972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 957/1916] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:32:38.246112 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0afdb-b6cd-4882-881d-014c1989c4a0 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:38.247693 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-91c0afdb-b6cd-4882-881d-014c1989c4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:38.249960 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9c30b-4233-461f-95c3-a2dceae1a7f2 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:38.259705 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9c30b-4233-461f-95c3-a2dceae1a7f2 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:38.289273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:38.324709 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0afdb-b6cd-4882-881d-014c1989c4a0 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:38.330025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f895e4-4ad2-491a-b319-88cddd474b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:38.330671 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f895e4-4ad2-491a-b319-88cddd474b22 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.330945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f895e4-4ad2-491a-b319-88cddd474b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.331223 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f895e4-4ad2-491a-b319-88cddd474b22 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.331528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39e1f8-edd7-46c1-b65c-c35badf337f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:38.331980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f895e4-4ad2-491a-b319-88cddd474b22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:38.332289 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39e1f8-edd7-46c1-b65c-c35badf337f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.332578 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39e1f8-edd7-46c1-b65c-c35badf337f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.332854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39e1f8-edd7-46c1-b65c-c35badf337f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.333756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39e1f8-edd7-46c1-b65c-c35badf337f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:32:38.334359 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f895e4-4ad2-491a-b319-88cddd474b22 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:38.334468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39e1f8-edd7-46c1-b65c-c35badf337f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:38.335640 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39e1f8-edd7-46c1-b65c-c35badf337f5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:38.350363 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 958/1917] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:32:38.354979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39e1f8-edd7-46c1-b65c-c35badf337f5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:38.364740 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39e1f8-edd7-46c1-b65c-c35badf337f5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:38.369914 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fac073-15ce-4a53-a5e6-69354a1003e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:38.370531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fac073-15ce-4a53-a5e6-69354a1003e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.370816 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fac073-15ce-4a53-a5e6-69354a1003e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.371091 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fac073-15ce-4a53-a5e6-69354a1003e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.371749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fac073-15ce-4a53-a5e6-69354a1003e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:38.373662 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fac073-15ce-4a53-a5e6-69354a1003e5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:38.438912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 960/1918] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:38 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:32:38.442643 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f895e4-4ad2-491a-b319-88cddd474b22 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:38.449927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-a2f895e4-4ad2-491a-b319-88cddd474b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:38.459197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f895e4-4ad2-491a-b319-88cddd474b22 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:38.464594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e2825-71cc-4164-a725-6603a5fb9a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:38.465635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e2825-71cc-4164-a725-6603a5fb9a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.465957 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e2825-71cc-4164-a725-6603a5fb9a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.466188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e2825-71cc-4164-a725-6603a5fb9a3b admin admin] PATH_INFO: `/v3/projects/d82b2965218e443b8f14ae34931d7be2` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.467576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e2825-71cc-4164-a725-6603a5fb9a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82b2965218e443b8f14ae34931d7be2)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:38.469426 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e2825-71cc-4164-a725-6603a5fb9a3b admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:38.486715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 959/1919] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:38 2022] POST /identity/v3/projects => generated 395 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:38.486715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fac073-15ce-4a53-a5e6-69354a1003e5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:38.507257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:38.553410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fac073-15ce-4a53-a5e6-69354a1003e5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:38.558656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccbdf4-43f2-4161-a520-73d667977131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:38.559281 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccbdf4-43f2-4161-a520-73d667977131 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.559563 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccbdf4-43f2-4161-a520-73d667977131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.559839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccbdf4-43f2-4161-a520-73d667977131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.560538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccbdf4-43f2-4161-a520-73d667977131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:38.562305 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccbdf4-43f2-4161-a520-73d667977131 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:38.573504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 960/1920] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:38.574112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccbdf4-43f2-4161-a520-73d667977131 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:38.587068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccbdf4-43f2-4161-a520-73d667977131 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:38.592562 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d17e2825-71cc-4164-a725-6603a5fb9a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82b2965218e443b8f14ae34931d7be2', 'request_id': 'req-d17e2825-71cc-4164-a725-6603a5fb9a3b'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:38.648311 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a08f17-36c0-40a2-ad3b-51de8e344318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:38.648947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a08f17-36c0-40a2-ad3b-51de8e344318 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.649230 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a08f17-36c0-40a2-ad3b-51de8e344318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.649537 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a08f17-36c0-40a2-ad3b-51de8e344318 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.650623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a08f17-36c0-40a2-ad3b-51de8e344318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:38.652869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a08f17-36c0-40a2-ad3b-51de8e344318 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:38.660830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d17e2825-71cc-4164-a725-6603a5fb9a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82b2965218e443b8f14ae34931d7be2', 'request_id': 'req-d17e2825-71cc-4164-a725-6603a5fb9a3b'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:38.669648 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d17e2825-71cc-4164-a725-6603a5fb9a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82b2965218e443b8f14ae34931d7be2', 'request_id': 'req-d17e2825-71cc-4164-a725-6603a5fb9a3b'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:38.683755 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d17e2825-71cc-4164-a725-6603a5fb9a3b admin admin] The token cache is being invalidate because project d82b2965218e443b8f14ae34931d7be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:38.683989 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d17e2825-71cc-4164-a725-6603a5fb9a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:38.688498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d17e2825-71cc-4164-a725-6603a5fb9a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:38.692328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 961/1921] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:38 2022] DELETE /identity/v3/projects/d82b2965218e443b8f14ae34931d7be2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:38.692328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e2825-71cc-4164-a725-6603a5fb9a3b admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:38.694047 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d17e2825-71cc-4164-a725-6603a5fb9a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:38.707774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e2825-71cc-4164-a725-6603a5fb9a3b admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:38.712820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73e721-a0cb-4a4d-9763-1fc415131aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:38.713686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73e721-a0cb-4a4d-9763-1fc415131aba admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.713978 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73e721-a0cb-4a4d-9763-1fc415131aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.714255 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73e721-a0cb-4a4d-9763-1fc415131aba admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.714957 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73e721-a0cb-4a4d-9763-1fc415131aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:38.716576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73e721-a0cb-4a4d-9763-1fc415131aba admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:38.727077 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 962/1922] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:38.728229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901f739-5880-497a-a43b-3004270d6f05 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.728462 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901f739-5880-497a-a43b-3004270d6f05 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.729257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901f739-5880-497a-a43b-3004270d6f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.752642 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-8901f739-5880-497a-a43b-3004270d6f05 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:38.753303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 961/1923] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:38 2022] POST /identity/v3/users => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:38.753401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-8901f739-5880-497a-a43b-3004270d6f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:38.756097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a08f17-36c0-40a2-ad3b-51de8e344318 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:38.761048 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 963/1924] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:38.768571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901f739-5880-497a-a43b-3004270d6f05 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:38.768571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-8901f739-5880-497a-a43b-3004270d6f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:38.768770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a08f17-36c0-40a2-ad3b-51de8e344318 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:38.770138 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a53a68-fc88-41d6-af36-553b72bdf993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:38.770930 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a53a68-fc88-41d6-af36-553b72bdf993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.771313 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a53a68-fc88-41d6-af36-553b72bdf993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.771600 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a53a68-fc88-41d6-af36-553b72bdf993 admin admin] PATH_INFO: `/v3/projects/9df2539bb0734dce94d754f6fd8da9e3/users/2da56b86ea064a7c9a005420c5ddf81e/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.777450 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901f739-5880-497a-a43b-3004270d6f05 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:38.782360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ffaec-573b-4ab0-82fd-87d032283ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:38.783143 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ffaec-573b-4ab0-82fd-87d032283ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.783415 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ffaec-573b-4ab0-82fd-87d032283ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.783691 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ffaec-573b-4ab0-82fd-87d032283ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.784403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ffaec-573b-4ab0-82fd-87d032283ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:38.786120 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ffaec-573b-4ab0-82fd-87d032283ff7 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:38.788529 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a53a68-fc88-41d6-af36-553b72bdf993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df2539bb0734dce94d754f6fd8da9e3, user_id=2da56b86ea064a7c9a005420c5ddf81e, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:38.792832 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a53a68-fc88-41d6-af36-553b72bdf993 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:38.801627 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 964/1925] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:38.801627 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986ff4-4cdf-4e05-8fc5-e0f2dcfed001 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.801627 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986ff4-4cdf-4e05-8fc5-e0f2dcfed001 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.801627 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986ff4-4cdf-4e05-8fc5-e0f2dcfed001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.821061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e4986ff4-4cdf-4e05-8fc5-e0f2dcfed001 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:38.822446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e4986ff4-4cdf-4e05-8fc5-e0f2dcfed001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:38.830573 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 965/1926] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:38.831398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4986ff4-4cdf-4e05-8fc5-e0f2dcfed001 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:38.841366 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4986ff4-4cdf-4e05-8fc5-e0f2dcfed001 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:38.846093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb2e61-8f39-4ffe-ae97-dfab7ebcf5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:38.846731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb2e61-8f39-4ffe-ae97-dfab7ebcf5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.847056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb2e61-8f39-4ffe-ae97-dfab7ebcf5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.847329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb2e61-8f39-4ffe-ae97-dfab7ebcf5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.848025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb2e61-8f39-4ffe-ae97-dfab7ebcf5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:38.849700 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb2e61-8f39-4ffe-ae97-dfab7ebcf5e4 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:38.861646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 966/1927] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:38.861646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb2e61-8f39-4ffe-ae97-dfab7ebcf5e4 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:38.863139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 962/1928] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:38 2022] PUT /identity/v3/projects/9df2539bb0734dce94d754f6fd8da9e3/users/2da56b86ea064a7c9a005420c5ddf81e/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:38.870531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a53a68-fc88-41d6-af36-553b72bdf993 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:38.871421 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb2e61-8f39-4ffe-ae97-dfab7ebcf5e4 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:38.935185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ea3e1-0b7f-496c-9bd3-c31ddabffa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:38.935851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ea3e1-0b7f-496c-9bd3-c31ddabffa25 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.936144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ea3e1-0b7f-496c-9bd3-c31ddabffa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.936441 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ea3e1-0b7f-496c-9bd3-c31ddabffa25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.937118 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ea3e1-0b7f-496c-9bd3-c31ddabffa25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:32:38.937428 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ea3e1-0b7f-496c-9bd3-c31ddabffa25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:38.939060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ea3e1-0b7f-496c-9bd3-c31ddabffa25 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:38.940606 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:38.946733 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a53a68-fc88-41d6-af36-553b72bdf993 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:38.951755 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c20f80-ce44-4165-b116-0a158e7eaa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:38.952137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 967/1929] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:32:38.952368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c20f80-ce44-4165-b116-0a158e7eaa1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.952645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c20f80-ce44-4165-b116-0a158e7eaa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.952925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c20f80-ce44-4165-b116-0a158e7eaa1d admin admin] PATH_INFO: `/v3/projects/9b02c30c9f804a42844fda865d90248d/users/a00f25c6af344722ac08e52cd91f1fe9/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.953456 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706109cc-3a21-4d8c-920d-2ea7f72bb6ab None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:38.953781 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706109cc-3a21-4d8c-920d-2ea7f72bb6ab None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:38.954056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706109cc-3a21-4d8c-920d-2ea7f72bb6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:38.971317 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c20f80-ce44-4165-b116-0a158e7eaa1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b02c30c9f804a42844fda865d90248d, user_id=a00f25c6af344722ac08e52cd91f1fe9, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:38.974138 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c20f80-ce44-4165-b116-0a158e7eaa1d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:38.982741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-706109cc-3a21-4d8c-920d-2ea7f72bb6ab None None] MFA Rules not processed for user `2da56b86ea064a7c9a005420c5ddf81e`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:38.984006 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-706109cc-3a21-4d8c-920d-2ea7f72bb6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:39.052473 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 968/1930] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:39.053603 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706109cc-3a21-4d8c-920d-2ea7f72bb6ab None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:39.065389 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706109cc-3a21-4d8c-920d-2ea7f72bb6ab None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:39.067869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 963/1931] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:38 2022] PUT /identity/v3/projects/9b02c30c9f804a42844fda865d90248d/users/a00f25c6af344722ac08e52cd91f1fe9/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:39.077287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c20f80-ce44-4165-b116-0a158e7eaa1d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:39.079712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a2c20f80-ce44-4165-b116-0a158e7eaa1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:39.085317 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:39.136593 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d80c81-6e50-44d7-b87c-6701443c85ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:39.137291 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d80c81-6e50-44d7-b87c-6701443c85ee admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:39.137642 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d80c81-6e50-44d7-b87c-6701443c85ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:39.137925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d80c81-6e50-44d7-b87c-6701443c85ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:39.138609 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d80c81-6e50-44d7-b87c-6701443c85ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:39.140817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d80c81-6e50-44d7-b87c-6701443c85ee admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:39.142560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c20f80-ce44-4165-b116-0a158e7eaa1d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:39.146346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88e384-9779-4124-a78c-6c097bb5132f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:39.146971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88e384-9779-4124-a78c-6c097bb5132f service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:39.147253 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88e384-9779-4124-a78c-6c097bb5132f service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:39.147523 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88e384-9779-4124-a78c-6c097bb5132f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:39.209395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88e384-9779-4124-a78c-6c097bb5132f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:39.210765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88e384-9779-4124-a78c-6c097bb5132f service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:39.220916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 964/1932] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:39.222228 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb8287-bfa4-4858-9ea2-6d31e2736c79 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:39.222998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb8287-bfa4-4858-9ea2-6d31e2736c79 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:39.223333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb8287-bfa4-4858-9ea2-6d31e2736c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:39.227299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 969/1933] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:39 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:39.232452 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d80c81-6e50-44d7-b87c-6701443c85ee admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:39.261096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-23cb8287-bfa4-4858-9ea2-6d31e2736c79 None None] MFA Rules not processed for user `a00f25c6af344722ac08e52cd91f1fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:39.261096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-23cb8287-bfa4-4858-9ea2-6d31e2736c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:39.300595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d80c81-6e50-44d7-b87c-6701443c85ee admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:39.306234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b60a5b-a9b3-47d7-89f0-e1508f95762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:39.307145 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b60a5b-a9b3-47d7-89f0-e1508f95762a admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:39.307961 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b60a5b-a9b3-47d7-89f0-e1508f95762a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:39.307961 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b60a5b-a9b3-47d7-89f0-e1508f95762a admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:39.308362 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b60a5b-a9b3-47d7-89f0-e1508f95762a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:39.310318 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b60a5b-a9b3-47d7-89f0-e1508f95762a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:39.340211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 965/1934] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:39.351888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb8287-bfa4-4858-9ea2-6d31e2736c79 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:39.353319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-23cb8287-bfa4-4858-9ea2-6d31e2736c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:39.398879 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:39.406106 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 970/1935] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:39 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:32:39.409942 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b60a5b-a9b3-47d7-89f0-e1508f95762a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:39.411169 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:39.417130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb8287-bfa4-4858-9ea2-6d31e2736c79 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:39.420954 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b60a5b-a9b3-47d7-89f0-e1508f95762a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:39.421129 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac12d74-855e-4215-bd8e-c0a10e02b101 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:39.422005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac12d74-855e-4215-bd8e-c0a10e02b101 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:39.422227 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac12d74-855e-4215-bd8e-c0a10e02b101 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:39.422494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac12d74-855e-4215-bd8e-c0a10e02b101 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:39.427913 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e405b-9503-4a26-9a6b-9c7ddbade5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:39.428536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e405b-9503-4a26-9a6b-9c7ddbade5cd admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:39.428823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e405b-9503-4a26-9a6b-9c7ddbade5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:39.429102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e405b-9503-4a26-9a6b-9c7ddbade5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:39.429898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e405b-9503-4a26-9a6b-9c7ddbade5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:39.431590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e405b-9503-4a26-9a6b-9c7ddbade5cd admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:39.432340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac12d74-855e-4215-bd8e-c0a10e02b101 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:39.433910 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac12d74-855e-4215-bd8e-c0a10e02b101 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:39.443551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 966/1936] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:32:39.447085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 971/1937] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:32:39.448879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac12d74-855e-4215-bd8e-c0a10e02b101 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:39.460212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac12d74-855e-4215-bd8e-c0a10e02b101 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:39.465690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35b5fc-b46f-43f7-8974-0d843f448237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:39.466305 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35b5fc-b46f-43f7-8974-0d843f448237 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:39.466651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35b5fc-b46f-43f7-8974-0d843f448237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:39.466873 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35b5fc-b46f-43f7-8974-0d843f448237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:39.467568 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35b5fc-b46f-43f7-8974-0d843f448237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:39.469902 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35b5fc-b46f-43f7-8974-0d843f448237 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:39.483926 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 967/1938] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:39.485186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e405b-9503-4a26-9a6b-9c7ddbade5cd admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:39.496104 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e405b-9503-4a26-9a6b-9c7ddbade5cd admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:39.501234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d998e5-2502-4417-9cbf-050f57ea7c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:39.501896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d998e5-2502-4417-9cbf-050f57ea7c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:39.502184 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d998e5-2502-4417-9cbf-050f57ea7c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:39.502820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d998e5-2502-4417-9cbf-050f57ea7c84 admin admin] PATH_INFO: `/v3/projects/248fcc4b767c4f4aa268756e244443e0/users/5cffe4065aa4479f8bc6d202a9a00063/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:39.519901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d998e5-2502-4417-9cbf-050f57ea7c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248fcc4b767c4f4aa268756e244443e0, user_id=5cffe4065aa4479f8bc6d202a9a00063, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:39.522705 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d998e5-2502-4417-9cbf-050f57ea7c84 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:39.616151 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 972/1939] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:39 2022] PUT /identity/v3/projects/248fcc4b767c4f4aa268756e244443e0/users/5cffe4065aa4479f8bc6d202a9a00063/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:39.627579 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631ff64-44db-4d41-aa49-da806e128216 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:39.628128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631ff64-44db-4d41-aa49-da806e128216 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:39.628585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631ff64-44db-4d41-aa49-da806e128216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:39.660017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6631ff64-44db-4d41-aa49-da806e128216 None None] MFA Rules not processed for user `5cffe4065aa4479f8bc6d202a9a00063`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:39.661228 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6631ff64-44db-4d41-aa49-da806e128216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:39.730897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 968/1940] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:39.749209 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d998e5-2502-4417-9cbf-050f57ea7c84 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:39.804466 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d998e5-2502-4417-9cbf-050f57ea7c84 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:39.809181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2bcc0-2db6-43b1-897a-a826c44563b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:39.809852 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2bcc0-2db6-43b1-897a-a826c44563b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:39.810126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2bcc0-2db6-43b1-897a-a826c44563b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:39.810398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2bcc0-2db6-43b1-897a-a826c44563b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:39.818730 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2bcc0-2db6-43b1-897a-a826c44563b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:39.820126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2bcc0-2db6-43b1-897a-a826c44563b3 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:39.829229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 973/1941] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:43.029002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631ff64-44db-4d41-aa49-da806e128216 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:43.091264 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631ff64-44db-4d41-aa49-da806e128216 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:43.095829 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02423dd5-d1ec-462c-ae1b-590d9bf2b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:43.096474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02423dd5-d1ec-462c-ae1b-590d9bf2b754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:43.096756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02423dd5-d1ec-462c-ae1b-590d9bf2b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:43.097029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02423dd5-d1ec-462c-ae1b-590d9bf2b754 admin admin] PATH_INFO: `/v3/users/2da56b86ea064a7c9a005420c5ddf81e` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:43.098223 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02423dd5-d1ec-462c-ae1b-590d9bf2b754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2da56b86ea064a7c9a005420c5ddf81e)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:43.100126 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02423dd5-d1ec-462c-ae1b-590d9bf2b754 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:43.264470 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-02423dd5-d1ec-462c-ae1b-590d9bf2b754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2da56b86ea064a7c9a005420c5ddf81e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:43.265140 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-02423dd5-d1ec-462c-ae1b-590d9bf2b754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2da56b86ea064a7c9a005420c5ddf81e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:43.340492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-02423dd5-d1ec-462c-ae1b-590d9bf2b754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2da56b86ea064a7c9a005420c5ddf81e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:43.352432 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:43.354159 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-02423dd5-d1ec-462c-ae1b-590d9bf2b754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2da56b86ea064a7c9a005420c5ddf81e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:43.354802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-02423dd5-d1ec-462c-ae1b-590d9bf2b754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2da56b86ea064a7c9a005420c5ddf81e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:43.366864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 969/1942] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:43 2022] DELETE /identity/v3/users/2da56b86ea064a7c9a005420c5ddf81e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:43.371391 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cb9a5-8a1e-4bda-b54a-4ac1cf714aa6 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:43.371850 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cb9a5-8a1e-4bda-b54a-4ac1cf714aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:43.371940 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cb9a5-8a1e-4bda-b54a-4ac1cf714aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:43.392166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-472cb9a5-8a1e-4bda-b54a-4ac1cf714aa6 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:43.393458 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-472cb9a5-8a1e-4bda-b54a-4ac1cf714aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:43.454877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 974/1943] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:43.465228 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02423dd5-d1ec-462c-ae1b-590d9bf2b754 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:43.466954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-02423dd5-d1ec-462c-ae1b-590d9bf2b754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:43.526251 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02423dd5-d1ec-462c-ae1b-590d9bf2b754 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:43.529942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574ee61-0b61-44a7-bd35-427a401315c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:43.530582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ee61-0b61-44a7-bd35-427a401315c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:43.530866 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ee61-0b61-44a7-bd35-427a401315c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:43.531144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ee61-0b61-44a7-bd35-427a401315c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:43.540716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574ee61-0b61-44a7-bd35-427a401315c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:43.542346 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574ee61-0b61-44a7-bd35-427a401315c9 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:43.552593 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 970/1944] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:43.959714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cb9a5-8a1e-4bda-b54a-4ac1cf714aa6 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:43.961259 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-472cb9a5-8a1e-4bda-b54a-4ac1cf714aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:43.973438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cb9a5-8a1e-4bda-b54a-4ac1cf714aa6 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:43.978956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627389ea-8361-4cc1-ad65-db38ad2c1759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:43.979920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627389ea-8361-4cc1-ad65-db38ad2c1759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:43.980202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627389ea-8361-4cc1-ad65-db38ad2c1759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:43.980479 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627389ea-8361-4cc1-ad65-db38ad2c1759 admin admin] PATH_INFO: `/v3/projects/9df2539bb0734dce94d754f6fd8da9e3` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:43.981716 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627389ea-8361-4cc1-ad65-db38ad2c1759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df2539bb0734dce94d754f6fd8da9e3)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:43.983705 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627389ea-8361-4cc1-ad65-db38ad2c1759 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:44.095834 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-627389ea-8361-4cc1-ad65-db38ad2c1759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df2539bb0734dce94d754f6fd8da9e3', 'request_id': 'req-627389ea-8361-4cc1-ad65-db38ad2c1759'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:44.163632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-627389ea-8361-4cc1-ad65-db38ad2c1759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df2539bb0734dce94d754f6fd8da9e3', 'request_id': 'req-627389ea-8361-4cc1-ad65-db38ad2c1759'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:44.168563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:44.170906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-627389ea-8361-4cc1-ad65-db38ad2c1759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df2539bb0734dce94d754f6fd8da9e3', 'request_id': 'req-627389ea-8361-4cc1-ad65-db38ad2c1759'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:44.185375 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-627389ea-8361-4cc1-ad65-db38ad2c1759 admin admin] The token cache is being invalidate because project 9df2539bb0734dce94d754f6fd8da9e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:44.186088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-627389ea-8361-4cc1-ad65-db38ad2c1759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:44.187181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-627389ea-8361-4cc1-ad65-db38ad2c1759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:44.188700 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 975/1945] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:43 2022] DELETE /identity/v3/projects/9df2539bb0734dce94d754f6fd8da9e3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:44.193621 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d34f64-aff7-42e8-a21a-e4bac90917d8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:44.194102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d34f64-aff7-42e8-a21a-e4bac90917d8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:44.194203 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d34f64-aff7-42e8-a21a-e4bac90917d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:44.215916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-17d34f64-aff7-42e8-a21a-e4bac90917d8 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:44.217158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-17d34f64-aff7-42e8-a21a-e4bac90917d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:44.277434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 971/1946] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:44.285142 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec64739-b745-4e61-a7a8-2e34c1ae2ad0 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:44.285432 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec64739-b745-4e61-a7a8-2e34c1ae2ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:44.285772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec64739-b745-4e61-a7a8-2e34c1ae2ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:44.305393 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-9ec64739-b745-4e61-a7a8-2e34c1ae2ad0 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:44.306655 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9ec64739-b745-4e61-a7a8-2e34c1ae2ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:44.314728 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 976/1947] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:44.318950 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d34f64-aff7-42e8-a21a-e4bac90917d8 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:44.329598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d34f64-aff7-42e8-a21a-e4bac90917d8 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:44.334201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3c2a4-5db8-43f3-8706-830b8f973939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:44.334817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3c2a4-5db8-43f3-8706-830b8f973939 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:44.335100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3c2a4-5db8-43f3-8706-830b8f973939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:44.335373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3c2a4-5db8-43f3-8706-830b8f973939 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:44.336072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3c2a4-5db8-43f3-8706-830b8f973939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:32:44.336379 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3c2a4-5db8-43f3-8706-830b8f973939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:44.338665 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3c2a4-5db8-43f3-8706-830b8f973939 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:44.350334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 972/1948] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:32:44.354747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec64739-b745-4e61-a7a8-2e34c1ae2ad0 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:44.364145 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec64739-b745-4e61-a7a8-2e34c1ae2ad0 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:44.368734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346b8db-715c-4e9d-93ac-00e0bd4dc6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:44.369896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346b8db-715c-4e9d-93ac-00e0bd4dc6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:44.370174 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346b8db-715c-4e9d-93ac-00e0bd4dc6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:44.370446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346b8db-715c-4e9d-93ac-00e0bd4dc6c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:44.371111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346b8db-715c-4e9d-93ac-00e0bd4dc6c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:44.372981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346b8db-715c-4e9d-93ac-00e0bd4dc6c5 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:44.490624 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 977/1949] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:44 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:44.495547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3c2a4-5db8-43f3-8706-830b8f973939 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:44.505718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3c2a4-5db8-43f3-8706-830b8f973939 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:44.561257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2201a2-02e4-4c03-be59-3792f25db7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:44.561830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2201a2-02e4-4c03-be59-3792f25db7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:44.562113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2201a2-02e4-4c03-be59-3792f25db7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:44.562387 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2201a2-02e4-4c03-be59-3792f25db7f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:44.563055 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2201a2-02e4-4c03-be59-3792f25db7f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:44.564947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2201a2-02e4-4c03-be59-3792f25db7f5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:44.621517 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 973/1950] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:44 2022] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:32:44.625706 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346b8db-715c-4e9d-93ac-00e0bd4dc6c5 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:44.636866 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346b8db-715c-4e9d-93ac-00e0bd4dc6c5 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:44.641493 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f0ad7-afd7-49fc-aef3-bfe48f4644fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:44.642115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f0ad7-afd7-49fc-aef3-bfe48f4644fc admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:44.642398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f0ad7-afd7-49fc-aef3-bfe48f4644fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:44.645286 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f0ad7-afd7-49fc-aef3-bfe48f4644fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:44.645286 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f0ad7-afd7-49fc-aef3-bfe48f4644fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:44.645286 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f0ad7-afd7-49fc-aef3-bfe48f4644fc admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:44.656498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 978/1951] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:44.660552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2201a2-02e4-4c03-be59-3792f25db7f5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:44.671333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2201a2-02e4-4c03-be59-3792f25db7f5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:44.676039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4864a-8d74-4b4a-a3cf-35e38c173d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:44.676700 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4864a-8d74-4b4a-a3cf-35e38c173d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:44.677000 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4864a-8d74-4b4a-a3cf-35e38c173d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:44.677261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4864a-8d74-4b4a-a3cf-35e38c173d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:44.677997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4864a-8d74-4b4a-a3cf-35e38c173d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:44.679609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4864a-8d74-4b4a-a3cf-35e38c173d7b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:44.682641 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:44.691538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 974/1952] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:44.695923 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f0ad7-afd7-49fc-aef3-bfe48f4644fc admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:44.706970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f0ad7-afd7-49fc-aef3-bfe48f4644fc admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:44.711685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556578ee-b2c0-433a-9d3e-7cb416f76921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:44.712377 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556578ee-b2c0-433a-9d3e-7cb416f76921 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:44.712745 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556578ee-b2c0-433a-9d3e-7cb416f76921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:44.713059 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556578ee-b2c0-433a-9d3e-7cb416f76921 admin admin] PATH_INFO: `/v3/projects/0fafe3a7726844018a6c308f8acdbb49/users/02142b6537394571912b52f061aeb082/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:44.728809 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556578ee-b2c0-433a-9d3e-7cb416f76921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fafe3a7726844018a6c308f8acdbb49, user_id=02142b6537394571912b52f061aeb082, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:44.731784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556578ee-b2c0-433a-9d3e-7cb416f76921 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:44.820908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 979/1953] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:44 2022] PUT /identity/v3/projects/0fafe3a7726844018a6c308f8acdbb49/users/02142b6537394571912b52f061aeb082/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:44.826266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a19ec3-7bfc-4296-b8a4-8a7898aec8e5 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:44.826557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a19ec3-7bfc-4296-b8a4-8a7898aec8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:44.826837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a19ec3-7bfc-4296-b8a4-8a7898aec8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:44.845446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-03a19ec3-7bfc-4296-b8a4-8a7898aec8e5 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:44.846701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-03a19ec3-7bfc-4296-b8a4-8a7898aec8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:44.907738 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 975/1954] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:44.919092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556578ee-b2c0-433a-9d3e-7cb416f76921 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:44.920783 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-556578ee-b2c0-433a-9d3e-7cb416f76921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:44.976331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556578ee-b2c0-433a-9d3e-7cb416f76921 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:44.980603 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff283e34-70d8-4f2b-a6a3-7d78964a7a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:44.981223 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff283e34-70d8-4f2b-a6a3-7d78964a7a21 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:44.981531 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff283e34-70d8-4f2b-a6a3-7d78964a7a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:44.981812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff283e34-70d8-4f2b-a6a3-7d78964a7a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:44.990784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff283e34-70d8-4f2b-a6a3-7d78964a7a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:44.992199 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff283e34-70d8-4f2b-a6a3-7d78964a7a21 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:45.002241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 980/1955] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:46.507287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df704921-082a-4744-a422-170762fa5f20 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:46.507833 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df704921-082a-4744-a422-170762fa5f20 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:46.507833 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df704921-082a-4744-a422-170762fa5f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:46.536146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-df704921-082a-4744-a422-170762fa5f20 None None] MFA Rules not processed for user `02142b6537394571912b52f061aeb082`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:46.537462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-df704921-082a-4744-a422-170762fa5f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:46.606617 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 976/1956] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:46.617494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff283e34-70d8-4f2b-a6a3-7d78964a7a21 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:46.619020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ff283e34-70d8-4f2b-a6a3-7d78964a7a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:46.677187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff283e34-70d8-4f2b-a6a3-7d78964a7a21 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:46.680810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acb4a2-8f1b-47cb-98ed-29eba2935c53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:46.681485 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acb4a2-8f1b-47cb-98ed-29eba2935c53 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:46.681784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acb4a2-8f1b-47cb-98ed-29eba2935c53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:46.682060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acb4a2-8f1b-47cb-98ed-29eba2935c53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:46.690289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acb4a2-8f1b-47cb-98ed-29eba2935c53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:46.691704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acb4a2-8f1b-47cb-98ed-29eba2935c53 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:46.700609 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 981/1957] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:49.562683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fefc45-d7ca-44b2-bd4e-9ea19aca21e0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:49.563210 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fefc45-d7ca-44b2-bd4e-9ea19aca21e0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:49.563318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fefc45-d7ca-44b2-bd4e-9ea19aca21e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:49.585961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-23fefc45-d7ca-44b2-bd4e-9ea19aca21e0 None None] MFA Rules not processed for user `02142b6537394571912b52f061aeb082`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:49.587003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-23fefc45-d7ca-44b2-bd4e-9ea19aca21e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:49.595678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 977/1958] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:50.730914 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acb4a2-8f1b-47cb-98ed-29eba2935c53 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:50.732531 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c3acb4a2-8f1b-47cb-98ed-29eba2935c53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:50.747265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acb4a2-8f1b-47cb-98ed-29eba2935c53 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:50.752313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab798be-2163-4354-9c20-c6ebe6cd8091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:50.753025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab798be-2163-4354-9c20-c6ebe6cd8091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:50.753527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab798be-2163-4354-9c20-c6ebe6cd8091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:50.753976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab798be-2163-4354-9c20-c6ebe6cd8091 admin admin] PATH_INFO: `/v3/users/a00f25c6af344722ac08e52cd91f1fe9` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:50.755366 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab798be-2163-4354-9c20-c6ebe6cd8091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a00f25c6af344722ac08e52cd91f1fe9)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:50.757311 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab798be-2163-4354-9c20-c6ebe6cd8091 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:50.885572 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:51.003346 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-dab798be-2163-4354-9c20-c6ebe6cd8091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a00f25c6af344722ac08e52cd91f1fe9'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:51.004016 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-dab798be-2163-4354-9c20-c6ebe6cd8091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a00f25c6af344722ac08e52cd91f1fe9'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:51.094631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-dab798be-2163-4354-9c20-c6ebe6cd8091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a00f25c6af344722ac08e52cd91f1fe9'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:51.102835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-dab798be-2163-4354-9c20-c6ebe6cd8091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a00f25c6af344722ac08e52cd91f1fe9'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:51.114978 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-dab798be-2163-4354-9c20-c6ebe6cd8091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a00f25c6af344722ac08e52cd91f1fe9'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:51.121132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 982/1959] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:50 2022] DELETE /identity/v3/users/a00f25c6af344722ac08e52cd91f1fe9 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:51.126463 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ea0ec-092c-4515-8732-cb81e97727cc None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:51.126920 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ea0ec-092c-4515-8732-cb81e97727cc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:51.127025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ea0ec-092c-4515-8732-cb81e97727cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:51.150405 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-597ea0ec-092c-4515-8732-cb81e97727cc None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:51.151863 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-597ea0ec-092c-4515-8732-cb81e97727cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:51.216649 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 978/1960] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:51.226809 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab798be-2163-4354-9c20-c6ebe6cd8091 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:51.228253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-dab798be-2163-4354-9c20-c6ebe6cd8091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:51.288628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab798be-2163-4354-9c20-c6ebe6cd8091 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:51.292240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1af16a-fda1-44dd-b112-6a67d2b3add6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:51.292937 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1af16a-fda1-44dd-b112-6a67d2b3add6 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:51.293259 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1af16a-fda1-44dd-b112-6a67d2b3add6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:51.293900 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1af16a-fda1-44dd-b112-6a67d2b3add6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:51.303552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1af16a-fda1-44dd-b112-6a67d2b3add6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:51.304981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1af16a-fda1-44dd-b112-6a67d2b3add6 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:51.315188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 983/1961] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:52.024470 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ea0ec-092c-4515-8732-cb81e97727cc None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:52.025981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-597ea0ec-092c-4515-8732-cb81e97727cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:52.054744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ea0ec-092c-4515-8732-cb81e97727cc None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:52.065625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9d706-47b4-40df-8c32-4262f7a2d459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:52.065625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9d706-47b4-40df-8c32-4262f7a2d459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:52.065625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9d706-47b4-40df-8c32-4262f7a2d459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:52.065625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9d706-47b4-40df-8c32-4262f7a2d459 admin admin] PATH_INFO: `/v3/projects/9b02c30c9f804a42844fda865d90248d` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:52.067817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9d706-47b4-40df-8c32-4262f7a2d459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b02c30c9f804a42844fda865d90248d)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:52.070340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9d706-47b4-40df-8c32-4262f7a2d459 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:52.091117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:52.245182 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-66c9d706-47b4-40df-8c32-4262f7a2d459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b02c30c9f804a42844fda865d90248d', 'request_id': 'req-66c9d706-47b4-40df-8c32-4262f7a2d459'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:52.335269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-66c9d706-47b4-40df-8c32-4262f7a2d459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b02c30c9f804a42844fda865d90248d', 'request_id': 'req-66c9d706-47b4-40df-8c32-4262f7a2d459'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:52.342254 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-66c9d706-47b4-40df-8c32-4262f7a2d459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b02c30c9f804a42844fda865d90248d', 'request_id': 'req-66c9d706-47b4-40df-8c32-4262f7a2d459'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:52.353530 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-66c9d706-47b4-40df-8c32-4262f7a2d459 admin admin] The token cache is being invalidate because project 9b02c30c9f804a42844fda865d90248d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:52.353831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-66c9d706-47b4-40df-8c32-4262f7a2d459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:52.354493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-66c9d706-47b4-40df-8c32-4262f7a2d459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:52.357325 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 979/1962] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:52 2022] DELETE /identity/v3/projects/9b02c30c9f804a42844fda865d90248d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:53.346229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1af16a-fda1-44dd-b112-6a67d2b3add6 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:53.347763 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-bc1af16a-fda1-44dd-b112-6a67d2b3add6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:53.361070 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1af16a-fda1-44dd-b112-6a67d2b3add6 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:53.458259 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfba255-31ca-4ff3-bce1-76a4d9de49a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:53.459269 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfba255-31ca-4ff3-bce1-76a4d9de49a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:53.459764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfba255-31ca-4ff3-bce1-76a4d9de49a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:53.460261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfba255-31ca-4ff3-bce1-76a4d9de49a3 admin admin] PATH_INFO: `/v3/users/5cffe4065aa4479f8bc6d202a9a00063` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:53.462006 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfba255-31ca-4ff3-bce1-76a4d9de49a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cffe4065aa4479f8bc6d202a9a00063)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:53.464892 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfba255-31ca-4ff3-bce1-76a4d9de49a3 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:53.718594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-bcfba255-31ca-4ff3-bce1-76a4d9de49a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cffe4065aa4479f8bc6d202a9a00063'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:53.721025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-bcfba255-31ca-4ff3-bce1-76a4d9de49a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cffe4065aa4479f8bc6d202a9a00063'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:53.723413 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:53.814947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-bcfba255-31ca-4ff3-bce1-76a4d9de49a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cffe4065aa4479f8bc6d202a9a00063'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:53.824185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-bcfba255-31ca-4ff3-bce1-76a4d9de49a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cffe4065aa4479f8bc6d202a9a00063'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:53.838982 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-bcfba255-31ca-4ff3-bce1-76a4d9de49a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cffe4065aa4479f8bc6d202a9a00063'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:53.850346 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 984/1963] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:53 2022] DELETE /identity/v3/users/5cffe4065aa4479f8bc6d202a9a00063 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:53.852423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31bcf8-d5a5-479c-8c2d-c27bf27dff8e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:53.852901 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31bcf8-d5a5-479c-8c2d-c27bf27dff8e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:53.852990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31bcf8-d5a5-479c-8c2d-c27bf27dff8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:53.875513 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ed31bcf8-d5a5-479c-8c2d-c27bf27dff8e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:53.876927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ed31bcf8-d5a5-479c-8c2d-c27bf27dff8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:53.984826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 980/1964] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:53.993177 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfba255-31ca-4ff3-bce1-76a4d9de49a3 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:53.994657 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-bcfba255-31ca-4ff3-bce1-76a4d9de49a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:54.109060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfba255-31ca-4ff3-bce1-76a4d9de49a3 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:54.114954 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95db6b-6220-4e8a-9b5e-3dfc5f34508f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:54.115783 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95db6b-6220-4e8a-9b5e-3dfc5f34508f service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:54.116347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95db6b-6220-4e8a-9b5e-3dfc5f34508f service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:54.116772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95db6b-6220-4e8a-9b5e-3dfc5f34508f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:54.131148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95db6b-6220-4e8a-9b5e-3dfc5f34508f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:54.133449 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95db6b-6220-4e8a-9b5e-3dfc5f34508f service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:54.151685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 985/1965] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:54.880529 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31bcf8-d5a5-479c-8c2d-c27bf27dff8e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:54.882122 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ed31bcf8-d5a5-479c-8c2d-c27bf27dff8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:54.896510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31bcf8-d5a5-479c-8c2d-c27bf27dff8e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:54.908463 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d1054-43d7-4789-9412-71dad12f28e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:54.909284 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d1054-43d7-4789-9412-71dad12f28e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:54.909677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d1054-43d7-4789-9412-71dad12f28e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:54.909943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d1054-43d7-4789-9412-71dad12f28e9 admin admin] PATH_INFO: `/v3/projects/248fcc4b767c4f4aa268756e244443e0` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:54.911276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d1054-43d7-4789-9412-71dad12f28e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=248fcc4b767c4f4aa268756e244443e0)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:54.913195 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d1054-43d7-4789-9412-71dad12f28e9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:55.077249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-992d1054-43d7-4789-9412-71dad12f28e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248fcc4b767c4f4aa268756e244443e0', 'request_id': 'req-992d1054-43d7-4789-9412-71dad12f28e9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:55.237885 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-992d1054-43d7-4789-9412-71dad12f28e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248fcc4b767c4f4aa268756e244443e0', 'request_id': 'req-992d1054-43d7-4789-9412-71dad12f28e9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:55.245629 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-992d1054-43d7-4789-9412-71dad12f28e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248fcc4b767c4f4aa268756e244443e0', 'request_id': 'req-992d1054-43d7-4789-9412-71dad12f28e9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:55.257179 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-992d1054-43d7-4789-9412-71dad12f28e9 admin admin] The token cache is being invalidate because project 248fcc4b767c4f4aa268756e244443e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:55.257516 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-992d1054-43d7-4789-9412-71dad12f28e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:55.258215 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-992d1054-43d7-4789-9412-71dad12f28e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:55.261407 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 981/1966] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:54 2022] DELETE /identity/v3/projects/248fcc4b767c4f4aa268756e244443e0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:56.526644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95db6b-6220-4e8a-9b5e-3dfc5f34508f service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:56.528827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6d95db6b-6220-4e8a-9b5e-3dfc5f34508f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:56.543915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95db6b-6220-4e8a-9b5e-3dfc5f34508f service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:56.603456 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a8627-7027-4252-b57a-189de6115f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:56.604031 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a8627-7027-4252-b57a-189de6115f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:56.604314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a8627-7027-4252-b57a-189de6115f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:56.604596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a8627-7027-4252-b57a-189de6115f56 admin admin] PATH_INFO: `/v3/users/b3124696ed4c40029066ceef822f35b7` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:56.606479 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a8627-7027-4252-b57a-189de6115f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3124696ed4c40029066ceef822f35b7)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:56.608399 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a8627-7027-4252-b57a-189de6115f56 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:56.800139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-139a8627-7027-4252-b57a-189de6115f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3124696ed4c40029066ceef822f35b7'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:56.800784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-139a8627-7027-4252-b57a-189de6115f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3124696ed4c40029066ceef822f35b7'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:56.883095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-139a8627-7027-4252-b57a-189de6115f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3124696ed4c40029066ceef822f35b7'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:56.890700 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-139a8627-7027-4252-b57a-189de6115f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3124696ed4c40029066ceef822f35b7'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:56.895937 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:56.903154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-139a8627-7027-4252-b57a-189de6115f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3124696ed4c40029066ceef822f35b7'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:56.909056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 986/1967] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:32:56 2022] DELETE /identity/v3/users/b3124696ed4c40029066ceef822f35b7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:57.154429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d1054-43d7-4789-9412-71dad12f28e9 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:57.156471 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-992d1054-43d7-4789-9412-71dad12f28e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:57.171042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d1054-43d7-4789-9412-71dad12f28e9 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:57.197887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:57.237441 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6fd7-f883-48a8-8713-82af6e45a879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:57.238176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6fd7-f883-48a8-8713-82af6e45a879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:57.239057 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6fd7-f883-48a8-8713-82af6e45a879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:57.239310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6fd7-f883-48a8-8713-82af6e45a879 admin admin] PATH_INFO: `/v3/projects/ee5ed205b4a048e18443c6d18b871a90` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:57.240484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b6fd7-f883-48a8-8713-82af6e45a879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5ed205b4a048e18443c6d18b871a90)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:57.242481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b6fd7-f883-48a8-8713-82af6e45a879 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:57.354179 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-667b6fd7-f883-48a8-8713-82af6e45a879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5ed205b4a048e18443c6d18b871a90', 'request_id': 'req-667b6fd7-f883-48a8-8713-82af6e45a879'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:57.443245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-667b6fd7-f883-48a8-8713-82af6e45a879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5ed205b4a048e18443c6d18b871a90', 'request_id': 'req-667b6fd7-f883-48a8-8713-82af6e45a879'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:57.452192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-667b6fd7-f883-48a8-8713-82af6e45a879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5ed205b4a048e18443c6d18b871a90', 'request_id': 'req-667b6fd7-f883-48a8-8713-82af6e45a879'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:57.464026 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-667b6fd7-f883-48a8-8713-82af6e45a879 admin admin] The token cache is being invalidate because project ee5ed205b4a048e18443c6d18b871a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:32:57.464318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-667b6fd7-f883-48a8-8713-82af6e45a879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:57.465704 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-667b6fd7-f883-48a8-8713-82af6e45a879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:32:57.467342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 982/1968] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:32:57 2022] DELETE /identity/v3/projects/ee5ed205b4a048e18443c6d18b871a90 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:57.472240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2784900-d7a3-414e-bc7b-9725939b1835 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:57.472596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2784900-d7a3-414e-bc7b-9725939b1835 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:57.472936 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2784900-d7a3-414e-bc7b-9725939b1835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:57.492711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-c2784900-d7a3-414e-bc7b-9725939b1835 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:57.493965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c2784900-d7a3-414e-bc7b-9725939b1835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:57.554492 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 987/1969] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:57.562349 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db6214-80ac-4545-95fb-5aecff99e859 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:57.562638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db6214-80ac-4545-95fb-5aecff99e859 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:57.562915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db6214-80ac-4545-95fb-5aecff99e859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:57.582783 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-47db6214-80ac-4545-95fb-5aecff99e859 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:57.583982 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-47db6214-80ac-4545-95fb-5aecff99e859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:57.592466 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 983/1970] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:57.596562 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2784900-d7a3-414e-bc7b-9725939b1835 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:57.606372 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2784900-d7a3-414e-bc7b-9725939b1835 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:57.610958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68466b9-b3a2-424b-a38b-35bba53c0fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:57.611570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68466b9-b3a2-424b-a38b-35bba53c0fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:57.611853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68466b9-b3a2-424b-a38b-35bba53c0fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:57.612134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68466b9-b3a2-424b-a38b-35bba53c0fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:57.612826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68466b9-b3a2-424b-a38b-35bba53c0fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:32:57.613137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68466b9-b3a2-424b-a38b-35bba53c0fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:57.614782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68466b9-b3a2-424b-a38b-35bba53c0fc2 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:57.626527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 988/1971] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:32:57.630690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db6214-80ac-4545-95fb-5aecff99e859 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:57.640809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db6214-80ac-4545-95fb-5aecff99e859 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:57.645574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd538eac-7e42-44e2-9804-0c66296de38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:57.646180 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd538eac-7e42-44e2-9804-0c66296de38c admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:57.646487 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd538eac-7e42-44e2-9804-0c66296de38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:57.646756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd538eac-7e42-44e2-9804-0c66296de38c admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:57.647427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd538eac-7e42-44e2-9804-0c66296de38c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:57.649625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd538eac-7e42-44e2-9804-0c66296de38c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:57.770377 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 984/1972] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:57 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:57.774891 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68466b9-b3a2-424b-a38b-35bba53c0fc2 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:57.785283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68466b9-b3a2-424b-a38b-35bba53c0fc2 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:57.842154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924124e-ba85-4380-a5a2-7ae15dce1b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:57.857660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924124e-ba85-4380-a5a2-7ae15dce1b28 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:57.857660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924124e-ba85-4380-a5a2-7ae15dce1b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:57.857660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924124e-ba85-4380-a5a2-7ae15dce1b28 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:57.857660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924124e-ba85-4380-a5a2-7ae15dce1b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:57.857660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924124e-ba85-4380-a5a2-7ae15dce1b28 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:57.946120 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 989/1973] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:57 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:32:57.950660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd538eac-7e42-44e2-9804-0c66296de38c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:57.961557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd538eac-7e42-44e2-9804-0c66296de38c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:57.966311 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be0f9d-d2dd-4372-ab24-668115f05792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:57.966929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be0f9d-d2dd-4372-ab24-668115f05792 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:57.967327 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be0f9d-d2dd-4372-ab24-668115f05792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:57.967611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be0f9d-d2dd-4372-ab24-668115f05792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:57.968311 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be0f9d-d2dd-4372-ab24-668115f05792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:57.969948 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be0f9d-d2dd-4372-ab24-668115f05792 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:57.981401 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 985/1974] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:57.985450 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924124e-ba85-4380-a5a2-7ae15dce1b28 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:57.996491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924124e-ba85-4380-a5a2-7ae15dce1b28 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:58.001598 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82e8bf-36fb-4b45-84bf-5d4979e9c3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:58.002115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82e8bf-36fb-4b45-84bf-5d4979e9c3eb admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:58.002519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82e8bf-36fb-4b45-84bf-5d4979e9c3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:58.002803 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82e8bf-36fb-4b45-84bf-5d4979e9c3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:58.003533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82e8bf-36fb-4b45-84bf-5d4979e9c3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:58.005149 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82e8bf-36fb-4b45-84bf-5d4979e9c3eb admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:58.017068 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 990/1975] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:58.025570 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be0f9d-d2dd-4372-ab24-668115f05792 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:58.032037 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be0f9d-d2dd-4372-ab24-668115f05792 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:58.036884 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ed2d0-0ef9-47f3-93e8-d935b8af7d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:58.037586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ed2d0-0ef9-47f3-93e8-d935b8af7d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:58.037874 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ed2d0-0ef9-47f3-93e8-d935b8af7d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:58.038153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ed2d0-0ef9-47f3-93e8-d935b8af7d94 admin admin] PATH_INFO: `/v3/projects/383656f01d9d479ba68cbef0219e4836/users/17b30409209b464894b12159b07b0366/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:58.053126 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ed2d0-0ef9-47f3-93e8-d935b8af7d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=383656f01d9d479ba68cbef0219e4836, user_id=17b30409209b464894b12159b07b0366, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:58.055818 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ed2d0-0ef9-47f3-93e8-d935b8af7d94 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:58.198054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 986/1976] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:58 2022] PUT /identity/v3/projects/383656f01d9d479ba68cbef0219e4836/users/17b30409209b464894b12159b07b0366/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:58.211774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c09b5-8066-4cd8-bb0b-12fe1a69aae6 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:58.212068 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c09b5-8066-4cd8-bb0b-12fe1a69aae6 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:58.212349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c09b5-8066-4cd8-bb0b-12fe1a69aae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:58.239951 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-215c09b5-8066-4cd8-bb0b-12fe1a69aae6 None None] MFA Rules not processed for user `17b30409209b464894b12159b07b0366`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:58.241309 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-215c09b5-8066-4cd8-bb0b-12fe1a69aae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:58.294086 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:58.314822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 991/1977] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:58.319497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ed2d0-0ef9-47f3-93e8-d935b8af7d94 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:58.374493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:58.385508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ed2d0-0ef9-47f3-93e8-d935b8af7d94 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:58.391021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213a93e-7e67-410d-9fc9-6839f8b2c681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:58.391656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213a93e-7e67-410d-9fc9-6839f8b2c681 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:58.391942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213a93e-7e67-410d-9fc9-6839f8b2c681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:58.392223 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213a93e-7e67-410d-9fc9-6839f8b2c681 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:58.392910 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213a93e-7e67-410d-9fc9-6839f8b2c681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:58.395066 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213a93e-7e67-410d-9fc9-6839f8b2c681 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:58.494372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 987/1978] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:32:58 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:58.495626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c09b5-8066-4cd8-bb0b-12fe1a69aae6 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:58.507370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c09b5-8066-4cd8-bb0b-12fe1a69aae6 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:58.579251 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182f116-fb60-432f-8122-154255c03876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:58.580080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f116-fb60-432f-8122-154255c03876 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:58.580358 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f116-fb60-432f-8122-154255c03876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:58.580636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f116-fb60-432f-8122-154255c03876 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:58.581294 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182f116-fb60-432f-8122-154255c03876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:58.583234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182f116-fb60-432f-8122-154255c03876 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:58.657171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 992/1979] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:32:58 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:32:58.658735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213a93e-7e67-410d-9fc9-6839f8b2c681 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:58.671669 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213a93e-7e67-410d-9fc9-6839f8b2c681 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:58.677674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25064c7a-c260-48a8-894d-c9a9bf43d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:58.678501 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25064c7a-c260-48a8-894d-c9a9bf43d836 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:58.678929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25064c7a-c260-48a8-894d-c9a9bf43d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:58.679358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25064c7a-c260-48a8-894d-c9a9bf43d836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:58.680224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25064c7a-c260-48a8-894d-c9a9bf43d836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:58.682017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25064c7a-c260-48a8-894d-c9a9bf43d836 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:58.696748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 988/1980] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:58.698021 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182f116-fb60-432f-8122-154255c03876 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:58.709443 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182f116-fb60-432f-8122-154255c03876 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:58.714255 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d41488-1412-43aa-a32a-f6b45bd8c0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:58.715026 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d41488-1412-43aa-a32a-f6b45bd8c0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:58.715303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d41488-1412-43aa-a32a-f6b45bd8c0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:58.715569 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d41488-1412-43aa-a32a-f6b45bd8c0a2 admin admin] PATH_INFO: `/v3/projects/84daed3402e0451bbf533582590963cf/users/7659af1f243044f186d9a0452d0eb821/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:58.732459 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d41488-1412-43aa-a32a-f6b45bd8c0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84daed3402e0451bbf533582590963cf, user_id=7659af1f243044f186d9a0452d0eb821, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:58.736488 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d41488-1412-43aa-a32a-f6b45bd8c0a2 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:58.809622 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 993/1981] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:58 2022] PUT /identity/v3/projects/84daed3402e0451bbf533582590963cf/users/7659af1f243044f186d9a0452d0eb821/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:58.813601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25064c7a-c260-48a8-894d-c9a9bf43d836 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:58.823848 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25064c7a-c260-48a8-894d-c9a9bf43d836 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:58.881872 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfe38c-0c46-42c9-af83-36fcf9572548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:58.882499 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfe38c-0c46-42c9-af83-36fcf9572548 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:58.882785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfe38c-0c46-42c9-af83-36fcf9572548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:58.883065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfe38c-0c46-42c9-af83-36fcf9572548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:58.883794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfe38c-0c46-42c9-af83-36fcf9572548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:58.885537 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfe38c-0c46-42c9-af83-36fcf9572548 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:58.896134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 989/1982] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:58.900636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d41488-1412-43aa-a32a-f6b45bd8c0a2 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:58.911254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d41488-1412-43aa-a32a-f6b45bd8c0a2 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:58.915914 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7215a-ebb3-47e7-8e1e-df77f2787abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:58.916679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7215a-ebb3-47e7-8e1e-df77f2787abf admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:58.922965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7215a-ebb3-47e7-8e1e-df77f2787abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:58.922965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7215a-ebb3-47e7-8e1e-df77f2787abf admin admin] PATH_INFO: `/v3/projects/84daed3402e0451bbf533582590963cf/users/7659af1f243044f186d9a0452d0eb821/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:58.922965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7215a-ebb3-47e7-8e1e-df77f2787abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=84daed3402e0451bbf533582590963cf, user_id=7659af1f243044f186d9a0452d0eb821, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:58.922965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7215a-ebb3-47e7-8e1e-df77f2787abf admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:58.934118 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 994/1983] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:32:58 2022] PUT /identity/v3/projects/84daed3402e0451bbf533582590963cf/users/7659af1f243044f186d9a0452d0eb821/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:32:58.945997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf8149-2491-4c0e-a8f9-1352b029c162 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:58.946316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf8149-2491-4c0e-a8f9-1352b029c162 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:58.951676 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf8149-2491-4c0e-a8f9-1352b029c162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:58.974705 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8dcf8149-2491-4c0e-a8f9-1352b029c162 None None] MFA Rules not processed for user `7659af1f243044f186d9a0452d0eb821`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:58.980952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8dcf8149-2491-4c0e-a8f9-1352b029c162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:59.048938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 990/1984] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:59.061365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7215a-ebb3-47e7-8e1e-df77f2787abf admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:59.063090 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-3bc7215a-ebb3-47e7-8e1e-df77f2787abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:59.126171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7215a-ebb3-47e7-8e1e-df77f2787abf admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:59.129930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb4874-6155-4532-969b-a7ec08e8115d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:59.130554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb4874-6155-4532-969b-a7ec08e8115d service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:59.133305 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb4874-6155-4532-969b-a7ec08e8115d service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:59.133305 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb4874-6155-4532-969b-a7ec08e8115d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:59.146619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb4874-6155-4532-969b-a7ec08e8115d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:59.148063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb4874-6155-4532-969b-a7ec08e8115d service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:59.158594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 995/1985] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:59.421950 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf8149-2491-4c0e-a8f9-1352b029c162 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:59.423397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8dcf8149-2491-4c0e-a8f9-1352b029c162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:59.436268 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf8149-2491-4c0e-a8f9-1352b029c162 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:59.440026 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1d33f-765c-4b1f-bec4-94dfb378d844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:59.441072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1d33f-765c-4b1f-bec4-94dfb378d844 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:59.441572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1d33f-765c-4b1f-bec4-94dfb378d844 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:59.441935 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1d33f-765c-4b1f-bec4-94dfb378d844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:59.497431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:59.511457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1d33f-765c-4b1f-bec4-94dfb378d844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:59.513024 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1d33f-765c-4b1f-bec4-94dfb378d844 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:59.525296 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 991/1986] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:33:09.153981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=78,keystone:INSERT=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:09.539891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=6 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:24.108545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1222-eb9d-45ca-af6a-e6c6af47c852 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:24.117715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1222-eb9d-45ca-af6a-e6c6af47c852 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:24.117715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1222-eb9d-45ca-af6a-e6c6af47c852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:24.129647 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-77ce1222-eb9d-45ca-af6a-e6c6af47c852 None None] MFA Rules not processed for user `4fcc81558e8f4224ad2ea6fb2b7bf0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:33:24.130906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-77ce1222-eb9d-45ca-af6a-e6c6af47c852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:33:24.193690 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 996/1987] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:33:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:33:34.187086 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=25 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:51.730434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1d33f-765c-4b1f-bec4-94dfb378d844 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:51.798255 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1d33f-765c-4b1f-bec4-94dfb378d844 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:51.802921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636aa7ee-ebcd-42df-9d2e-30191d88833a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:51.803567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aa7ee-ebcd-42df-9d2e-30191d88833a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:51.803849 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aa7ee-ebcd-42df-9d2e-30191d88833a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:51.804127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aa7ee-ebcd-42df-9d2e-30191d88833a admin admin] PATH_INFO: `/v3/users/17b30409209b464894b12159b07b0366` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:51.805290 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636aa7ee-ebcd-42df-9d2e-30191d88833a admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b30409209b464894b12159b07b0366)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:51.807408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636aa7ee-ebcd-42df-9d2e-30191d88833a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:51.997149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-636aa7ee-ebcd-42df-9d2e-30191d88833a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b30409209b464894b12159b07b0366'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:51.998406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-636aa7ee-ebcd-42df-9d2e-30191d88833a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b30409209b464894b12159b07b0366'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:52.059563 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-636aa7ee-ebcd-42df-9d2e-30191d88833a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b30409209b464894b12159b07b0366'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:52.078001 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-636aa7ee-ebcd-42df-9d2e-30191d88833a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b30409209b464894b12159b07b0366'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:52.078868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-636aa7ee-ebcd-42df-9d2e-30191d88833a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b30409209b464894b12159b07b0366'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:52.094128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 992/1988] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:33:51 2022] DELETE /identity/v3/users/17b30409209b464894b12159b07b0366 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:33:52.098656 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596982e-be5d-493f-a804-b5234b1d5686 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:52.099180 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596982e-be5d-493f-a804-b5234b1d5686 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:52.099398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596982e-be5d-493f-a804-b5234b1d5686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:52.119259 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-9596982e-be5d-493f-a804-b5234b1d5686 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:33:52.121334 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9596982e-be5d-493f-a804-b5234b1d5686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:33:52.218707 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 997/1989] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:33:52.228321 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636aa7ee-ebcd-42df-9d2e-30191d88833a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:52.230502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-636aa7ee-ebcd-42df-9d2e-30191d88833a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:33:52.329502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636aa7ee-ebcd-42df-9d2e-30191d88833a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:52.329502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f427-308e-47a8-92c5-76cd507ed636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:52.329502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f427-308e-47a8-92c5-76cd507ed636 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:52.329502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f427-308e-47a8-92c5-76cd507ed636 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:52.329981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f427-308e-47a8-92c5-76cd507ed636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:52.339278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326f427-308e-47a8-92c5-76cd507ed636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:52.341170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326f427-308e-47a8-92c5-76cd507ed636 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:52.353992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 993/1990] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:33:52.478486 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712bd95-a723-4cf7-8b52-05dcde73aed4 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:52.478774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712bd95-a723-4cf7-8b52-05dcde73aed4 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:52.479101 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712bd95-a723-4cf7-8b52-05dcde73aed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:52.507576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-c712bd95-a723-4cf7-8b52-05dcde73aed4 None None] MFA Rules not processed for user `0002ebbc629b4dafb109dc94450fe1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:33:52.508826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c712bd95-a723-4cf7-8b52-05dcde73aed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:33:52.566781 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 998/1991] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:33:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:33:52.820178 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f427-308e-47a8-92c5-76cd507ed636 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:52.826868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5326f427-308e-47a8-92c5-76cd507ed636 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:33:52.842688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f427-308e-47a8-92c5-76cd507ed636 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:52.849071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:52.849930 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:52.858602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:52.858827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646 admin admin] PATH_INFO: `/v3/projects/383656f01d9d479ba68cbef0219e4836` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:52.860317 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=383656f01d9d479ba68cbef0219e4836)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:52.862363 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:52.883267 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:52.921659 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c61df3-78cf-4fc4-b169-a84e24d65593 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:52.922061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c61df3-78cf-4fc4-b169-a84e24d65593 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:52.922981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c61df3-78cf-4fc4-b169-a84e24d65593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:52.944947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-14c61df3-78cf-4fc4-b169-a84e24d65593 None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:33:52.948780 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-14c61df3-78cf-4fc4-b169-a84e24d65593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:33:52.999300 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '383656f01d9d479ba68cbef0219e4836', 'request_id': 'req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:53.039170 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 999/1992] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jul 28 05:33:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:33:53.084316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c61df3-78cf-4fc4-b169-a84e24d65593 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:53.086102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-14c61df3-78cf-4fc4-b169-a84e24d65593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:33:53.103998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '383656f01d9d479ba68cbef0219e4836', 'request_id': 'req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:53.111985 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '383656f01d9d479ba68cbef0219e4836', 'request_id': 'req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:53.124305 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646 admin admin] The token cache is being invalidate because project 383656f01d9d479ba68cbef0219e4836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:33:53.124717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:53.126470 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:53.130185 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 994/1993] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:33:52 2022] DELETE /identity/v3/projects/383656f01d9d479ba68cbef0219e4836 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:33:53.131598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:53.133105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:33:53.146680 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:53.167961 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c61df3-78cf-4fc4-b169-a84e24d65593 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:53.201987 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf888cd-a265-4d5d-bb0b-6cbc79b09646 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:53.206792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2617a8-9b75-4574-8047-c7771a6f5eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:53.207453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2617a8-9b75-4574-8047-c7771a6f5eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:53.207739 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2617a8-9b75-4574-8047-c7771a6f5eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:53.208017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2617a8-9b75-4574-8047-c7771a6f5eef admin admin] PATH_INFO: `/v3/users/7659af1f243044f186d9a0452d0eb821` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:53.209204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2617a8-9b75-4574-8047-c7771a6f5eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=7659af1f243044f186d9a0452d0eb821)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:53.211153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2617a8-9b75-4574-8047-c7771a6f5eef admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:53.243891 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb28eb-deb3-4a60-adf0-1bf049289f75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:53.244583 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb28eb-deb3-4a60-adf0-1bf049289f75 service swift] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:53.248108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb28eb-deb3-4a60-adf0-1bf049289f75 service swift] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:53.248108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb28eb-deb3-4a60-adf0-1bf049289f75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:53.248108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-48fb28eb-deb3-4a60-adf0-1bf049289f75 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:33:53.304843 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb28eb-deb3-4a60-adf0-1bf049289f75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:53.306470 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb28eb-deb3-4a60-adf0-1bf049289f75 service swift] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:53.314680 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1000/1994] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:33:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 05:33:53.450187 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ee2617a8-9b75-4574-8047-c7771a6f5eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7659af1f243044f186d9a0452d0eb821'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:53.453873 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ee2617a8-9b75-4574-8047-c7771a6f5eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7659af1f243044f186d9a0452d0eb821'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:53.517891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ee2617a8-9b75-4574-8047-c7771a6f5eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7659af1f243044f186d9a0452d0eb821'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:53.562090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ee2617a8-9b75-4574-8047-c7771a6f5eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7659af1f243044f186d9a0452d0eb821'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:53.563270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ee2617a8-9b75-4574-8047-c7771a6f5eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7659af1f243044f186d9a0452d0eb821'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:53.582495 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 995/1995] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:33:53 2022] DELETE /identity/v3/users/7659af1f243044f186d9a0452d0eb821 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:33:54.092240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb28eb-deb3-4a60-adf0-1bf049289f75 service swift] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:54.106206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb28eb-deb3-4a60-adf0-1bf049289f75 service swift] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:54.209595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1e7c9-28c5-4723-8c5a-923c27bea56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:54.210330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1e7c9-28c5-4723-8c5a-923c27bea56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:54.210582 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1e7c9-28c5-4723-8c5a-923c27bea56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:54.210868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1e7c9-28c5-4723-8c5a-923c27bea56b admin admin] PATH_INFO: `/v3/projects/84daed3402e0451bbf533582590963cf` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:54.212087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1e7c9-28c5-4723-8c5a-923c27bea56b admin admin] RBAC: Authorizing `identity:delete_project(project_id=84daed3402e0451bbf533582590963cf)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:54.214950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1e7c9-28c5-4723-8c5a-923c27bea56b admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:54.351297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:54.362693 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-3ad1e7c9-28c5-4723-8c5a-923c27bea56b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84daed3402e0451bbf533582590963cf', 'request_id': 'req-3ad1e7c9-28c5-4723-8c5a-923c27bea56b'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:54.435188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-3ad1e7c9-28c5-4723-8c5a-923c27bea56b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84daed3402e0451bbf533582590963cf', 'request_id': 'req-3ad1e7c9-28c5-4723-8c5a-923c27bea56b'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:54.446622 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-3ad1e7c9-28c5-4723-8c5a-923c27bea56b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84daed3402e0451bbf533582590963cf', 'request_id': 'req-3ad1e7c9-28c5-4723-8c5a-923c27bea56b'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:54.460520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-3ad1e7c9-28c5-4723-8c5a-923c27bea56b admin admin] The token cache is being invalidate because project 84daed3402e0451bbf533582590963cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:33:54.460906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-3ad1e7c9-28c5-4723-8c5a-923c27bea56b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:54.463511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-3ad1e7c9-28c5-4723-8c5a-923c27bea56b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:33:54.467091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1001/1996] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:33:54 2022] DELETE /identity/v3/projects/84daed3402e0451bbf533582590963cf => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:33:54.472104 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442f48e-49a3-490a-8773-7d2875ed5ab7 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:54.472602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442f48e-49a3-490a-8773-7d2875ed5ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:54.472860 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442f48e-49a3-490a-8773-7d2875ed5ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:54.496707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1442f48e-49a3-490a-8773-7d2875ed5ab7 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:33:54.498058 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1442f48e-49a3-490a-8773-7d2875ed5ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:33:54.525160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:54.587151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 996/1997] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:33:54.596683 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c61ef5-6c79-4de2-ae3d-ff6a8b48c198 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:54.597308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c61ef5-6c79-4de2-ae3d-ff6a8b48c198 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:54.597865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c61ef5-6c79-4de2-ae3d-ff6a8b48c198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:54.739911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-82c61ef5-6c79-4de2-ae3d-ff6a8b48c198 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:33:54.744499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-82c61ef5-6c79-4de2-ae3d-ff6a8b48c198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:33:54.788178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1002/1998] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:33:54.791276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442f48e-49a3-490a-8773-7d2875ed5ab7 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:54.811945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442f48e-49a3-490a-8773-7d2875ed5ab7 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:54.817945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33208af2-34ff-453d-aaa6-7f08716d71ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:54.818700 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33208af2-34ff-453d-aaa6-7f08716d71ba admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:54.819152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33208af2-34ff-453d-aaa6-7f08716d71ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:54.819508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33208af2-34ff-453d-aaa6-7f08716d71ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:54.820134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33208af2-34ff-453d-aaa6-7f08716d71ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:33:54.820448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33208af2-34ff-453d-aaa6-7f08716d71ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:54.822145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33208af2-34ff-453d-aaa6-7f08716d71ba admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:54.836988 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 997/1999] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:33:54.841590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c61ef5-6c79-4de2-ae3d-ff6a8b48c198 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:54.853204 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c61ef5-6c79-4de2-ae3d-ff6a8b48c198 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:54.859622 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8417e5-5fb8-4d07-88ba-d5b5006358fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:54.860263 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8417e5-5fb8-4d07-88ba-d5b5006358fb admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:54.860557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8417e5-5fb8-4d07-88ba-d5b5006358fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:54.860833 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8417e5-5fb8-4d07-88ba-d5b5006358fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:54.861542 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8417e5-5fb8-4d07-88ba-d5b5006358fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:54.863577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8417e5-5fb8-4d07-88ba-d5b5006358fb admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:54.984327 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1003/2000] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:33:54 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:33:54.988391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33208af2-34ff-453d-aaa6-7f08716d71ba admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:55.000293 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33208af2-34ff-453d-aaa6-7f08716d71ba admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:55.082763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66621c1a-f737-4267-a6b4-0eec5b640775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:55.083517 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66621c1a-f737-4267-a6b4-0eec5b640775 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:55.083863 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66621c1a-f737-4267-a6b4-0eec5b640775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:55.084207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66621c1a-f737-4267-a6b4-0eec5b640775 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:55.084978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66621c1a-f737-4267-a6b4-0eec5b640775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:55.088832 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66621c1a-f737-4267-a6b4-0eec5b640775 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:55.188169 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 998/2001] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:33:54 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:33:55.192538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8417e5-5fb8-4d07-88ba-d5b5006358fb admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:55.214307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8417e5-5fb8-4d07-88ba-d5b5006358fb admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:55.224730 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1474ec-a873-4e6e-9ec2-5a14a283c759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:55.225435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1474ec-a873-4e6e-9ec2-5a14a283c759 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:55.225748 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1474ec-a873-4e6e-9ec2-5a14a283c759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:55.226030 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1474ec-a873-4e6e-9ec2-5a14a283c759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:55.226741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1474ec-a873-4e6e-9ec2-5a14a283c759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:55.228389 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1474ec-a873-4e6e-9ec2-5a14a283c759 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:55.244312 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1004/2002] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:33:55.248708 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66621c1a-f737-4267-a6b4-0eec5b640775 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:55.272716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66621c1a-f737-4267-a6b4-0eec5b640775 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:55.287175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24c640-82a2-4301-b981-405dd880c4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:55.288902 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24c640-82a2-4301-b981-405dd880c4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:55.289204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24c640-82a2-4301-b981-405dd880c4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:55.289540 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24c640-82a2-4301-b981-405dd880c4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:55.290282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24c640-82a2-4301-b981-405dd880c4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:55.294333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24c640-82a2-4301-b981-405dd880c4d2 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:55.307762 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 999/2003] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:33:55.311771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1474ec-a873-4e6e-9ec2-5a14a283c759 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:55.322540 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1474ec-a873-4e6e-9ec2-5a14a283c759 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:55.330730 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed3933-d515-4b9f-81a5-b9d63f334af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:55.331563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed3933-d515-4b9f-81a5-b9d63f334af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:55.331852 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed3933-d515-4b9f-81a5-b9d63f334af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:55.332149 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed3933-d515-4b9f-81a5-b9d63f334af2 admin admin] PATH_INFO: `/v3/projects/7ff57c0816d04f2aaf20f2c08a8a4449/users/456ec9928bf543ee93531c099e4a0a85/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:55.350574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed3933-d515-4b9f-81a5-b9d63f334af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff57c0816d04f2aaf20f2c08a8a4449, user_id=456ec9928bf543ee93531c099e4a0a85, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:55.353968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed3933-d515-4b9f-81a5-b9d63f334af2 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:55.429876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1005/2004] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:33:55 2022] PUT /identity/v3/projects/7ff57c0816d04f2aaf20f2c08a8a4449/users/456ec9928bf543ee93531c099e4a0a85/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:33:55.431769 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a668c29-0fdf-4979-937e-fe7fc7826531 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:55.432934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a668c29-0fdf-4979-937e-fe7fc7826531 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:55.433309 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a668c29-0fdf-4979-937e-fe7fc7826531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:55.469857 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8a668c29-0fdf-4979-937e-fe7fc7826531 None None] MFA Rules not processed for user `456ec9928bf543ee93531c099e4a0a85`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:33:55.471253 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8a668c29-0fdf-4979-937e-fe7fc7826531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:33:55.568504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1000/2005] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:33:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:33:55.569720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed3933-d515-4b9f-81a5-b9d63f334af2 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:55.658097 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed3933-d515-4b9f-81a5-b9d63f334af2 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:55.666920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0ed6c-f308-4469-b1b3-204541966859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:55.667985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0ed6c-f308-4469-b1b3-204541966859 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:55.668462 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0ed6c-f308-4469-b1b3-204541966859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:55.668908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0ed6c-f308-4469-b1b3-204541966859 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:55.669860 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0ed6c-f308-4469-b1b3-204541966859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:55.671789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0ed6c-f308-4469-b1b3-204541966859 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:55.764665 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a668c29-0fdf-4979-937e-fe7fc7826531 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:55.766482 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1006/2006] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:33:55 2022] POST /identity/v3/projects => generated 381 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:33:55.788023 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a668c29-0fdf-4979-937e-fe7fc7826531 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:55.814279 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:55.869102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28933f5-5cb1-40cf-a97f-6a56d80d945e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:55.869102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28933f5-5cb1-40cf-a97f-6a56d80d945e admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:55.869102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28933f5-5cb1-40cf-a97f-6a56d80d945e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:55.869102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28933f5-5cb1-40cf-a97f-6a56d80d945e admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:55.869866 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28933f5-5cb1-40cf-a97f-6a56d80d945e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:55.870850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28933f5-5cb1-40cf-a97f-6a56d80d945e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:55.962383 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1001/2007] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:33:55 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:33:55.964645 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0ed6c-f308-4469-b1b3-204541966859 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:55.978602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0ed6c-f308-4469-b1b3-204541966859 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:55.984360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b2a94-1425-4177-a1fb-c5b5a97b97c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:55.989699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b2a94-1425-4177-a1fb-c5b5a97b97c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:55.989699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b2a94-1425-4177-a1fb-c5b5a97b97c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:55.989699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b2a94-1425-4177-a1fb-c5b5a97b97c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:55.989699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b2a94-1425-4177-a1fb-c5b5a97b97c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:55.992810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b2a94-1425-4177-a1fb-c5b5a97b97c2 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:56.013319 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1007/2008] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:33:56.014282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28933f5-5cb1-40cf-a97f-6a56d80d945e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:56.028599 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28933f5-5cb1-40cf-a97f-6a56d80d945e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:56.033668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb50ef-d984-495b-b202-594831f60775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:56.034362 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb50ef-d984-495b-b202-594831f60775 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:56.034652 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb50ef-d984-495b-b202-594831f60775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:56.035146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb50ef-d984-495b-b202-594831f60775 admin admin] PATH_INFO: `/v3/projects/e8e66349f5ed4754a4947828af879d2e/users/1575d03aaf1b49da81282e8f3b1e02da/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:56.055601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb50ef-d984-495b-b202-594831f60775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e66349f5ed4754a4947828af879d2e, user_id=1575d03aaf1b49da81282e8f3b1e02da, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:56.059077 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb50ef-d984-495b-b202-594831f60775 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:56.153245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1002/2009] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:33:56 2022] PUT /identity/v3/projects/e8e66349f5ed4754a4947828af879d2e/users/1575d03aaf1b49da81282e8f3b1e02da/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:33:56.158419 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b2a94-1425-4177-a1fb-c5b5a97b97c2 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:56.171050 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b2a94-1425-4177-a1fb-c5b5a97b97c2 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:56.211719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:56.239862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193fc25-4bdf-4788-bde2-7f8ccee321d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:56.240559 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193fc25-4bdf-4788-bde2-7f8ccee321d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:56.240935 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193fc25-4bdf-4788-bde2-7f8ccee321d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:56.241507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193fc25-4bdf-4788-bde2-7f8ccee321d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:56.242458 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193fc25-4bdf-4788-bde2-7f8ccee321d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:56.244202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193fc25-4bdf-4788-bde2-7f8ccee321d3 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:56.259591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1008/2010] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:33:56.271802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb50ef-d984-495b-b202-594831f60775 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:56.284707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb50ef-d984-495b-b202-594831f60775 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:56.293741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ceb062-3a45-4180-9771-729e5d5db7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:56.294773 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ceb062-3a45-4180-9771-729e5d5db7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:56.294773 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ceb062-3a45-4180-9771-729e5d5db7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:56.301829 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ceb062-3a45-4180-9771-729e5d5db7f2 admin admin] PATH_INFO: `/v3/projects/e8e66349f5ed4754a4947828af879d2e/users/1575d03aaf1b49da81282e8f3b1e02da/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:56.306981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ceb062-3a45-4180-9771-729e5d5db7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e66349f5ed4754a4947828af879d2e, user_id=1575d03aaf1b49da81282e8f3b1e02da, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:56.310794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ceb062-3a45-4180-9771-729e5d5db7f2 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:56.325528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1003/2011] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:33:56 2022] PUT /identity/v3/projects/e8e66349f5ed4754a4947828af879d2e/users/1575d03aaf1b49da81282e8f3b1e02da/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:33:56.340078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60d7bd-3a65-4c02-9ca8-9f22db7efac2 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:56.340410 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60d7bd-3a65-4c02-9ca8-9f22db7efac2 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:56.340646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60d7bd-3a65-4c02-9ca8-9f22db7efac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:56.382466 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-6f60d7bd-3a65-4c02-9ca8-9f22db7efac2 None None] MFA Rules not processed for user `1575d03aaf1b49da81282e8f3b1e02da`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:33:56.384083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6f60d7bd-3a65-4c02-9ca8-9f22db7efac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:33:56.520492 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1009/2012] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:33:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:33:56.538763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ceb062-3a45-4180-9771-729e5d5db7f2 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:56.540451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-69ceb062-3a45-4180-9771-729e5d5db7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:33:56.606230 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ceb062-3a45-4180-9771-729e5d5db7f2 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:56.643962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ca782-5c71-4a5a-97d2-4c43089a2647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:56.643962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca782-5c71-4a5a-97d2-4c43089a2647 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:56.643962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca782-5c71-4a5a-97d2-4c43089a2647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:56.643962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca782-5c71-4a5a-97d2-4c43089a2647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:56.644524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ca782-5c71-4a5a-97d2-4c43089a2647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:56.644524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ca782-5c71-4a5a-97d2-4c43089a2647 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:56.644524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1004/2013] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:33:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:33:57.117090 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60d7bd-3a65-4c02-9ca8-9f22db7efac2 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:33:57.118714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6f60d7bd-3a65-4c02-9ca8-9f22db7efac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:33:57.132953 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60d7bd-3a65-4c02-9ca8-9f22db7efac2 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:33:57.137929 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99427542-fb09-421f-9f9c-33a41841152e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:33:57.138800 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99427542-fb09-421f-9f9c-33a41841152e service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:33:57.139418 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99427542-fb09-421f-9f9c-33a41841152e service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:33:57.139946 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99427542-fb09-421f-9f9c-33a41841152e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:33:57.228794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99427542-fb09-421f-9f9c-33a41841152e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:33:57.239967 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99427542-fb09-421f-9f9c-33a41841152e service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:33:57.259692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1010/2014] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:33:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:06.627961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=61,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:07.248599 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=75 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:15.628776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ca782-5c71-4a5a-97d2-4c43089a2647 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:15.694382 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ca782-5c71-4a5a-97d2-4c43089a2647 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:15.698939 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b17e4-8e45-44df-8472-9b52f60d8a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:15.699588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b17e4-8e45-44df-8472-9b52f60d8a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:15.699875 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b17e4-8e45-44df-8472-9b52f60d8a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:15.700158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b17e4-8e45-44df-8472-9b52f60d8a69 admin admin] PATH_INFO: `/v3/users/456ec9928bf543ee93531c099e4a0a85` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:15.701356 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b17e4-8e45-44df-8472-9b52f60d8a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=456ec9928bf543ee93531c099e4a0a85)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:15.703338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b17e4-8e45-44df-8472-9b52f60d8a69 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:15.982289 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f22b17e4-8e45-44df-8472-9b52f60d8a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '456ec9928bf543ee93531c099e4a0a85'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:15.984427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f22b17e4-8e45-44df-8472-9b52f60d8a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '456ec9928bf543ee93531c099e4a0a85'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:16.098155 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f22b17e4-8e45-44df-8472-9b52f60d8a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '456ec9928bf543ee93531c099e4a0a85'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:16.111047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f22b17e4-8e45-44df-8472-9b52f60d8a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '456ec9928bf543ee93531c099e4a0a85'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:16.111712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f22b17e4-8e45-44df-8472-9b52f60d8a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '456ec9928bf543ee93531c099e4a0a85'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:16.129517 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1005/2015] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:34:15 2022] DELETE /identity/v3/users/456ec9928bf543ee93531c099e4a0a85 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:16.131218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dead62-60c1-4698-b083-b2a9d335ad0a None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:16.131687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dead62-60c1-4698-b083-b2a9d335ad0a None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:16.131782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dead62-60c1-4698-b083-b2a9d335ad0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:16.160688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-66dead62-60c1-4698-b083-b2a9d335ad0a None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:16.162386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-66dead62-60c1-4698-b083-b2a9d335ad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:16.305503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1011/2016] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:16.315376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b17e4-8e45-44df-8472-9b52f60d8a69 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:16.316897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f22b17e4-8e45-44df-8472-9b52f60d8a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:16.380225 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b17e4-8e45-44df-8472-9b52f60d8a69 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:16.385733 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20eee63-d60c-4f2d-8761-a7b145a89136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:16.388772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eee63-d60c-4f2d-8761-a7b145a89136 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:16.388772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eee63-d60c-4f2d-8761-a7b145a89136 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:16.388772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eee63-d60c-4f2d-8761-a7b145a89136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:16.405876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20eee63-d60c-4f2d-8761-a7b145a89136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:16.407925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20eee63-d60c-4f2d-8761-a7b145a89136 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:16.426350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1006/2017] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:16.826414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dead62-60c1-4698-b083-b2a9d335ad0a None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:16.828049 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-66dead62-60c1-4698-b083-b2a9d335ad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:16.841405 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dead62-60c1-4698-b083-b2a9d335ad0a None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:16.847868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911c5ea-ccc9-4832-9689-148aee5e2931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:16.848540 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911c5ea-ccc9-4832-9689-148aee5e2931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:16.849156 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911c5ea-ccc9-4832-9689-148aee5e2931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:16.849156 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911c5ea-ccc9-4832-9689-148aee5e2931 admin admin] PATH_INFO: `/v3/projects/7ff57c0816d04f2aaf20f2c08a8a4449` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:16.850281 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911c5ea-ccc9-4832-9689-148aee5e2931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff57c0816d04f2aaf20f2c08a8a4449)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:16.852394 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911c5ea-ccc9-4832-9689-148aee5e2931 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:16.961487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7911c5ea-ccc9-4832-9689-148aee5e2931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff57c0816d04f2aaf20f2c08a8a4449', 'request_id': 'req-7911c5ea-ccc9-4832-9689-148aee5e2931'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:17.034927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7911c5ea-ccc9-4832-9689-148aee5e2931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff57c0816d04f2aaf20f2c08a8a4449', 'request_id': 'req-7911c5ea-ccc9-4832-9689-148aee5e2931'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:17.041962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7911c5ea-ccc9-4832-9689-148aee5e2931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff57c0816d04f2aaf20f2c08a8a4449', 'request_id': 'req-7911c5ea-ccc9-4832-9689-148aee5e2931'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:17.054488 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7911c5ea-ccc9-4832-9689-148aee5e2931 admin admin] The token cache is being invalidate because project 7ff57c0816d04f2aaf20f2c08a8a4449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:34:17.054877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7911c5ea-ccc9-4832-9689-148aee5e2931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:17.055545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7911c5ea-ccc9-4832-9689-148aee5e2931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:17.057772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1012/2018] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:34:16 2022] DELETE /identity/v3/projects/7ff57c0816d04f2aaf20f2c08a8a4449 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:17.061946 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20eee63-d60c-4f2d-8761-a7b145a89136 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:17.071600 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20eee63-d60c-4f2d-8761-a7b145a89136 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:17.090135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:17.129419 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7191bed-c69a-4167-9d23-b349922ac8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:17.130101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7191bed-c69a-4167-9d23-b349922ac8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:17.130387 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7191bed-c69a-4167-9d23-b349922ac8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:17.130688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7191bed-c69a-4167-9d23-b349922ac8a5 admin admin] PATH_INFO: `/v3/users/1575d03aaf1b49da81282e8f3b1e02da` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:17.132085 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7191bed-c69a-4167-9d23-b349922ac8a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1575d03aaf1b49da81282e8f3b1e02da)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:17.134018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7191bed-c69a-4167-9d23-b349922ac8a5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:17.305675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-a7191bed-c69a-4167-9d23-b349922ac8a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1575d03aaf1b49da81282e8f3b1e02da'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:17.306660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-a7191bed-c69a-4167-9d23-b349922ac8a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1575d03aaf1b49da81282e8f3b1e02da'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:17.355761 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-a7191bed-c69a-4167-9d23-b349922ac8a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1575d03aaf1b49da81282e8f3b1e02da'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:17.370303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-a7191bed-c69a-4167-9d23-b349922ac8a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1575d03aaf1b49da81282e8f3b1e02da'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:17.371168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-a7191bed-c69a-4167-9d23-b349922ac8a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1575d03aaf1b49da81282e8f3b1e02da'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:17.384926 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1007/2019] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:34:17 2022] DELETE /identity/v3/users/1575d03aaf1b49da81282e8f3b1e02da => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:17.871120 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911c5ea-ccc9-4832-9689-148aee5e2931 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:17.872696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7911c5ea-ccc9-4832-9689-148aee5e2931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:17.886492 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911c5ea-ccc9-4832-9689-148aee5e2931 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:17.946243 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e615fc-7c0b-427b-bd1d-204f1f1b9bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:17.946898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e615fc-7c0b-427b-bd1d-204f1f1b9bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:17.947177 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e615fc-7c0b-427b-bd1d-204f1f1b9bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:17.947965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e615fc-7c0b-427b-bd1d-204f1f1b9bdf admin admin] PATH_INFO: `/v3/projects/e8e66349f5ed4754a4947828af879d2e` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:17.949406 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e615fc-7c0b-427b-bd1d-204f1f1b9bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8e66349f5ed4754a4947828af879d2e)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:17.951493 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e615fc-7c0b-427b-bd1d-204f1f1b9bdf admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:18.041607 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:18.058340 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-21e615fc-7c0b-427b-bd1d-204f1f1b9bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e66349f5ed4754a4947828af879d2e', 'request_id': 'req-21e615fc-7c0b-427b-bd1d-204f1f1b9bdf'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:18.132438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-21e615fc-7c0b-427b-bd1d-204f1f1b9bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e66349f5ed4754a4947828af879d2e', 'request_id': 'req-21e615fc-7c0b-427b-bd1d-204f1f1b9bdf'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:18.139395 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-21e615fc-7c0b-427b-bd1d-204f1f1b9bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e66349f5ed4754a4947828af879d2e', 'request_id': 'req-21e615fc-7c0b-427b-bd1d-204f1f1b9bdf'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:18.153532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-21e615fc-7c0b-427b-bd1d-204f1f1b9bdf admin admin] The token cache is being invalidate because project e8e66349f5ed4754a4947828af879d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:34:18.153830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-21e615fc-7c0b-427b-bd1d-204f1f1b9bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:18.154484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-21e615fc-7c0b-427b-bd1d-204f1f1b9bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:18.156698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1013/2020] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:34:17 2022] DELETE /identity/v3/projects/e8e66349f5ed4754a4947828af879d2e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:18.161172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c05cc1-9e26-4fbf-b6d8-b7a348cecc9b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:18.161674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c05cc1-9e26-4fbf-b6d8-b7a348cecc9b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:18.161766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c05cc1-9e26-4fbf-b6d8-b7a348cecc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:18.184051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-05c05cc1-9e26-4fbf-b6d8-b7a348cecc9b None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:18.185256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-05c05cc1-9e26-4fbf-b6d8-b7a348cecc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:18.251884 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1008/2021] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:18.261426 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0e3f-992a-462f-a85a-264f1096e387 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:18.261426 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0e3f-992a-462f-a85a-264f1096e387 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:18.261426 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0e3f-992a-462f-a85a-264f1096e387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:18.283642 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-ff0a0e3f-992a-462f-a85a-264f1096e387 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:18.285339 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ff0a0e3f-992a-462f-a85a-264f1096e387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:18.297625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1014/2022] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:34:18.300065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c05cc1-9e26-4fbf-b6d8-b7a348cecc9b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:18.310886 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c05cc1-9e26-4fbf-b6d8-b7a348cecc9b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:18.315916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfe268-e2e3-4822-a18a-cdf9b3c8db58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:18.316534 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfe268-e2e3-4822-a18a-cdf9b3c8db58 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:18.316813 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfe268-e2e3-4822-a18a-cdf9b3c8db58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:18.317086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfe268-e2e3-4822-a18a-cdf9b3c8db58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:18.317826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfe268-e2e3-4822-a18a-cdf9b3c8db58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:34:18.318119 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfe268-e2e3-4822-a18a-cdf9b3c8db58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:18.319714 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfe268-e2e3-4822-a18a-cdf9b3c8db58 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:18.336653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1009/2023] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:34:18.337905 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a0e3f-992a-462f-a85a-264f1096e387 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:18.347651 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a0e3f-992a-462f-a85a-264f1096e387 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:18.351953 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c63af-894f-4aaa-bf3c-abb3ce949fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:18.352613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c63af-894f-4aaa-bf3c-abb3ce949fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:18.352897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c63af-894f-4aaa-bf3c-abb3ce949fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:18.353176 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c63af-894f-4aaa-bf3c-abb3ce949fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:18.354535 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c63af-894f-4aaa-bf3c-abb3ce949fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:18.356654 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c63af-894f-4aaa-bf3c-abb3ce949fb7 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:18.482027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1015/2024] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:34:18 2022] POST /identity/v3/projects => generated 363 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:34:18.486359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfe268-e2e3-4822-a18a-cdf9b3c8db58 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:18.503693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfe268-e2e3-4822-a18a-cdf9b3c8db58 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:18.530028 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:18.561662 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e11ff6-3af4-49be-a597-c6589c4f9781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:18.562290 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e11ff6-3af4-49be-a597-c6589c4f9781 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:18.562559 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e11ff6-3af4-49be-a597-c6589c4f9781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:18.562840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e11ff6-3af4-49be-a597-c6589c4f9781 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:18.563505 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e11ff6-3af4-49be-a597-c6589c4f9781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:18.565495 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e11ff6-3af4-49be-a597-c6589c4f9781 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:18.671080 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1010/2025] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:34:18 2022] POST /identity/v3/users => generated 282 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:34:18.684503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c63af-894f-4aaa-bf3c-abb3ce949fb7 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:18.703723 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c63af-894f-4aaa-bf3c-abb3ce949fb7 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:18.716301 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176260ec-5ad6-411e-8c06-d1a780d39059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:18.716956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176260ec-5ad6-411e-8c06-d1a780d39059 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:18.717239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176260ec-5ad6-411e-8c06-d1a780d39059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:18.717536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176260ec-5ad6-411e-8c06-d1a780d39059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:18.718251 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176260ec-5ad6-411e-8c06-d1a780d39059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:18.722247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176260ec-5ad6-411e-8c06-d1a780d39059 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:18.746767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1016/2026] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:34:18.748519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e11ff6-3af4-49be-a597-c6589c4f9781 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:18.766634 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e11ff6-3af4-49be-a597-c6589c4f9781 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:18.767698 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18dc02-59e8-42ea-8451-c7fc7d2b4f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:18.768529 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18dc02-59e8-42ea-8451-c7fc7d2b4f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:18.768883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18dc02-59e8-42ea-8451-c7fc7d2b4f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:18.769281 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18dc02-59e8-42ea-8451-c7fc7d2b4f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:18.770113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18dc02-59e8-42ea-8451-c7fc7d2b4f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:18.772612 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18dc02-59e8-42ea-8451-c7fc7d2b4f35 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:18.789156 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1011/2027] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:34:18.799053 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176260ec-5ad6-411e-8c06-d1a780d39059 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:18.810249 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176260ec-5ad6-411e-8c06-d1a780d39059 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:18.815004 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d7e84-1803-4b20-be35-e1dd9d3b7b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:18.815716 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d7e84-1803-4b20-be35-e1dd9d3b7b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:18.816131 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d7e84-1803-4b20-be35-e1dd9d3b7b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:18.816303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d7e84-1803-4b20-be35-e1dd9d3b7b09 admin admin] PATH_INFO: `/v3/projects/4ca207c8c8e64c1fb3a13dbe6c9504d3/users/12cabc026f6d482c9dd3017696080d16/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:18.832710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d7e84-1803-4b20-be35-e1dd9d3b7b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca207c8c8e64c1fb3a13dbe6c9504d3, user_id=12cabc026f6d482c9dd3017696080d16, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:18.835416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d7e84-1803-4b20-be35-e1dd9d3b7b09 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:18.887640 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1017/2028] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:34:18 2022] PUT /identity/v3/projects/4ca207c8c8e64c1fb3a13dbe6c9504d3/users/12cabc026f6d482c9dd3017696080d16/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:18.898405 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af752d-ff29-4b66-b77a-fa35ebdf31d9 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:18.898693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af752d-ff29-4b66-b77a-fa35ebdf31d9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:18.898976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af752d-ff29-4b66-b77a-fa35ebdf31d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:18.938944 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e6af752d-ff29-4b66-b77a-fa35ebdf31d9 None None] MFA Rules not processed for user `12cabc026f6d482c9dd3017696080d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:18.940184 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e6af752d-ff29-4b66-b77a-fa35ebdf31d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:19.011194 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1012/2029] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:19.015731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d7e84-1803-4b20-be35-e1dd9d3b7b09 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:19.078493 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d7e84-1803-4b20-be35-e1dd9d3b7b09 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:19.083147 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cdeda-d868-46f3-814d-9289db612658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:19.083764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cdeda-d868-46f3-814d-9289db612658 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:19.084043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cdeda-d868-46f3-814d-9289db612658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:19.084316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cdeda-d868-46f3-814d-9289db612658 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:19.085083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cdeda-d868-46f3-814d-9289db612658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:19.086970 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cdeda-d868-46f3-814d-9289db612658 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:19.203049 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1018/2030] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:34:19 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:34:19.207026 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af752d-ff29-4b66-b77a-fa35ebdf31d9 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:19.218010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af752d-ff29-4b66-b77a-fa35ebdf31d9 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:19.280945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b9f61-f15a-461d-8279-220fc1ba6ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:19.281616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b9f61-f15a-461d-8279-220fc1ba6ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:19.281906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b9f61-f15a-461d-8279-220fc1ba6ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:19.282183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b9f61-f15a-461d-8279-220fc1ba6ba9 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:19.282966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b9f61-f15a-461d-8279-220fc1ba6ba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:19.284887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b9f61-f15a-461d-8279-220fc1ba6ba9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:19.377440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1013/2031] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:34:19 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:34:19.381267 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cdeda-d868-46f3-814d-9289db612658 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:19.392987 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cdeda-d868-46f3-814d-9289db612658 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:19.398791 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797303b-2697-4852-a73d-bd7550793146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:19.398791 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797303b-2697-4852-a73d-bd7550793146 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:19.399020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797303b-2697-4852-a73d-bd7550793146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:19.399291 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797303b-2697-4852-a73d-bd7550793146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:19.399985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797303b-2697-4852-a73d-bd7550793146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:19.401702 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797303b-2697-4852-a73d-bd7550793146 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:19.416690 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1019/2032] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:34:19.419243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b9f61-f15a-461d-8279-220fc1ba6ba9 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:19.429483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b9f61-f15a-461d-8279-220fc1ba6ba9 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:19.434986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2574c2e-15f8-4090-b131-00ac12b33455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:19.435651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2574c2e-15f8-4090-b131-00ac12b33455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:19.435936 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2574c2e-15f8-4090-b131-00ac12b33455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:19.436215 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2574c2e-15f8-4090-b131-00ac12b33455 admin admin] PATH_INFO: `/v3/projects/d55fc772eecc428aa18c061e120b7186/users/59360a5e3577465480a493825c1419d7/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:19.454085 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2574c2e-15f8-4090-b131-00ac12b33455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55fc772eecc428aa18c061e120b7186, user_id=59360a5e3577465480a493825c1419d7, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:19.459127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0021d-a3e6-4dbc-a05b-3ed4bca8e497 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:19.459127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0021d-a3e6-4dbc-a05b-3ed4bca8e497 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:19.459127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0021d-a3e6-4dbc-a05b-3ed4bca8e497 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:19.459127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1020/2033] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jul 28 05:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:34:19.459436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2574c2e-15f8-4090-b131-00ac12b33455 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:19.461984 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3db7d-2335-4302-8ed2-eb4b825ead37 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:19.462268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3db7d-2335-4302-8ed2-eb4b825ead37 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:19.462542 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3db7d-2335-4302-8ed2-eb4b825ead37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:19.486731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-d8a3db7d-2335-4302-8ed2-eb4b825ead37 None None] MFA Rules not processed for user `99d8c709e6f4462c98c055cb03eebf42`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:19.488518 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d8a3db7d-2335-4302-8ed2-eb4b825ead37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:19.508948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:19.550267 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1014/2034] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:34:19 2022] PUT /identity/v3/projects/d55fc772eecc428aa18c061e120b7186/users/59360a5e3577465480a493825c1419d7/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:19.558345 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1021/2035] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jul 28 05:34:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:19.559597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2574c2e-15f8-4090-b131-00ac12b33455 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:19.564251 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:19.569670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3db7d-2335-4302-8ed2-eb4b825ead37 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:19.571015 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d8a3db7d-2335-4302-8ed2-eb4b825ead37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:19.623778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2574c2e-15f8-4090-b131-00ac12b33455 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:19.628212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3db7d-2335-4302-8ed2-eb4b825ead37 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:19.628465 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10899562-fca4-4239-893f-ee6ccd1cafa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:19.629116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899562-fca4-4239-893f-ee6ccd1cafa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:19.629403 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899562-fca4-4239-893f-ee6ccd1cafa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:19.629723 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899562-fca4-4239-893f-ee6ccd1cafa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:19.630415 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10899562-fca4-4239-893f-ee6ccd1cafa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:19.632046 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10899562-fca4-4239-893f-ee6ccd1cafa0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:19.642012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1015/2036] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:34:19.646474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10899562-fca4-4239-893f-ee6ccd1cafa0 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:19.656997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10899562-fca4-4239-893f-ee6ccd1cafa0 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:19.661896 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dd3a2-0974-43f6-8641-599cbe3f550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:19.662560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dd3a2-0974-43f6-8641-599cbe3f550f admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:19.662846 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dd3a2-0974-43f6-8641-599cbe3f550f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:19.663125 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dd3a2-0974-43f6-8641-599cbe3f550f admin admin] PATH_INFO: `/v3/projects/d55fc772eecc428aa18c061e120b7186/users/59360a5e3577465480a493825c1419d7/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:19.665106 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dd3a2-0974-43f6-8641-599cbe3f550f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55fc772eecc428aa18c061e120b7186, user_id=59360a5e3577465480a493825c1419d7, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:19.668440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dd3a2-0974-43f6-8641-599cbe3f550f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:19.678091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350251ac-a5eb-4e7a-b1a1-47aa1dacdef5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628ef75fa7194253bcf6cd6c85211738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:19.678716 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350251ac-a5eb-4e7a-b1a1-47aa1dacdef5 service glance] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:19.678820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1016/2037] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:34:19 2022] PUT /identity/v3/projects/d55fc772eecc428aa18c061e120b7186/users/59360a5e3577465480a493825c1419d7/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:34:19.679010 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350251ac-a5eb-4e7a-b1a1-47aa1dacdef5 service glance] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:19.679337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350251ac-a5eb-4e7a-b1a1-47aa1dacdef5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:19.689991 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c25743-b56c-4497-a66e-8551ada10568 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:19.692706 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c25743-b56c-4497-a66e-8551ada10568 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:19.692706 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c25743-b56c-4497-a66e-8551ada10568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:19.719256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d1c25743-b56c-4497-a66e-8551ada10568 None None] MFA Rules not processed for user `59360a5e3577465480a493825c1419d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:19.720474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d1c25743-b56c-4497-a66e-8551ada10568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:19.753395 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350251ac-a5eb-4e7a-b1a1-47aa1dacdef5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:19.754878 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350251ac-a5eb-4e7a-b1a1-47aa1dacdef5 service glance] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:19.766577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1022/2038] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:34:19.806961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1017/2039] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:34:19.814867 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350251ac-a5eb-4e7a-b1a1-47aa1dacdef5 service glance] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:19.816328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-350251ac-a5eb-4e7a-b1a1-47aa1dacdef5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:19.831144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:19.874835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350251ac-a5eb-4e7a-b1a1-47aa1dacdef5 service glance] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:19.929140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03941aa7-4ac2-4ed9-bb22-a22de4ecdfb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:19.929950 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03941aa7-4ac2-4ed9-bb22-a22de4ecdfb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:19.930238 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03941aa7-4ac2-4ed9-bb22-a22de4ecdfb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:19.930536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03941aa7-4ac2-4ed9-bb22-a22de4ecdfb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:19.941073 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03941aa7-4ac2-4ed9-bb22-a22de4ecdfb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:19.942957 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03941aa7-4ac2-4ed9-bb22-a22de4ecdfb0 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:19.945613 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a598b4-2817-48e4-a468-83ddc27a5c49 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:19.945904 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a598b4-2817-48e4-a468-83ddc27a5c49 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:19.946183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a598b4-2817-48e4-a468-83ddc27a5c49 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:19.949853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1018/2040] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jul 28 05:34:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:34:19.954699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1023/2041] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:19.955626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3068076-fd30-46d5-bf54-c3e059229e8a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:19.955913 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3068076-fd30-46d5-bf54-c3e059229e8a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:19.956191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3068076-fd30-46d5-bf54-c3e059229e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:19.989981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c3068076-fd30-46d5-bf54-c3e059229e8a None None] MFA Rules not processed for user `6907d8a429404b1c92805b364900ba60`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:19.991196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c3068076-fd30-46d5-bf54-c3e059229e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:20.060538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1019/2042] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jul 28 05:34:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:20.074964 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03941aa7-4ac2-4ed9-bb22-a22de4ecdfb0 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:20.077181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-03941aa7-4ac2-4ed9-bb22-a22de4ecdfb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:20.103116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03941aa7-4ac2-4ed9-bb22-a22de4ecdfb0 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:20.103116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791867d-24f3-4761-a5ce-d746897ef287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:20.103116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791867d-24f3-4761-a5ce-d746897ef287 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:20.103116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791867d-24f3-4761-a5ce-d746897ef287 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:20.104306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791867d-24f3-4761-a5ce-d746897ef287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:20.111649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791867d-24f3-4761-a5ce-d746897ef287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:20.113126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791867d-24f3-4761-a5ce-d746897ef287 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:20.121908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1024/2043] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:20.188597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3068076-fd30-46d5-bf54-c3e059229e8a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:20.192414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c3068076-fd30-46d5-bf54-c3e059229e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:20.204772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3068076-fd30-46d5-bf54-c3e059229e8a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:20.208747 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865715b-469e-46df-8378-1372065df998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:20.209411 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865715b-469e-46df-8378-1372065df998 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:20.209728 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865715b-469e-46df-8378-1372065df998 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:20.210039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865715b-469e-46df-8378-1372065df998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:20.225667 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd866eb-791a-45ea-b474-3071c7ab3dd4 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:20.226076 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd866eb-791a-45ea-b474-3071c7ab3dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:20.226433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd866eb-791a-45ea-b474-3071c7ab3dd4 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:20.229447 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1025/2044] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jul 28 05:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:34:20.229601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:20.236170 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859df4e8-12c0-4725-a265-e5bc5cf242f3 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:20.236461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859df4e8-12c0-4725-a265-e5bc5cf242f3 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:20.236746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859df4e8-12c0-4725-a265-e5bc5cf242f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:20.260789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-859df4e8-12c0-4725-a265-e5bc5cf242f3 None None] MFA Rules not processed for user `99d8c709e6f4462c98c055cb03eebf42`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:20.263663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-859df4e8-12c0-4725-a265-e5bc5cf242f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:20.288674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865715b-469e-46df-8378-1372065df998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:20.290314 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865715b-469e-46df-8378-1372065df998 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:20.301127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1020/2045] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:20.351320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1026/2046] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jul 28 05:34:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:34:20.363654 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865715b-469e-46df-8378-1372065df998 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:20.365202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6865715b-469e-46df-8378-1372065df998 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:20.377916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865715b-469e-46df-8378-1372065df998 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:20.381641 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081023e-3d76-460e-8c3a-e545e4897ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:20.382212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081023e-3d76-460e-8c3a-e545e4897ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:20.382497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081023e-3d76-460e-8c3a-e545e4897ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:20.382771 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081023e-3d76-460e-8c3a-e545e4897ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:20.394602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081023e-3d76-460e-8c3a-e545e4897ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:20.396452 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081023e-3d76-460e-8c3a-e545e4897ac4 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:20.408539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1021/2047] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:23.852835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859df4e8-12c0-4725-a265-e5bc5cf242f3 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:23.916859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:23.930024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859df4e8-12c0-4725-a265-e5bc5cf242f3 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:23.934681 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169254c4-ab0a-4f19-9469-33db28096f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:23.935326 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169254c4-ab0a-4f19-9469-33db28096f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:23.935608 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169254c4-ab0a-4f19-9469-33db28096f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:23.935884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169254c4-ab0a-4f19-9469-33db28096f83 admin admin] PATH_INFO: `/v3/users/12cabc026f6d482c9dd3017696080d16` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:23.937083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169254c4-ab0a-4f19-9469-33db28096f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12cabc026f6d482c9dd3017696080d16)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:23.939056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169254c4-ab0a-4f19-9469-33db28096f83 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:24.168767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-169254c4-ab0a-4f19-9469-33db28096f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12cabc026f6d482c9dd3017696080d16'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:24.169433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-169254c4-ab0a-4f19-9469-33db28096f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12cabc026f6d482c9dd3017696080d16'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:24.246797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-169254c4-ab0a-4f19-9469-33db28096f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12cabc026f6d482c9dd3017696080d16'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:24.255933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-169254c4-ab0a-4f19-9469-33db28096f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12cabc026f6d482c9dd3017696080d16'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:24.272644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-169254c4-ab0a-4f19-9469-33db28096f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12cabc026f6d482c9dd3017696080d16'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:24.284726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1027/2048] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:34:23 2022] DELETE /identity/v3/users/12cabc026f6d482c9dd3017696080d16 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:24.292306 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ba18a-8d33-4781-ab87-995bb23a02f1 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:24.293255 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ba18a-8d33-4781-ab87-995bb23a02f1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:24.293763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ba18a-8d33-4781-ab87-995bb23a02f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:24.314663 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-771ba18a-8d33-4781-ab87-995bb23a02f1 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:24.315899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-771ba18a-8d33-4781-ab87-995bb23a02f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:24.377397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1022/2049] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:24.387113 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169254c4-ab0a-4f19-9469-33db28096f83 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:24.388604 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-169254c4-ab0a-4f19-9469-33db28096f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:24.447741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169254c4-ab0a-4f19-9469-33db28096f83 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:24.451443 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c3dcd-ef11-44d7-af48-0f3c48abd8d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:24.452074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c3dcd-ef11-44d7-af48-0f3c48abd8d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:24.452378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c3dcd-ef11-44d7-af48-0f3c48abd8d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:24.452640 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c3dcd-ef11-44d7-af48-0f3c48abd8d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:24.461906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c3dcd-ef11-44d7-af48-0f3c48abd8d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:24.463333 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c3dcd-ef11-44d7-af48-0f3c48abd8d1 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:24.472856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1028/2050] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:24.881420 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ba18a-8d33-4781-ab87-995bb23a02f1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:24.882796 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-771ba18a-8d33-4781-ab87-995bb23a02f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:24.895506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ba18a-8d33-4781-ab87-995bb23a02f1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:24.901871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e3575-e390-40bb-8fa2-617dec2aafe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:24.903693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e3575-e390-40bb-8fa2-617dec2aafe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:24.903693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e3575-e390-40bb-8fa2-617dec2aafe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:24.903693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e3575-e390-40bb-8fa2-617dec2aafe1 admin admin] PATH_INFO: `/v3/projects/4ca207c8c8e64c1fb3a13dbe6c9504d3` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:24.904442 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e3575-e390-40bb-8fa2-617dec2aafe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca207c8c8e64c1fb3a13dbe6c9504d3)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:24.906431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e3575-e390-40bb-8fa2-617dec2aafe1 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:25.038522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-214e3575-e390-40bb-8fa2-617dec2aafe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca207c8c8e64c1fb3a13dbe6c9504d3', 'request_id': 'req-214e3575-e390-40bb-8fa2-617dec2aafe1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:25.092671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-214e3575-e390-40bb-8fa2-617dec2aafe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca207c8c8e64c1fb3a13dbe6c9504d3', 'request_id': 'req-214e3575-e390-40bb-8fa2-617dec2aafe1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:25.100471 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-214e3575-e390-40bb-8fa2-617dec2aafe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca207c8c8e64c1fb3a13dbe6c9504d3', 'request_id': 'req-214e3575-e390-40bb-8fa2-617dec2aafe1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:25.112462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-214e3575-e390-40bb-8fa2-617dec2aafe1 admin admin] The token cache is being invalidate because project 4ca207c8c8e64c1fb3a13dbe6c9504d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:34:25.112776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-214e3575-e390-40bb-8fa2-617dec2aafe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:25.113432 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-214e3575-e390-40bb-8fa2-617dec2aafe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:25.115081 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1023/2051] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:34:24 2022] DELETE /identity/v3/projects/4ca207c8c8e64c1fb3a13dbe6c9504d3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:25.119268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c3dcd-ef11-44d7-af48-0f3c48abd8d1 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:25.130317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c3dcd-ef11-44d7-af48-0f3c48abd8d1 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:25.189222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212f016-cfe0-4550-a932-d88af2965246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:25.189860 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212f016-cfe0-4550-a932-d88af2965246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:25.190275 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212f016-cfe0-4550-a932-d88af2965246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:25.190628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212f016-cfe0-4550-a932-d88af2965246 admin admin] PATH_INFO: `/v3/users/59360a5e3577465480a493825c1419d7` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:25.191905 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212f016-cfe0-4550-a932-d88af2965246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59360a5e3577465480a493825c1419d7)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:25.193928 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212f016-cfe0-4550-a932-d88af2965246 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:25.208577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:25.374096 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9212f016-cfe0-4550-a932-d88af2965246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59360a5e3577465480a493825c1419d7'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:25.374770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9212f016-cfe0-4550-a932-d88af2965246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59360a5e3577465480a493825c1419d7'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:25.468247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9212f016-cfe0-4550-a932-d88af2965246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59360a5e3577465480a493825c1419d7'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:25.475831 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9212f016-cfe0-4550-a932-d88af2965246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59360a5e3577465480a493825c1419d7'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:25.488054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9212f016-cfe0-4550-a932-d88af2965246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59360a5e3577465480a493825c1419d7'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:25.494993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1029/2052] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:34:25 2022] DELETE /identity/v3/users/59360a5e3577465480a493825c1419d7 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:26.035114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e3575-e390-40bb-8fa2-617dec2aafe1 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:26.035114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-214e3575-e390-40bb-8fa2-617dec2aafe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:26.059166 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e3575-e390-40bb-8fa2-617dec2aafe1 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:26.100210 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:26.132440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd54636-06f1-41ab-b1e7-0ff3cda137f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:26.133106 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd54636-06f1-41ab-b1e7-0ff3cda137f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:26.133396 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd54636-06f1-41ab-b1e7-0ff3cda137f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:26.135005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd54636-06f1-41ab-b1e7-0ff3cda137f1 admin admin] PATH_INFO: `/v3/projects/d55fc772eecc428aa18c061e120b7186` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:26.135972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd54636-06f1-41ab-b1e7-0ff3cda137f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55fc772eecc428aa18c061e120b7186)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:26.138049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd54636-06f1-41ab-b1e7-0ff3cda137f1 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:26.264780 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2cd54636-06f1-41ab-b1e7-0ff3cda137f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55fc772eecc428aa18c061e120b7186', 'request_id': 'req-2cd54636-06f1-41ab-b1e7-0ff3cda137f1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:26.360718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2cd54636-06f1-41ab-b1e7-0ff3cda137f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55fc772eecc428aa18c061e120b7186', 'request_id': 'req-2cd54636-06f1-41ab-b1e7-0ff3cda137f1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:26.367667 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2cd54636-06f1-41ab-b1e7-0ff3cda137f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55fc772eecc428aa18c061e120b7186', 'request_id': 'req-2cd54636-06f1-41ab-b1e7-0ff3cda137f1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:26.379789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2cd54636-06f1-41ab-b1e7-0ff3cda137f1 admin admin] The token cache is being invalidate because project d55fc772eecc428aa18c061e120b7186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:34:26.380080 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2cd54636-06f1-41ab-b1e7-0ff3cda137f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:26.380727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2cd54636-06f1-41ab-b1e7-0ff3cda137f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:26.382297 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1024/2053] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:34:26 2022] DELETE /identity/v3/projects/d55fc772eecc428aa18c061e120b7186 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:26.387956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15980b2e-ddb4-405d-b03a-661193579999 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:26.388905 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15980b2e-ddb4-405d-b03a-661193579999 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:26.389398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15980b2e-ddb4-405d-b03a-661193579999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:26.410522 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-15980b2e-ddb4-405d-b03a-661193579999 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:26.411977 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-15980b2e-ddb4-405d-b03a-661193579999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:26.470600 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112412a-3b40-4d58-87e0-60ed916f5410 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:26.471175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112412a-3b40-4d58-87e0-60ed916f5410 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:26.471821 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112412a-3b40-4d58-87e0-60ed916f5410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:26.487751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1030/2054] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:26.489095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4a970-1beb-4f3e-9011-185e8ba9caa9 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:26.489350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4a970-1beb-4f3e-9011-185e8ba9caa9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:26.489662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4a970-1beb-4f3e-9011-185e8ba9caa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:26.514742 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d112412a-3b40-4d58-87e0-60ed916f5410 None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:26.524176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d112412a-3b40-4d58-87e0-60ed916f5410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:26.537244 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-d6a4a970-1beb-4f3e-9011-185e8ba9caa9 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:26.538828 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d6a4a970-1beb-4f3e-9011-185e8ba9caa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:26.549189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1031/2055] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:26.557558 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4a970-1beb-4f3e-9011-185e8ba9caa9 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:26.567734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4a970-1beb-4f3e-9011-185e8ba9caa9 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:26.573405 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21008b1-e9e0-4cf8-8ab4-e261a905693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:26.574122 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21008b1-e9e0-4cf8-8ab4-e261a905693a admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:26.574479 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21008b1-e9e0-4cf8-8ab4-e261a905693a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:26.574830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21008b1-e9e0-4cf8-8ab4-e261a905693a admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:26.575774 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21008b1-e9e0-4cf8-8ab4-e261a905693a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:34:26.576909 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21008b1-e9e0-4cf8-8ab4-e261a905693a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:26.577768 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21008b1-e9e0-4cf8-8ab4-e261a905693a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:26.592212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1032/2056] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:34:26.596889 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21008b1-e9e0-4cf8-8ab4-e261a905693a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:26.609167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1025/2057] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jul 28 05:34:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:26.613734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21008b1-e9e0-4cf8-8ab4-e261a905693a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:26.619776 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ba51d-f19e-412e-81e6-aa6024a7b435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:26.620503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba51d-f19e-412e-81e6-aa6024a7b435 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:26.620792 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba51d-f19e-412e-81e6-aa6024a7b435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:26.621058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba51d-f19e-412e-81e6-aa6024a7b435 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:26.621856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ba51d-f19e-412e-81e6-aa6024a7b435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:26.624114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ba51d-f19e-412e-81e6-aa6024a7b435 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:26.625018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112412a-3b40-4d58-87e0-60ed916f5410 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:26.627111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d112412a-3b40-4d58-87e0-60ed916f5410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:26.702940 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112412a-3b40-4d58-87e0-60ed916f5410 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:26.708411 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e9141-28e5-470b-80d4-1e239a450b14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:26.708955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e9141-28e5-470b-80d4-1e239a450b14 service swift] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:26.709297 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e9141-28e5-470b-80d4-1e239a450b14 service swift] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:26.709633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e9141-28e5-470b-80d4-1e239a450b14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:26.715237 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:26.718708 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1033/2058] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:34:26 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:34:26.718895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e9141-28e5-470b-80d4-1e239a450b14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:26.720575 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e9141-28e5-470b-80d4-1e239a450b14 service swift] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:26.722924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ba51d-f19e-412e-81e6-aa6024a7b435 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:26.730532 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1026/2059] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:34:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 05:34:26.778254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:26.789183 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ba51d-f19e-412e-81e6-aa6024a7b435 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:26.794730 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085d3ad-5dc2-4762-817f-4609c74f6c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:26.795471 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085d3ad-5dc2-4762-817f-4609c74f6c6c admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:26.795734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085d3ad-5dc2-4762-817f-4609c74f6c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:26.796010 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085d3ad-5dc2-4762-817f-4609c74f6c6c admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:26.796700 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085d3ad-5dc2-4762-817f-4609c74f6c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:26.798738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085d3ad-5dc2-4762-817f-4609c74f6c6c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:26.928581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1034/2060] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:34:26 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:34:26.933610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e9141-28e5-470b-80d4-1e239a450b14 service swift] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:26.946223 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e9141-28e5-470b-80d4-1e239a450b14 service swift] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:26.952917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad74d1d-2b16-436b-a784-b9cde8918621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:26.953715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad74d1d-2b16-436b-a784-b9cde8918621 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:26.954459 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad74d1d-2b16-436b-a784-b9cde8918621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:26.954879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad74d1d-2b16-436b-a784-b9cde8918621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:26.956132 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad74d1d-2b16-436b-a784-b9cde8918621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:26.958707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad74d1d-2b16-436b-a784-b9cde8918621 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:26.974230 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1027/2061] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:34:26.979078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085d3ad-5dc2-4762-817f-4609c74f6c6c admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:26.992924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085d3ad-5dc2-4762-817f-4609c74f6c6c admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:27.002098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a89698-0a2c-451b-becc-11f6a925e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:27.002794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a89698-0a2c-451b-becc-11f6a925e602 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:27.003134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a89698-0a2c-451b-becc-11f6a925e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:27.003406 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a89698-0a2c-451b-becc-11f6a925e602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:27.004229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a89698-0a2c-451b-becc-11f6a925e602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:27.006094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a89698-0a2c-451b-becc-11f6a925e602 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:27.019001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1035/2062] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:34:27.023568 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad74d1d-2b16-436b-a784-b9cde8918621 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:27.035745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad74d1d-2b16-436b-a784-b9cde8918621 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:27.042154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc25d32-b05f-483d-9ca4-0c588258866d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:27.043144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc25d32-b05f-483d-9ca4-0c588258866d admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:27.044173 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc25d32-b05f-483d-9ca4-0c588258866d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:27.044589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc25d32-b05f-483d-9ca4-0c588258866d admin admin] PATH_INFO: `/v3/projects/2d10c67ca4a343659a4e447b784a07f4/users/a61a071bcd0a455da03525137e3c3f62/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:27.066237 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc25d32-b05f-483d-9ca4-0c588258866d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d10c67ca4a343659a4e447b784a07f4, user_id=a61a071bcd0a455da03525137e3c3f62, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:27.069235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc25d32-b05f-483d-9ca4-0c588258866d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:27.178180 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a30864-0980-4e5c-b021-1d7892f64ea9 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:27.178503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a30864-0980-4e5c-b021-1d7892f64ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:27.178849 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a30864-0980-4e5c-b021-1d7892f64ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:27.179340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1028/2063] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:34:27 2022] PUT /identity/v3/projects/2d10c67ca4a343659a4e447b784a07f4/users/a61a071bcd0a455da03525137e3c3f62/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:27.219140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-29a30864-0980-4e5c-b021-1d7892f64ea9 None None] MFA Rules not processed for user `a61a071bcd0a455da03525137e3c3f62`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:27.220440 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-29a30864-0980-4e5c-b021-1d7892f64ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:27.324959 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1036/2064] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:27.325316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc25d32-b05f-483d-9ca4-0c588258866d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:27.397974 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc25d32-b05f-483d-9ca4-0c588258866d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:27.402960 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c10aa0-5f3e-418a-a6e8-8252ffc3837e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:27.403597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c10aa0-5f3e-418a-a6e8-8252ffc3837e admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:27.403877 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c10aa0-5f3e-418a-a6e8-8252ffc3837e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:27.404148 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c10aa0-5f3e-418a-a6e8-8252ffc3837e admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:27.404934 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c10aa0-5f3e-418a-a6e8-8252ffc3837e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:27.407351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c10aa0-5f3e-418a-a6e8-8252ffc3837e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:27.500387 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1029/2065] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:34:27 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:34:27.504740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a30864-0980-4e5c-b021-1d7892f64ea9 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:27.516534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a30864-0980-4e5c-b021-1d7892f64ea9 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:27.586837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37c60f-ea2b-4486-a60d-757ff087b9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:27.587608 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37c60f-ea2b-4486-a60d-757ff087b9fe admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:27.588161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37c60f-ea2b-4486-a60d-757ff087b9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:27.588523 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37c60f-ea2b-4486-a60d-757ff087b9fe admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:27.589503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37c60f-ea2b-4486-a60d-757ff087b9fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:27.591498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37c60f-ea2b-4486-a60d-757ff087b9fe admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:27.682886 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1037/2066] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:34:27 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:34:27.686840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c10aa0-5f3e-418a-a6e8-8252ffc3837e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:27.699448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c10aa0-5f3e-418a-a6e8-8252ffc3837e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:27.704996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1dc65-ac43-40c2-bccc-e29671914e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:27.705601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1dc65-ac43-40c2-bccc-e29671914e13 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:27.705601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1dc65-ac43-40c2-bccc-e29671914e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:27.705781 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1dc65-ac43-40c2-bccc-e29671914e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:27.706437 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1dc65-ac43-40c2-bccc-e29671914e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:27.708045 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1dc65-ac43-40c2-bccc-e29671914e13 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:27.721924 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1030/2067] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:34:27.726094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37c60f-ea2b-4486-a60d-757ff087b9fe admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:27.738528 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37c60f-ea2b-4486-a60d-757ff087b9fe admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:27.744162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3bb52-6a31-4777-b632-dd285c1c0841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:27.745021 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3bb52-6a31-4777-b632-dd285c1c0841 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:27.745454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3bb52-6a31-4777-b632-dd285c1c0841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:27.745861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3bb52-6a31-4777-b632-dd285c1c0841 admin admin] PATH_INFO: `/v3/projects/e6b3e84f9bc74874aee0e8a8e8218f6c/users/842e3b20d60e483bafad852c031627f4/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:27.762954 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3bb52-6a31-4777-b632-dd285c1c0841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b3e84f9bc74874aee0e8a8e8218f6c, user_id=842e3b20d60e483bafad852c031627f4, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:27.765745 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3bb52-6a31-4777-b632-dd285c1c0841 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:27.873938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1038/2068] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:34:27 2022] PUT /identity/v3/projects/e6b3e84f9bc74874aee0e8a8e8218f6c/users/842e3b20d60e483bafad852c031627f4/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:27.878040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1dc65-ac43-40c2-bccc-e29671914e13 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:27.902496 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1dc65-ac43-40c2-bccc-e29671914e13 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:27.971052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a42d00-5eb5-44de-8459-289840ff6fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:27.971713 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a42d00-5eb5-44de-8459-289840ff6fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:27.971998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a42d00-5eb5-44de-8459-289840ff6fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:27.972271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a42d00-5eb5-44de-8459-289840ff6fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:27.978648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a42d00-5eb5-44de-8459-289840ff6fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:27.978648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a42d00-5eb5-44de-8459-289840ff6fc0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:27.989037 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1031/2069] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:34:27.990491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3bb52-6a31-4777-b632-dd285c1c0841 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:28.001864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3bb52-6a31-4777-b632-dd285c1c0841 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:28.012710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69099f-62f4-4be7-9880-bda8deb4269b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:28.012710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69099f-62f4-4be7-9880-bda8deb4269b admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:28.012710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69099f-62f4-4be7-9880-bda8deb4269b admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:28.012710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69099f-62f4-4be7-9880-bda8deb4269b admin admin] PATH_INFO: `/v3/projects/e6b3e84f9bc74874aee0e8a8e8218f6c/users/842e3b20d60e483bafad852c031627f4/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:28.013071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69099f-62f4-4be7-9880-bda8deb4269b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b3e84f9bc74874aee0e8a8e8218f6c, user_id=842e3b20d60e483bafad852c031627f4, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:28.015078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69099f-62f4-4be7-9880-bda8deb4269b admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:28.027088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1039/2070] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:34:27 2022] PUT /identity/v3/projects/e6b3e84f9bc74874aee0e8a8e8218f6c/users/842e3b20d60e483bafad852c031627f4/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:28.038246 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb9dd7-b616-4508-b7d2-85071bb50345 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:28.038832 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb9dd7-b616-4508-b7d2-85071bb50345 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:28.038832 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb9dd7-b616-4508-b7d2-85071bb50345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:28.069270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2bfb9dd7-b616-4508-b7d2-85071bb50345 None None] MFA Rules not processed for user `842e3b20d60e483bafad852c031627f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:28.070536 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2bfb9dd7-b616-4508-b7d2-85071bb50345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:28.091495 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:28.147511 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1032/2071] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:28.160915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69099f-62f4-4be7-9880-bda8deb4269b admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:28.162766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ab69099f-62f4-4be7-9880-bda8deb4269b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:28.186853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:28.237317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69099f-62f4-4be7-9880-bda8deb4269b admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:28.241794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33316459-128a-4136-8438-3cffcdebf142 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:28.242427 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33316459-128a-4136-8438-3cffcdebf142 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:28.242717 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33316459-128a-4136-8438-3cffcdebf142 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:28.243314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33316459-128a-4136-8438-3cffcdebf142 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:28.253061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33316459-128a-4136-8438-3cffcdebf142 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:28.254563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33316459-128a-4136-8438-3cffcdebf142 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:28.273827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1040/2072] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:29.914685 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb9dd7-b616-4508-b7d2-85071bb50345 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:29.924684 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb9dd7-b616-4508-b7d2-85071bb50345 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:29.929448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea00ce7-c22b-4b5a-acc6-f70bc8bf1bee tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842e3b20d60e483bafad852c031627f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b3e84f9bc74874aee0e8a8e8218f6c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:29.930110 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea00ce7-c22b-4b5a-acc6-f70bc8bf1bee tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:29.930524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea00ce7-c22b-4b5a-acc6-f70bc8bf1bee tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:29.930743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea00ce7-c22b-4b5a-acc6-f70bc8bf1bee tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:29.931925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea00ce7-c22b-4b5a-acc6-f70bc8bf1bee tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:34:29.932333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea00ce7-c22b-4b5a-acc6-f70bc8bf1bee tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:29.934184 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea00ce7-c22b-4b5a-acc6-f70bc8bf1bee tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:29.962147 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1033/2073] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:34:29.964460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33316459-128a-4136-8438-3cffcdebf142 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:29.974842 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33316459-128a-4136-8438-3cffcdebf142 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:29.979836 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27e78e-87b8-4688-ae92-e4bce6ae005e tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842e3b20d60e483bafad852c031627f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b3e84f9bc74874aee0e8a8e8218f6c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:29.982314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27e78e-87b8-4688-ae92-e4bce6ae005e tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:29.982314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27e78e-87b8-4688-ae92-e4bce6ae005e tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:29.982314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27e78e-87b8-4688-ae92-e4bce6ae005e tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:29.982314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27e78e-87b8-4688-ae92-e4bce6ae005e tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:29.983659 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27e78e-87b8-4688-ae92-e4bce6ae005e tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:30.096964 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1041/2074] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:34:29 2022] POST /identity/v3/projects => generated 355 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:34:30.101115 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea00ce7-c22b-4b5a-acc6-f70bc8bf1bee tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:30.111627 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea00ce7-c22b-4b5a-acc6-f70bc8bf1bee tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:30.183001 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a2c20-b81f-4d7d-94e7-108c960a337f tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842e3b20d60e483bafad852c031627f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b3e84f9bc74874aee0e8a8e8218f6c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:30.183572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a2c20-b81f-4d7d-94e7-108c960a337f tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:30.183858 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a2c20-b81f-4d7d-94e7-108c960a337f tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:30.184263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a2c20-b81f-4d7d-94e7-108c960a337f tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:30.185034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a2c20-b81f-4d7d-94e7-108c960a337f tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:34:30.185589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a2c20-b81f-4d7d-94e7-108c960a337f tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:30.190031 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a2c20-b81f-4d7d-94e7-108c960a337f tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:30.201362 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1034/2075] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:34:30.241255 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27e78e-87b8-4688-ae92-e4bce6ae005e tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:30.252988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27e78e-87b8-4688-ae92-e4bce6ae005e tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:30.257702 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34cc4d-1f0b-49c0-ade4-3186d6b607d4 tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842e3b20d60e483bafad852c031627f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b3e84f9bc74874aee0e8a8e8218f6c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:30.258351 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34cc4d-1f0b-49c0-ade4-3186d6b607d4 tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:30.258641 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34cc4d-1f0b-49c0-ade4-3186d6b607d4 tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:30.260226 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34cc4d-1f0b-49c0-ade4-3186d6b607d4 tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] PATH_INFO: `/v3/projects/9229229fcf4240e994704e35a0d79490` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:30.261742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34cc4d-1f0b-49c0-ade4-3186d6b607d4 tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9229229fcf4240e994704e35a0d79490)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:30.263819 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34cc4d-1f0b-49c0-ade4-3186d6b607d4 tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:30.391502 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2d34cc4d-1f0b-49c0-ade4-3186d6b607d4 tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9229229fcf4240e994704e35a0d79490', 'request_id': 'req-2d34cc4d-1f0b-49c0-ade4-3186d6b607d4'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:30.515191 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2d34cc4d-1f0b-49c0-ade4-3186d6b607d4 tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9229229fcf4240e994704e35a0d79490', 'request_id': 'req-2d34cc4d-1f0b-49c0-ade4-3186d6b607d4'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:30.524018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2d34cc4d-1f0b-49c0-ade4-3186d6b607d4 tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9229229fcf4240e994704e35a0d79490', 'request_id': 'req-2d34cc4d-1f0b-49c0-ade4-3186d6b607d4'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:30.543277 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2d34cc4d-1f0b-49c0-ade4-3186d6b607d4 tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] The token cache is being invalidate because project 9229229fcf4240e994704e35a0d79490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:34:30.543570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2d34cc4d-1f0b-49c0-ade4-3186d6b607d4 tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:30.544247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2d34cc4d-1f0b-49c0-ade4-3186d6b607d4 tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:30.546287 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1042/2076] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:34:30 2022] DELETE /identity/v3/projects/9229229fcf4240e994704e35a0d79490 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:31.729752 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a2c20-b81f-4d7d-94e7-108c960a337f tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:31.732337 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-362a2c20-b81f-4d7d-94e7-108c960a337f tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:31.828481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a2c20-b81f-4d7d-94e7-108c960a337f tempest-VolumeQuotaClassesTest-805692138 tempest-VolumeQuotaClassesTest-805692138-project-admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:31.882305 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:31.899436 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2ebf8-a096-42a2-b361-0542a9a32f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:31.902721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2ebf8-a096-42a2-b361-0542a9a32f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:31.902721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2ebf8-a096-42a2-b361-0542a9a32f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:31.902721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2ebf8-a096-42a2-b361-0542a9a32f9d admin admin] PATH_INFO: `/v3/users/a61a071bcd0a455da03525137e3c3f62` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:31.902721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2ebf8-a096-42a2-b361-0542a9a32f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a61a071bcd0a455da03525137e3c3f62)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:31.904504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2ebf8-a096-42a2-b361-0542a9a32f9d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:32.185681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cee2ebf8-a096-42a2-b361-0542a9a32f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a61a071bcd0a455da03525137e3c3f62'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:32.186261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cee2ebf8-a096-42a2-b361-0542a9a32f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a61a071bcd0a455da03525137e3c3f62'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:32.256763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cee2ebf8-a096-42a2-b361-0542a9a32f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a61a071bcd0a455da03525137e3c3f62'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:32.279074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cee2ebf8-a096-42a2-b361-0542a9a32f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a61a071bcd0a455da03525137e3c3f62'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:32.279903 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cee2ebf8-a096-42a2-b361-0542a9a32f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a61a071bcd0a455da03525137e3c3f62'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:32.299206 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1035/2077] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:34:31 2022] DELETE /identity/v3/users/a61a071bcd0a455da03525137e3c3f62 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:32.304423 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258a3a9-0ce8-43a5-96fe-84dcb6fc5bc6 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:32.304945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258a3a9-0ce8-43a5-96fe-84dcb6fc5bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:32.305105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258a3a9-0ce8-43a5-96fe-84dcb6fc5bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:32.325098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-4258a3a9-0ce8-43a5-96fe-84dcb6fc5bc6 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:32.326445 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4258a3a9-0ce8-43a5-96fe-84dcb6fc5bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:32.424437 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1043/2078] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:32.438651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2ebf8-a096-42a2-b361-0542a9a32f9d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:32.440946 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cee2ebf8-a096-42a2-b361-0542a9a32f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:32.530832 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2ebf8-a096-42a2-b361-0542a9a32f9d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:32.535042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb83f6a-5783-44c0-9cf2-9e9bbc49319c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:32.535954 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb83f6a-5783-44c0-9cf2-9e9bbc49319c service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:32.536399 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb83f6a-5783-44c0-9cf2-9e9bbc49319c service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:32.536847 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb83f6a-5783-44c0-9cf2-9e9bbc49319c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:32.548586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb83f6a-5783-44c0-9cf2-9e9bbc49319c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:32.553039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb83f6a-5783-44c0-9cf2-9e9bbc49319c service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:32.560801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1036/2079] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:33.268867 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258a3a9-0ce8-43a5-96fe-84dcb6fc5bc6 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:33.276691 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4258a3a9-0ce8-43a5-96fe-84dcb6fc5bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:33.296203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258a3a9-0ce8-43a5-96fe-84dcb6fc5bc6 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:33.301350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4c48d-e9fb-4aef-b151-24ede71aec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:33.302154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4c48d-e9fb-4aef-b151-24ede71aec8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:33.302439 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4c48d-e9fb-4aef-b151-24ede71aec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:33.302719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4c48d-e9fb-4aef-b151-24ede71aec8b admin admin] PATH_INFO: `/v3/projects/2d10c67ca4a343659a4e447b784a07f4` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:33.303899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4c48d-e9fb-4aef-b151-24ede71aec8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d10c67ca4a343659a4e447b784a07f4)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:33.305925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4c48d-e9fb-4aef-b151-24ede71aec8b admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:33.317161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:33.408981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-eef4c48d-e9fb-4aef-b151-24ede71aec8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d10c67ca4a343659a4e447b784a07f4', 'request_id': 'req-eef4c48d-e9fb-4aef-b151-24ede71aec8b'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:33.503272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-eef4c48d-e9fb-4aef-b151-24ede71aec8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d10c67ca4a343659a4e447b784a07f4', 'request_id': 'req-eef4c48d-e9fb-4aef-b151-24ede71aec8b'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:33.509942 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-eef4c48d-e9fb-4aef-b151-24ede71aec8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d10c67ca4a343659a4e447b784a07f4', 'request_id': 'req-eef4c48d-e9fb-4aef-b151-24ede71aec8b'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:33.522413 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-eef4c48d-e9fb-4aef-b151-24ede71aec8b admin admin] The token cache is being invalidate because project 2d10c67ca4a343659a4e447b784a07f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:34:33.523509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-eef4c48d-e9fb-4aef-b151-24ede71aec8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:33.523509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-eef4c48d-e9fb-4aef-b151-24ede71aec8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:33.524989 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1044/2080] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:34:33 2022] DELETE /identity/v3/projects/2d10c67ca4a343659a4e447b784a07f4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:33.529185 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb83f6a-5783-44c0-9cf2-9e9bbc49319c service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:33.540148 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb83f6a-5783-44c0-9cf2-9e9bbc49319c service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:33.601366 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a88db-2478-42af-accf-37846c15d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:33.602046 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a88db-2478-42af-accf-37846c15d4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:33.602327 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a88db-2478-42af-accf-37846c15d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:33.603244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a88db-2478-42af-accf-37846c15d4fe admin admin] PATH_INFO: `/v3/users/842e3b20d60e483bafad852c031627f4` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:33.604496 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a88db-2478-42af-accf-37846c15d4fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=842e3b20d60e483bafad852c031627f4)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:33.606520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a88db-2478-42af-accf-37846c15d4fe admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:33.614064 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:34.042539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8e6a88db-2478-42af-accf-37846c15d4fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842e3b20d60e483bafad852c031627f4'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:34.043190 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8e6a88db-2478-42af-accf-37846c15d4fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842e3b20d60e483bafad852c031627f4'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:34.110878 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8e6a88db-2478-42af-accf-37846c15d4fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842e3b20d60e483bafad852c031627f4'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:34.128395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8e6a88db-2478-42af-accf-37846c15d4fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842e3b20d60e483bafad852c031627f4'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:34.129127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8e6a88db-2478-42af-accf-37846c15d4fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842e3b20d60e483bafad852c031627f4'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:34.147771 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1037/2081] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:34:33 2022] DELETE /identity/v3/users/842e3b20d60e483bafad852c031627f4 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:34.789532 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4c48d-e9fb-4aef-b151-24ede71aec8b admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:34.791257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-eef4c48d-e9fb-4aef-b151-24ede71aec8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:34.805237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4c48d-e9fb-4aef-b151-24ede71aec8b admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:34.866182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299d405-0364-4dff-ad9d-6441b94392be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:34.866826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299d405-0364-4dff-ad9d-6441b94392be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:34.867105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299d405-0364-4dff-ad9d-6441b94392be admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:34.867375 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299d405-0364-4dff-ad9d-6441b94392be admin admin] PATH_INFO: `/v3/projects/e6b3e84f9bc74874aee0e8a8e8218f6c` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:34.869318 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299d405-0364-4dff-ad9d-6441b94392be admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6b3e84f9bc74874aee0e8a8e8218f6c)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:34.871508 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299d405-0364-4dff-ad9d-6441b94392be admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:34.984311 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1299d405-0364-4dff-ad9d-6441b94392be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6b3e84f9bc74874aee0e8a8e8218f6c', 'request_id': 'req-1299d405-0364-4dff-ad9d-6441b94392be'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:35.057495 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1299d405-0364-4dff-ad9d-6441b94392be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6b3e84f9bc74874aee0e8a8e8218f6c', 'request_id': 'req-1299d405-0364-4dff-ad9d-6441b94392be'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:35.064417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1299d405-0364-4dff-ad9d-6441b94392be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6b3e84f9bc74874aee0e8a8e8218f6c', 'request_id': 'req-1299d405-0364-4dff-ad9d-6441b94392be'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:35.077205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1299d405-0364-4dff-ad9d-6441b94392be admin admin] The token cache is being invalidate because project e6b3e84f9bc74874aee0e8a8e8218f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:34:35.077559 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1299d405-0364-4dff-ad9d-6441b94392be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:35.078448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1299d405-0364-4dff-ad9d-6441b94392be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:35.080046 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1045/2082] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:34:34 2022] DELETE /identity/v3/projects/e6b3e84f9bc74874aee0e8a8e8218f6c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:35.084923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bd48e-dd4e-4d6d-aa3c-cadef52d2b58 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:35.086765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bd48e-dd4e-4d6d-aa3c-cadef52d2b58 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:35.087083 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bd48e-dd4e-4d6d-aa3c-cadef52d2b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:35.108845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-0b7bd48e-dd4e-4d6d-aa3c-cadef52d2b58 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:35.110102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0b7bd48e-dd4e-4d6d-aa3c-cadef52d2b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:35.178154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1038/2083] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:35.186930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88629055-134a-44fc-8e54-c9a47e67401f None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:35.187236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88629055-134a-44fc-8e54-c9a47e67401f None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:35.187491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88629055-134a-44fc-8e54-c9a47e67401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:35.219121 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-88629055-134a-44fc-8e54-c9a47e67401f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:35.220116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-88629055-134a-44fc-8e54-c9a47e67401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:35.230326 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1046/2084] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:35.236836 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bd48e-dd4e-4d6d-aa3c-cadef52d2b58 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:35.247487 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bd48e-dd4e-4d6d-aa3c-cadef52d2b58 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:35.252211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a441e8-1676-441a-90c1-d6aed189a84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:35.252828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a441e8-1676-441a-90c1-d6aed189a84b admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:35.253104 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a441e8-1676-441a-90c1-d6aed189a84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:35.253373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a441e8-1676-441a-90c1-d6aed189a84b admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:35.254104 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a441e8-1676-441a-90c1-d6aed189a84b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:34:35.254410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a441e8-1676-441a-90c1-d6aed189a84b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:35.256138 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a441e8-1676-441a-90c1-d6aed189a84b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:35.273876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1039/2085] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:34:35.278751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88629055-134a-44fc-8e54-c9a47e67401f None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:35.295495 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88629055-134a-44fc-8e54-c9a47e67401f None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:35.300549 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ccda6-78e5-4149-8a61-a1bcfcb0223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:35.301807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ccda6-78e5-4149-8a61-a1bcfcb0223d admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:35.301807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ccda6-78e5-4149-8a61-a1bcfcb0223d admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:35.302147 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ccda6-78e5-4149-8a61-a1bcfcb0223d admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:35.302982 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ccda6-78e5-4149-8a61-a1bcfcb0223d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:35.305176 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ccda6-78e5-4149-8a61-a1bcfcb0223d admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:35.401995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:35.409378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1047/2086] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:34:35 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:34:35.414778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a441e8-1676-441a-90c1-d6aed189a84b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:35.425348 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a441e8-1676-441a-90c1-d6aed189a84b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:35.484456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e9f75-17a9-4f2a-bb9a-ae43d08a88fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:35.485083 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e9f75-17a9-4f2a-bb9a-ae43d08a88fe admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:35.485360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e9f75-17a9-4f2a-bb9a-ae43d08a88fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:35.485712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e9f75-17a9-4f2a-bb9a-ae43d08a88fe admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:35.486427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e9f75-17a9-4f2a-bb9a-ae43d08a88fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:35.488319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e9f75-17a9-4f2a-bb9a-ae43d08a88fe admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:35.563084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:35.568830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1040/2087] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:34:35 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:34:35.575181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ccda6-78e5-4149-8a61-a1bcfcb0223d admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:35.585176 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ccda6-78e5-4149-8a61-a1bcfcb0223d admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:35.590624 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5b90a-1610-46b2-b7cb-a14839d03259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:35.591360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5b90a-1610-46b2-b7cb-a14839d03259 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:35.591793 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5b90a-1610-46b2-b7cb-a14839d03259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:35.592144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5b90a-1610-46b2-b7cb-a14839d03259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:35.593010 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5b90a-1610-46b2-b7cb-a14839d03259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:35.595022 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5b90a-1610-46b2-b7cb-a14839d03259 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:35.609136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1048/2088] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:34:35.613232 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e9f75-17a9-4f2a-bb9a-ae43d08a88fe admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:35.625580 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e9f75-17a9-4f2a-bb9a-ae43d08a88fe admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:35.631542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f07183-f99b-4967-a950-bf5c7dd649a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:35.632367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f07183-f99b-4967-a950-bf5c7dd649a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:35.632645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f07183-f99b-4967-a950-bf5c7dd649a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:35.633008 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f07183-f99b-4967-a950-bf5c7dd649a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:35.633661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f07183-f99b-4967-a950-bf5c7dd649a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:35.636486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f07183-f99b-4967-a950-bf5c7dd649a8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:35.650345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1041/2089] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:34:35.657807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5b90a-1610-46b2-b7cb-a14839d03259 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:35.671837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5b90a-1610-46b2-b7cb-a14839d03259 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:35.687075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154d342-9521-48a1-ae3b-525aa13afddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:35.690136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154d342-9521-48a1-ae3b-525aa13afddf admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:35.690136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154d342-9521-48a1-ae3b-525aa13afddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:35.690136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154d342-9521-48a1-ae3b-525aa13afddf admin admin] PATH_INFO: `/v3/projects/b79fdb12b62c4af1967ff7d193cf5c4b/users/510906ec8a6147e5a774cf418a9e2c99/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:35.704478 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154d342-9521-48a1-ae3b-525aa13afddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79fdb12b62c4af1967ff7d193cf5c4b, user_id=510906ec8a6147e5a774cf418a9e2c99, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:35.707235 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154d342-9521-48a1-ae3b-525aa13afddf admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:35.789296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1049/2090] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:34:35 2022] PUT /identity/v3/projects/b79fdb12b62c4af1967ff7d193cf5c4b/users/510906ec8a6147e5a774cf418a9e2c99/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:34:35.802008 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e375e2-c933-47ef-bf7f-623b0c9f1336 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:35.802518 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e375e2-c933-47ef-bf7f-623b0c9f1336 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:35.802790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e375e2-c933-47ef-bf7f-623b0c9f1336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:35.834811 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e5e375e2-c933-47ef-bf7f-623b0c9f1336 None None] MFA Rules not processed for user `510906ec8a6147e5a774cf418a9e2c99`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:35.836070 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e5e375e2-c933-47ef-bf7f-623b0c9f1336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:35.907768 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1042/2091] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:35.912330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154d342-9521-48a1-ae3b-525aa13afddf admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:35.982881 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154d342-9521-48a1-ae3b-525aa13afddf admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:35.988054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0627c-4395-42a2-b5c4-9378519aa4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:35.988700 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0627c-4395-42a2-b5c4-9378519aa4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:35.988985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0627c-4395-42a2-b5c4-9378519aa4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:35.989263 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0627c-4395-42a2-b5c4-9378519aa4e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:35.989991 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0627c-4395-42a2-b5c4-9378519aa4e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:35.991899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0627c-4395-42a2-b5c4-9378519aa4e5 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:36.099150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1050/2092] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:34:35 2022] POST /identity/v3/projects => generated 393 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:34:36.103999 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e375e2-c933-47ef-bf7f-623b0c9f1336 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:36.115084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e375e2-c933-47ef-bf7f-623b0c9f1336 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:36.177698 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a470601-eb58-4afd-a52a-245215a28e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:36.178340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a470601-eb58-4afd-a52a-245215a28e3b admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:36.178621 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a470601-eb58-4afd-a52a-245215a28e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:36.178899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a470601-eb58-4afd-a52a-245215a28e3b admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:36.179573 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a470601-eb58-4afd-a52a-245215a28e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:36.181940 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a470601-eb58-4afd-a52a-245215a28e3b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:36.293178 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1043/2093] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:34:36 2022] POST /identity/v3/users => generated 303 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:34:36.297257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0627c-4395-42a2-b5c4-9378519aa4e5 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:36.307562 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0627c-4395-42a2-b5c4-9378519aa4e5 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:36.312066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a0db4-373e-4744-a1b0-eec4420fe3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:36.312680 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a0db4-373e-4744-a1b0-eec4420fe3ff admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:36.312962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a0db4-373e-4744-a1b0-eec4420fe3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:36.313241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a0db4-373e-4744-a1b0-eec4420fe3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:36.313969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a0db4-373e-4744-a1b0-eec4420fe3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:36.315563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a0db4-373e-4744-a1b0-eec4420fe3ff admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:36.326638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1051/2094] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:34:36.331132 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a470601-eb58-4afd-a52a-245215a28e3b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:36.342559 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a470601-eb58-4afd-a52a-245215a28e3b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:36.347892 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3a027-f3f2-4b25-99c5-a0267c9f36ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:36.348598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3a027-f3f2-4b25-99c5-a0267c9f36ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:36.348965 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3a027-f3f2-4b25-99c5-a0267c9f36ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:36.349302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3a027-f3f2-4b25-99c5-a0267c9f36ac admin admin] PATH_INFO: `/v3/projects/9f412f94019d4f4384a0e567dc8ee1d5/users/abf0661cff1840059f313069b6a1f206/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:36.364897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3a027-f3f2-4b25-99c5-a0267c9f36ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f412f94019d4f4384a0e567dc8ee1d5, user_id=abf0661cff1840059f313069b6a1f206, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:36.367877 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3a027-f3f2-4b25-99c5-a0267c9f36ac admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:36.445159 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1044/2095] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:34:36 2022] PUT /identity/v3/projects/9f412f94019d4f4384a0e567dc8ee1d5/users/abf0661cff1840059f313069b6a1f206/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:36.449504 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a0db4-373e-4744-a1b0-eec4420fe3ff admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:36.459947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a0db4-373e-4744-a1b0-eec4420fe3ff admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:36.523153 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc9a63-9121-4205-a0b6-65ecfcb8e934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:36.523903 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc9a63-9121-4205-a0b6-65ecfcb8e934 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:36.524188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc9a63-9121-4205-a0b6-65ecfcb8e934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:36.524570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc9a63-9121-4205-a0b6-65ecfcb8e934 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:36.525647 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc9a63-9121-4205-a0b6-65ecfcb8e934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:36.527461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc9a63-9121-4205-a0b6-65ecfcb8e934 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:36.543123 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1052/2096] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:34:36.544285 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3a027-f3f2-4b25-99c5-a0267c9f36ac admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:36.554725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3a027-f3f2-4b25-99c5-a0267c9f36ac admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:36.560286 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d72ae-c034-4dd4-a600-6df44c1094c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:36.560964 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d72ae-c034-4dd4-a600-6df44c1094c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:36.561250 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d72ae-c034-4dd4-a600-6df44c1094c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:36.561556 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d72ae-c034-4dd4-a600-6df44c1094c5 admin admin] PATH_INFO: `/v3/projects/9f412f94019d4f4384a0e567dc8ee1d5/users/abf0661cff1840059f313069b6a1f206/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:36.571396 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d72ae-c034-4dd4-a600-6df44c1094c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f412f94019d4f4384a0e567dc8ee1d5, user_id=abf0661cff1840059f313069b6a1f206, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:36.574311 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d72ae-c034-4dd4-a600-6df44c1094c5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:36.591448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1045/2097] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:34:36 2022] PUT /identity/v3/projects/9f412f94019d4f4384a0e567dc8ee1d5/users/abf0661cff1840059f313069b6a1f206/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:36.602287 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29d2b7-d27f-4241-ac89-373b395e2ef1 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:36.602509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29d2b7-d27f-4241-ac89-373b395e2ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:36.603379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29d2b7-d27f-4241-ac89-373b395e2ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:36.633978 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-9d29d2b7-d27f-4241-ac89-373b395e2ef1 None None] MFA Rules not processed for user `abf0661cff1840059f313069b6a1f206`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:36.635231 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9d29d2b7-d27f-4241-ac89-373b395e2ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:36.661649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:36.707673 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1053/2098] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:36.719625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d72ae-c034-4dd4-a600-6df44c1094c5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:36.724146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-625d72ae-c034-4dd4-a600-6df44c1094c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:36.757030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:36.782340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d72ae-c034-4dd4-a600-6df44c1094c5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:36.786304 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6baa2c-6d32-4a93-8b33-cbe4b991e936 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:36.786933 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6baa2c-6d32-4a93-8b33-cbe4b991e936 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:36.787216 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6baa2c-6d32-4a93-8b33-cbe4b991e936 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:36.787516 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6baa2c-6d32-4a93-8b33-cbe4b991e936 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:36.798212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6baa2c-6d32-4a93-8b33-cbe4b991e936 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:36.802702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6baa2c-6d32-4a93-8b33-cbe4b991e936 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:36.810498 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1046/2099] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:36.860835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29d2b7-d27f-4241-ac89-373b395e2ef1 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:36.860835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9d29d2b7-d27f-4241-ac89-373b395e2ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:36.872218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29d2b7-d27f-4241-ac89-373b395e2ef1 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:36.875843 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021a8f4-1622-4801-a4fa-32ec23cd8cf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:36.876592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021a8f4-1622-4801-a4fa-32ec23cd8cf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:36.876904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021a8f4-1622-4801-a4fa-32ec23cd8cf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:36.877184 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021a8f4-1622-4801-a4fa-32ec23cd8cf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:36.935648 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021a8f4-1622-4801-a4fa-32ec23cd8cf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:36.937184 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021a8f4-1622-4801-a4fa-32ec23cd8cf0 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:36.946265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1054/2100] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:36.992651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b28c5-1960-47b2-9a2b-7684eb3f8b1e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:36.993026 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b28c5-1960-47b2-9a2b-7684eb3f8b1e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:36.993353 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b28c5-1960-47b2-9a2b-7684eb3f8b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:37.012824 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-240b28c5-1960-47b2-9a2b-7684eb3f8b1e None None] MFA Rules not processed for user `02142b6537394571912b52f061aeb082`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:37.014071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-240b28c5-1960-47b2-9a2b-7684eb3f8b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:37.073189 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1047/2101] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:38.790587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021a8f4-1622-4801-a4fa-32ec23cd8cf0 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:38.792386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-1021a8f4-1622-4801-a4fa-32ec23cd8cf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:38.882131 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021a8f4-1622-4801-a4fa-32ec23cd8cf0 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:38.887931 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83dbd0-2227-4d10-80a8-3d579f67699c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aae5b2e7bf74805b04d01df47693ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:38.888572 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83dbd0-2227-4d10-80a8-3d579f67699c service placement] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:38.888861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83dbd0-2227-4d10-80a8-3d579f67699c service placement] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:38.889136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83dbd0-2227-4d10-80a8-3d579f67699c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:38.891267 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7a83dbd0-2227-4d10-80a8-3d579f67699c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:38.905377 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83dbd0-2227-4d10-80a8-3d579f67699c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:38.907153 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83dbd0-2227-4d10-80a8-3d579f67699c service placement] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:38.929695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1055/2102] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:41.633269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b28c5-1960-47b2-9a2b-7684eb3f8b1e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:41.701515 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b28c5-1960-47b2-9a2b-7684eb3f8b1e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:41.707108 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c85d05-e3d3-4b04-91a4-8ac4a930c62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:41.707766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c85d05-e3d3-4b04-91a4-8ac4a930c62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:41.708051 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c85d05-e3d3-4b04-91a4-8ac4a930c62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:41.708328 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c85d05-e3d3-4b04-91a4-8ac4a930c62f admin admin] PATH_INFO: `/v3/users/510906ec8a6147e5a774cf418a9e2c99` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:41.709536 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c85d05-e3d3-4b04-91a4-8ac4a930c62f admin admin] RBAC: Authorizing `identity:delete_user(user_id=510906ec8a6147e5a774cf418a9e2c99)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:41.711541 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c85d05-e3d3-4b04-91a4-8ac4a930c62f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:41.882973 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-51c85d05-e3d3-4b04-91a4-8ac4a930c62f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '510906ec8a6147e5a774cf418a9e2c99'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:41.884213 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-51c85d05-e3d3-4b04-91a4-8ac4a930c62f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '510906ec8a6147e5a774cf418a9e2c99'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:41.965825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-51c85d05-e3d3-4b04-91a4-8ac4a930c62f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '510906ec8a6147e5a774cf418a9e2c99'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:41.979265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-51c85d05-e3d3-4b04-91a4-8ac4a930c62f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '510906ec8a6147e5a774cf418a9e2c99'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:41.980010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-51c85d05-e3d3-4b04-91a4-8ac4a930c62f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '510906ec8a6147e5a774cf418a9e2c99'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:41.988992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:41.995321 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1048/2103] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:34:41 2022] DELETE /identity/v3/users/510906ec8a6147e5a774cf418a9e2c99 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:41.999738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931488f-5f9a-4893-aacc-4f9663db53d2 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:42.000201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931488f-5f9a-4893-aacc-4f9663db53d2 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:42.000326 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931488f-5f9a-4893-aacc-4f9663db53d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:42.024415 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-5931488f-5f9a-4893-aacc-4f9663db53d2 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:42.025788 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5931488f-5f9a-4893-aacc-4f9663db53d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:42.073113 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:42.088881 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1056/2104] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:42.098718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c85d05-e3d3-4b04-91a4-8ac4a930c62f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:42.100182 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-51c85d05-e3d3-4b04-91a4-8ac4a930c62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:42.162424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c85d05-e3d3-4b04-91a4-8ac4a930c62f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:42.166121 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43df3f-34ac-462e-9fe0-736efe9aab3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:42.166765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43df3f-34ac-462e-9fe0-736efe9aab3e service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:42.167047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43df3f-34ac-462e-9fe0-736efe9aab3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:42.167323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43df3f-34ac-462e-9fe0-736efe9aab3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:42.178347 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43df3f-34ac-462e-9fe0-736efe9aab3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:42.179896 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43df3f-34ac-462e-9fe0-736efe9aab3e service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:42.191349 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1049/2105] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:42.744782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931488f-5f9a-4893-aacc-4f9663db53d2 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:42.746598 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5931488f-5f9a-4893-aacc-4f9663db53d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:42.762149 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931488f-5f9a-4893-aacc-4f9663db53d2 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:42.770125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceace2e-03d1-45c3-a480-29de10b0ce9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:42.770125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceace2e-03d1-45c3-a480-29de10b0ce9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:42.770125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceace2e-03d1-45c3-a480-29de10b0ce9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:42.770125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceace2e-03d1-45c3-a480-29de10b0ce9a admin admin] PATH_INFO: `/v3/projects/b79fdb12b62c4af1967ff7d193cf5c4b` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:42.771331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceace2e-03d1-45c3-a480-29de10b0ce9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b79fdb12b62c4af1967ff7d193cf5c4b)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:42.772626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceace2e-03d1-45c3-a480-29de10b0ce9a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:42.869275 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4ceace2e-03d1-45c3-a480-29de10b0ce9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b79fdb12b62c4af1967ff7d193cf5c4b', 'request_id': 'req-4ceace2e-03d1-45c3-a480-29de10b0ce9a'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:42.931352 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4ceace2e-03d1-45c3-a480-29de10b0ce9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b79fdb12b62c4af1967ff7d193cf5c4b', 'request_id': 'req-4ceace2e-03d1-45c3-a480-29de10b0ce9a'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:42.937242 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4ceace2e-03d1-45c3-a480-29de10b0ce9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b79fdb12b62c4af1967ff7d193cf5c4b', 'request_id': 'req-4ceace2e-03d1-45c3-a480-29de10b0ce9a'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:42.948500 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4ceace2e-03d1-45c3-a480-29de10b0ce9a admin admin] The token cache is being invalidate because project b79fdb12b62c4af1967ff7d193cf5c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:34:42.948790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4ceace2e-03d1-45c3-a480-29de10b0ce9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:42.949498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4ceace2e-03d1-45c3-a480-29de10b0ce9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:42.951036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1057/2106] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:34:42 2022] DELETE /identity/v3/projects/b79fdb12b62c4af1967ff7d193cf5c4b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:42.955264 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43df3f-34ac-462e-9fe0-736efe9aab3e service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:42.965614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43df3f-34ac-462e-9fe0-736efe9aab3e service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:43.021571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8b9d1-d342-4d74-9780-6bcd9b1c8a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:43.022210 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b9d1-d342-4d74-9780-6bcd9b1c8a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:43.022525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b9d1-d342-4d74-9780-6bcd9b1c8a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:43.022759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b9d1-d342-4d74-9780-6bcd9b1c8a27 admin admin] PATH_INFO: `/v3/users/abf0661cff1840059f313069b6a1f206` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:43.023925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8b9d1-d342-4d74-9780-6bcd9b1c8a27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf0661cff1840059f313069b6a1f206)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:43.026364 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8b9d1-d342-4d74-9780-6bcd9b1c8a27 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:43.202792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-07f8b9d1-d342-4d74-9780-6bcd9b1c8a27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf0661cff1840059f313069b6a1f206'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:43.203381 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-07f8b9d1-d342-4d74-9780-6bcd9b1c8a27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf0661cff1840059f313069b6a1f206'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:43.262565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-07f8b9d1-d342-4d74-9780-6bcd9b1c8a27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf0661cff1840059f313069b6a1f206'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:43.276440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-07f8b9d1-d342-4d74-9780-6bcd9b1c8a27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf0661cff1840059f313069b6a1f206'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:43.277160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-07f8b9d1-d342-4d74-9780-6bcd9b1c8a27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf0661cff1840059f313069b6a1f206'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:43.289918 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1050/2107] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:34:42 2022] DELETE /identity/v3/users/abf0661cff1840059f313069b6a1f206 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:43.746019 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceace2e-03d1-45c3-a480-29de10b0ce9a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:43.747772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4ceace2e-03d1-45c3-a480-29de10b0ce9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:43.775700 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceace2e-03d1-45c3-a480-29de10b0ce9a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:43.847297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3984b2-3e9c-4eeb-8a2e-a7e3f9403ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:43.850105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3984b2-3e9c-4eeb-8a2e-a7e3f9403ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:43.850105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3984b2-3e9c-4eeb-8a2e-a7e3f9403ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:43.850105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3984b2-3e9c-4eeb-8a2e-a7e3f9403ae8 admin admin] PATH_INFO: `/v3/projects/9f412f94019d4f4384a0e567dc8ee1d5` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:43.850105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3984b2-3e9c-4eeb-8a2e-a7e3f9403ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f412f94019d4f4384a0e567dc8ee1d5)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:43.853098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3984b2-3e9c-4eeb-8a2e-a7e3f9403ae8 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:43.994038 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ad3984b2-3e9c-4eeb-8a2e-a7e3f9403ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f412f94019d4f4384a0e567dc8ee1d5', 'request_id': 'req-ad3984b2-3e9c-4eeb-8a2e-a7e3f9403ae8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:44.056594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ad3984b2-3e9c-4eeb-8a2e-a7e3f9403ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f412f94019d4f4384a0e567dc8ee1d5', 'request_id': 'req-ad3984b2-3e9c-4eeb-8a2e-a7e3f9403ae8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:44.062915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ad3984b2-3e9c-4eeb-8a2e-a7e3f9403ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f412f94019d4f4384a0e567dc8ee1d5', 'request_id': 'req-ad3984b2-3e9c-4eeb-8a2e-a7e3f9403ae8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:44.075098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ad3984b2-3e9c-4eeb-8a2e-a7e3f9403ae8 admin admin] The token cache is being invalidate because project 9f412f94019d4f4384a0e567dc8ee1d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:34:44.075417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ad3984b2-3e9c-4eeb-8a2e-a7e3f9403ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:44.076072 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ad3984b2-3e9c-4eeb-8a2e-a7e3f9403ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:44.077639 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1058/2108] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:34:43 2022] DELETE /identity/v3/projects/9f412f94019d4f4384a0e567dc8ee1d5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:44.083003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0220c1-3459-49e7-b483-f106eb552cf0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:44.083479 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0220c1-3459-49e7-b483-f106eb552cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:44.083589 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0220c1-3459-49e7-b483-f106eb552cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:44.103948 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8a0220c1-3459-49e7-b483-f106eb552cf0 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:44.105165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8a0220c1-3459-49e7-b483-f106eb552cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:44.118316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:44.165301 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1051/2109] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:44.173256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b20cd-784b-4094-b545-9a9a764cb594 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:44.173608 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b20cd-784b-4094-b545-9a9a764cb594 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:44.173896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b20cd-784b-4094-b545-9a9a764cb594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:44.182032 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:44.195226 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-827b20cd-784b-4094-b545-9a9a764cb594 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:44.197053 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-827b20cd-784b-4094-b545-9a9a764cb594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:44.205284 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1059/2110] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:44.209491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0220c1-3459-49e7-b483-f106eb552cf0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:44.219872 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0220c1-3459-49e7-b483-f106eb552cf0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:44.224581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0c740-72ed-4f1d-be53-f57c404f28fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:44.225192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0c740-72ed-4f1d-be53-f57c404f28fc admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:44.225496 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0c740-72ed-4f1d-be53-f57c404f28fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:44.225787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0c740-72ed-4f1d-be53-f57c404f28fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:44.226486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0c740-72ed-4f1d-be53-f57c404f28fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:34:44.226837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0c740-72ed-4f1d-be53-f57c404f28fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:44.228528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0c740-72ed-4f1d-be53-f57c404f28fc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:44.239898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1052/2111] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:34:44.248302 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b20cd-784b-4094-b545-9a9a764cb594 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:44.253939 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b20cd-784b-4094-b545-9a9a764cb594 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:44.259321 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a4d84-0fb2-4452-8b8d-cb134d2322a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:44.260044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a4d84-0fb2-4452-8b8d-cb134d2322a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:44.260322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a4d84-0fb2-4452-8b8d-cb134d2322a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:44.260596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a4d84-0fb2-4452-8b8d-cb134d2322a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:44.261293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a4d84-0fb2-4452-8b8d-cb134d2322a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:44.263222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a4d84-0fb2-4452-8b8d-cb134d2322a1 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:44.348555 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1060/2112] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:34:44 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:34:44.352981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0c740-72ed-4f1d-be53-f57c404f28fc admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:44.362844 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0c740-72ed-4f1d-be53-f57c404f28fc admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:44.420531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0797a83-2293-4c13-b2dc-d56d6187af73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:44.421142 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0797a83-2293-4c13-b2dc-d56d6187af73 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:44.421419 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0797a83-2293-4c13-b2dc-d56d6187af73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:44.421728 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0797a83-2293-4c13-b2dc-d56d6187af73 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:44.422381 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0797a83-2293-4c13-b2dc-d56d6187af73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:44.424270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0797a83-2293-4c13-b2dc-d56d6187af73 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:44.509176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1053/2113] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:34:44 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:34:44.513127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a4d84-0fb2-4452-8b8d-cb134d2322a1 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:44.523795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a4d84-0fb2-4452-8b8d-cb134d2322a1 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:44.528416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15284334-6adb-4510-8ce6-4c50ae265f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:44.529022 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15284334-6adb-4510-8ce6-4c50ae265f87 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:44.529424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15284334-6adb-4510-8ce6-4c50ae265f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:44.529741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15284334-6adb-4510-8ce6-4c50ae265f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:44.530433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15284334-6adb-4510-8ce6-4c50ae265f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:44.532018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15284334-6adb-4510-8ce6-4c50ae265f87 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:44.542222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1061/2114] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:34:44.546054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0797a83-2293-4c13-b2dc-d56d6187af73 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:44.556869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0797a83-2293-4c13-b2dc-d56d6187af73 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:44.561572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9d2d6-9433-48ec-ba5a-7001d6fe1c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:44.562179 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9d2d6-9433-48ec-ba5a-7001d6fe1c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:44.562461 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9d2d6-9433-48ec-ba5a-7001d6fe1c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:44.562738 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9d2d6-9433-48ec-ba5a-7001d6fe1c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:44.563430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9d2d6-9433-48ec-ba5a-7001d6fe1c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:44.565007 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9d2d6-9433-48ec-ba5a-7001d6fe1c0b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:44.576112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1054/2115] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:34:44.579913 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15284334-6adb-4510-8ce6-4c50ae265f87 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:44.589696 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15284334-6adb-4510-8ce6-4c50ae265f87 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:44.594235 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0130c8-0e02-4c6c-b0de-89dc6ecb84a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:44.594879 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0130c8-0e02-4c6c-b0de-89dc6ecb84a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:44.595157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0130c8-0e02-4c6c-b0de-89dc6ecb84a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:44.595430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0130c8-0e02-4c6c-b0de-89dc6ecb84a2 admin admin] PATH_INFO: `/v3/projects/fac2fd9b92994df6b774a8241d6f45e8/users/bff71ccd8ff44ec1af6eb76740d9aa36/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:44.610043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0130c8-0e02-4c6c-b0de-89dc6ecb84a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac2fd9b92994df6b774a8241d6f45e8, user_id=bff71ccd8ff44ec1af6eb76740d9aa36, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:44.612664 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0130c8-0e02-4c6c-b0de-89dc6ecb84a2 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:44.686174 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1062/2116] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:34:44 2022] PUT /identity/v3/projects/fac2fd9b92994df6b774a8241d6f45e8/users/bff71ccd8ff44ec1af6eb76740d9aa36/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:44.756362 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48c278-1a67-4d78-981d-a8fb48b27c13 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:44.756655 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48c278-1a67-4d78-981d-a8fb48b27c13 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:44.756937 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48c278-1a67-4d78-981d-a8fb48b27c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:44.786370 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-fb48c278-1a67-4d78-981d-a8fb48b27c13 None None] MFA Rules not processed for user `bff71ccd8ff44ec1af6eb76740d9aa36`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:44.787615 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fb48c278-1a67-4d78-981d-a8fb48b27c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:44.853317 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1055/2117] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:44.857835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0130c8-0e02-4c6c-b0de-89dc6ecb84a2 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:44.920498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0130c8-0e02-4c6c-b0de-89dc6ecb84a2 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:44.925233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d819c7-e0c9-4e51-97e1-549902ee75df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:44.925907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d819c7-e0c9-4e51-97e1-549902ee75df admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:44.926194 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d819c7-e0c9-4e51-97e1-549902ee75df admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:44.926505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d819c7-e0c9-4e51-97e1-549902ee75df admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:44.927178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d819c7-e0c9-4e51-97e1-549902ee75df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:44.929112 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d819c7-e0c9-4e51-97e1-549902ee75df admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:45.003910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1063/2118] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:34:44 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:34:45.006827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48c278-1a67-4d78-981d-a8fb48b27c13 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:45.018428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48c278-1a67-4d78-981d-a8fb48b27c13 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:45.030882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:45.079367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa7998-efb0-4007-93a0-2ec0d8c0644b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:45.079990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa7998-efb0-4007-93a0-2ec0d8c0644b admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:45.080273 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa7998-efb0-4007-93a0-2ec0d8c0644b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:45.080550 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa7998-efb0-4007-93a0-2ec0d8c0644b admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:45.081224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa7998-efb0-4007-93a0-2ec0d8c0644b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:45.083216 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa7998-efb0-4007-93a0-2ec0d8c0644b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:45.177248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1056/2119] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:34:45 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:34:45.181915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d819c7-e0c9-4e51-97e1-549902ee75df admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:45.192568 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d819c7-e0c9-4e51-97e1-549902ee75df admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:45.198020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c2afd-1e94-4229-879e-1c0e81497f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:45.198639 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c2afd-1e94-4229-879e-1c0e81497f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:45.198921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c2afd-1e94-4229-879e-1c0e81497f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:45.199197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c2afd-1e94-4229-879e-1c0e81497f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:45.199887 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c2afd-1e94-4229-879e-1c0e81497f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:45.201767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c2afd-1e94-4229-879e-1c0e81497f89 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:45.212302 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1064/2120] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:34:45.216464 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa7998-efb0-4007-93a0-2ec0d8c0644b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:45.226462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa7998-efb0-4007-93a0-2ec0d8c0644b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:45.231120 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d428d-a706-4e12-85ab-f1b46c3f1b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:45.231775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d428d-a706-4e12-85ab-f1b46c3f1b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:45.232058 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d428d-a706-4e12-85ab-f1b46c3f1b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:45.232342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d428d-a706-4e12-85ab-f1b46c3f1b3a admin admin] PATH_INFO: `/v3/projects/83e6b5a2e122458ea328ca749e4ade1e/users/423a7b2bc6354aa68029622c96a67bb4/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:45.247337 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d428d-a706-4e12-85ab-f1b46c3f1b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e6b5a2e122458ea328ca749e4ade1e, user_id=423a7b2bc6354aa68029622c96a67bb4, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:45.250100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d428d-a706-4e12-85ab-f1b46c3f1b3a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:45.332061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1057/2121] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:34:45 2022] PUT /identity/v3/projects/83e6b5a2e122458ea328ca749e4ade1e/users/423a7b2bc6354aa68029622c96a67bb4/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:34:45.336076 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c2afd-1e94-4229-879e-1c0e81497f89 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:45.346424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c2afd-1e94-4229-879e-1c0e81497f89 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:45.402856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b6477-fccc-497a-9ac1-ace6570a8222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:45.403471 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b6477-fccc-497a-9ac1-ace6570a8222 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:45.403751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b6477-fccc-497a-9ac1-ace6570a8222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:45.404025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b6477-fccc-497a-9ac1-ace6570a8222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:45.404708 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b6477-fccc-497a-9ac1-ace6570a8222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:45.406331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b6477-fccc-497a-9ac1-ace6570a8222 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:45.416383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1065/2122] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:34:45.420566 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d428d-a706-4e12-85ab-f1b46c3f1b3a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:45.431485 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d428d-a706-4e12-85ab-f1b46c3f1b3a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:45.436026 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b45f4-34e0-4295-8849-8dacccd94540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:45.436685 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b45f4-34e0-4295-8849-8dacccd94540 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:45.436961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b45f4-34e0-4295-8849-8dacccd94540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:45.437233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b45f4-34e0-4295-8849-8dacccd94540 admin admin] PATH_INFO: `/v3/projects/83e6b5a2e122458ea328ca749e4ade1e/users/423a7b2bc6354aa68029622c96a67bb4/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:45.439246 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b45f4-34e0-4295-8849-8dacccd94540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e6b5a2e122458ea328ca749e4ade1e, user_id=423a7b2bc6354aa68029622c96a67bb4, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:45.441951 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b45f4-34e0-4295-8849-8dacccd94540 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:45.451900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1058/2123] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:34:45 2022] PUT /identity/v3/projects/83e6b5a2e122458ea328ca749e4ade1e/users/423a7b2bc6354aa68029622c96a67bb4/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:45.462220 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b074900-3ec4-4746-8feb-58722dd9c5da None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:45.462676 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b074900-3ec4-4746-8feb-58722dd9c5da None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:45.463177 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b074900-3ec4-4746-8feb-58722dd9c5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:45.483280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:45.491611 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-3b074900-3ec4-4746-8feb-58722dd9c5da None None] MFA Rules not processed for user `423a7b2bc6354aa68029622c96a67bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:45.493405 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-3b074900-3ec4-4746-8feb-58722dd9c5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:45.562784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1066/2124] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:45.574431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b45f4-34e0-4295-8849-8dacccd94540 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:45.576249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f64b45f4-34e0-4295-8849-8dacccd94540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:45.638614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b45f4-34e0-4295-8849-8dacccd94540 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:45.642292 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5cfc7-7ad5-4e96-bd5e-8f6098d52352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:45.647150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5cfc7-7ad5-4e96-bd5e-8f6098d52352 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:45.647150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5cfc7-7ad5-4e96-bd5e-8f6098d52352 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:45.647150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5cfc7-7ad5-4e96-bd5e-8f6098d52352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:45.653007 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5cfc7-7ad5-4e96-bd5e-8f6098d52352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:45.654455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5cfc7-7ad5-4e96-bd5e-8f6098d52352 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:45.664193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1059/2125] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:45.797691 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b074900-3ec4-4746-8feb-58722dd9c5da None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:45.807762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b074900-3ec4-4746-8feb-58722dd9c5da None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:45.811408 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db2b65-3db1-45e0-8bac-01c998adc559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:45.812035 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db2b65-3db1-45e0-8bac-01c998adc559 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:45.812319 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db2b65-3db1-45e0-8bac-01c998adc559 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:45.812596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db2b65-3db1-45e0-8bac-01c998adc559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:45.877691 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db2b65-3db1-45e0-8bac-01c998adc559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:45.879227 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db2b65-3db1-45e0-8bac-01c998adc559 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:45.893577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1067/2126] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:46.394587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5cfc7-7ad5-4e96-bd5e-8f6098d52352 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:46.460293 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5cfc7-7ad5-4e96-bd5e-8f6098d52352 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:46.465331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600bc8f-ebb3-4b36-8716-63d031500782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:46.465998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600bc8f-ebb3-4b36-8716-63d031500782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:46.466275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600bc8f-ebb3-4b36-8716-63d031500782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:46.466546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600bc8f-ebb3-4b36-8716-63d031500782 admin admin] PATH_INFO: `/v3/users/bff71ccd8ff44ec1af6eb76740d9aa36` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:46.467763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600bc8f-ebb3-4b36-8716-63d031500782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff71ccd8ff44ec1af6eb76740d9aa36)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:46.469741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600bc8f-ebb3-4b36-8716-63d031500782 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:46.483935 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:46.676824 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4600bc8f-ebb3-4b36-8716-63d031500782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff71ccd8ff44ec1af6eb76740d9aa36'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:46.683536 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4600bc8f-ebb3-4b36-8716-63d031500782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff71ccd8ff44ec1af6eb76740d9aa36'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:46.794484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4600bc8f-ebb3-4b36-8716-63d031500782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff71ccd8ff44ec1af6eb76740d9aa36'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:46.807391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4600bc8f-ebb3-4b36-8716-63d031500782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff71ccd8ff44ec1af6eb76740d9aa36'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:46.808026 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4600bc8f-ebb3-4b36-8716-63d031500782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff71ccd8ff44ec1af6eb76740d9aa36'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:46.820143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1060/2127] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:34:46 2022] DELETE /identity/v3/users/bff71ccd8ff44ec1af6eb76740d9aa36 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:46.825313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cd35c-c547-43ed-a82d-ea9f59cdb6d1 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:46.825673 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cd35c-c547-43ed-a82d-ea9f59cdb6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:46.825986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cd35c-c547-43ed-a82d-ea9f59cdb6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:46.845224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-6c9cd35c-c547-43ed-a82d-ea9f59cdb6d1 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:46.846509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6c9cd35c-c547-43ed-a82d-ea9f59cdb6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:46.905637 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1068/2128] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:34:46.916279 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600bc8f-ebb3-4b36-8716-63d031500782 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:46.917798 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4600bc8f-ebb3-4b36-8716-63d031500782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:46.976429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600bc8f-ebb3-4b36-8716-63d031500782 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:46.980881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62747518-40a9-47a8-ac71-1ee69fba62ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:46.981533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62747518-40a9-47a8-ac71-1ee69fba62ba service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:46.981820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62747518-40a9-47a8-ac71-1ee69fba62ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:46.982099 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62747518-40a9-47a8-ac71-1ee69fba62ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:46.991097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62747518-40a9-47a8-ac71-1ee69fba62ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:46.992481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62747518-40a9-47a8-ac71-1ee69fba62ba service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:47.003316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1061/2129] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:47.516615 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cd35c-c547-43ed-a82d-ea9f59cdb6d1 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:47.518192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6c9cd35c-c547-43ed-a82d-ea9f59cdb6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:47.534893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cd35c-c547-43ed-a82d-ea9f59cdb6d1 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:47.537435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba137f1-aacd-4759-9439-c57c66c53093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:47.538153 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba137f1-aacd-4759-9439-c57c66c53093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:47.538440 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba137f1-aacd-4759-9439-c57c66c53093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:47.538724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba137f1-aacd-4759-9439-c57c66c53093 admin admin] PATH_INFO: `/v3/projects/fac2fd9b92994df6b774a8241d6f45e8` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:47.540482 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba137f1-aacd-4759-9439-c57c66c53093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fac2fd9b92994df6b774a8241d6f45e8)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:47.542571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba137f1-aacd-4759-9439-c57c66c53093 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:47.637941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:47.654141 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7ba137f1-aacd-4759-9439-c57c66c53093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fac2fd9b92994df6b774a8241d6f45e8', 'request_id': 'req-7ba137f1-aacd-4759-9439-c57c66c53093'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:47.736903 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7ba137f1-aacd-4759-9439-c57c66c53093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fac2fd9b92994df6b774a8241d6f45e8', 'request_id': 'req-7ba137f1-aacd-4759-9439-c57c66c53093'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:47.743201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7ba137f1-aacd-4759-9439-c57c66c53093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fac2fd9b92994df6b774a8241d6f45e8', 'request_id': 'req-7ba137f1-aacd-4759-9439-c57c66c53093'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:47.756112 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7ba137f1-aacd-4759-9439-c57c66c53093 admin admin] The token cache is being invalidate because project fac2fd9b92994df6b774a8241d6f45e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:34:47.756397 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7ba137f1-aacd-4759-9439-c57c66c53093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:47.757028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7ba137f1-aacd-4759-9439-c57c66c53093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:47.759288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1069/2130] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:34:47 2022] DELETE /identity/v3/projects/fac2fd9b92994df6b774a8241d6f45e8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:47.763384 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62747518-40a9-47a8-ac71-1ee69fba62ba service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:47.773456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62747518-40a9-47a8-ac71-1ee69fba62ba service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:47.831958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fceab5-01a9-4dbc-91b2-f49333e4f490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:47.832598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fceab5-01a9-4dbc-91b2-f49333e4f490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:47.832882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fceab5-01a9-4dbc-91b2-f49333e4f490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:47.833161 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fceab5-01a9-4dbc-91b2-f49333e4f490 admin admin] PATH_INFO: `/v3/users/423a7b2bc6354aa68029622c96a67bb4` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:47.834365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fceab5-01a9-4dbc-91b2-f49333e4f490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=423a7b2bc6354aa68029622c96a67bb4)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:47.836317 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fceab5-01a9-4dbc-91b2-f49333e4f490 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:48.010415 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:48.019778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-11fceab5-01a9-4dbc-91b2-f49333e4f490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423a7b2bc6354aa68029622c96a67bb4'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:48.020748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-11fceab5-01a9-4dbc-91b2-f49333e4f490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423a7b2bc6354aa68029622c96a67bb4'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:48.101813 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-11fceab5-01a9-4dbc-91b2-f49333e4f490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423a7b2bc6354aa68029622c96a67bb4'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:48.114534 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-11fceab5-01a9-4dbc-91b2-f49333e4f490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423a7b2bc6354aa68029622c96a67bb4'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:48.121275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-11fceab5-01a9-4dbc-91b2-f49333e4f490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423a7b2bc6354aa68029622c96a67bb4'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:48.127973 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1062/2131] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:34:47 2022] DELETE /identity/v3/users/423a7b2bc6354aa68029622c96a67bb4 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:48.585406 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba137f1-aacd-4759-9439-c57c66c53093 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:48.587268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7ba137f1-aacd-4759-9439-c57c66c53093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:48.600788 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba137f1-aacd-4759-9439-c57c66c53093 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:48.663399 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a1398-e71c-4e69-b824-6b5490ceffde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:48.664067 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a1398-e71c-4e69-b824-6b5490ceffde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:48.664354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a1398-e71c-4e69-b824-6b5490ceffde admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:48.665279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a1398-e71c-4e69-b824-6b5490ceffde admin admin] PATH_INFO: `/v3/projects/83e6b5a2e122458ea328ca749e4ade1e` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:48.666790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a1398-e71c-4e69-b824-6b5490ceffde admin admin] RBAC: Authorizing `identity:delete_project(project_id=83e6b5a2e122458ea328ca749e4ade1e)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:48.668599 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a1398-e71c-4e69-b824-6b5490ceffde admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:48.759650 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d00a1398-e71c-4e69-b824-6b5490ceffde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83e6b5a2e122458ea328ca749e4ade1e', 'request_id': 'req-d00a1398-e71c-4e69-b824-6b5490ceffde'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:48.816559 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d00a1398-e71c-4e69-b824-6b5490ceffde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83e6b5a2e122458ea328ca749e4ade1e', 'request_id': 'req-d00a1398-e71c-4e69-b824-6b5490ceffde'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:48.822423 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d00a1398-e71c-4e69-b824-6b5490ceffde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83e6b5a2e122458ea328ca749e4ade1e', 'request_id': 'req-d00a1398-e71c-4e69-b824-6b5490ceffde'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:48.833716 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d00a1398-e71c-4e69-b824-6b5490ceffde admin admin] The token cache is being invalidate because project 83e6b5a2e122458ea328ca749e4ade1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:34:48.833949 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d00a1398-e71c-4e69-b824-6b5490ceffde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:48.834576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d00a1398-e71c-4e69-b824-6b5490ceffde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:48.836071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1070/2132] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:34:48 2022] DELETE /identity/v3/projects/83e6b5a2e122458ea328ca749e4ade1e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:48.841488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beee77a-d0f3-4ebe-9d0d-55772d281c93 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:48.841998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beee77a-d0f3-4ebe-9d0d-55772d281c93 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:48.842092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beee77a-d0f3-4ebe-9d0d-55772d281c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:48.862388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9beee77a-d0f3-4ebe-9d0d-55772d281c93 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:48.863599 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9beee77a-d0f3-4ebe-9d0d-55772d281c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:48.923894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1063/2133] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:48.931883 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca6263-b4c7-4ea6-82a7-a61c6a19a158 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:48.932168 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca6263-b4c7-4ea6-82a7-a61c6a19a158 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:48.932440 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca6263-b4c7-4ea6-82a7-a61c6a19a158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:48.952642 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-8aca6263-b4c7-4ea6-82a7-a61c6a19a158 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:48.956433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-8aca6263-b4c7-4ea6-82a7-a61c6a19a158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:48.962817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1071/2134] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:48.967042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beee77a-d0f3-4ebe-9d0d-55772d281c93 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:48.976814 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beee77a-d0f3-4ebe-9d0d-55772d281c93 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:48.982089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c6710-c0d5-44b9-87d3-c1e7a0f2b9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:48.982702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c6710-c0d5-44b9-87d3-c1e7a0f2b9ed admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:48.982988 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c6710-c0d5-44b9-87d3-c1e7a0f2b9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:48.983295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c6710-c0d5-44b9-87d3-c1e7a0f2b9ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:48.984115 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c6710-c0d5-44b9-87d3-c1e7a0f2b9ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:34:48.984431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c6710-c0d5-44b9-87d3-c1e7a0f2b9ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:48.986060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c6710-c0d5-44b9-87d3-c1e7a0f2b9ed admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:48.997828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1064/2135] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:34:49.002371 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca6263-b4c7-4ea6-82a7-a61c6a19a158 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:49.012355 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca6263-b4c7-4ea6-82a7-a61c6a19a158 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:49.017320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ef226-6cde-4bae-b481-4bad368cd72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:49.017975 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ef226-6cde-4bae-b481-4bad368cd72e admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:49.018261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ef226-6cde-4bae-b481-4bad368cd72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:49.018561 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ef226-6cde-4bae-b481-4bad368cd72e admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:49.019245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ef226-6cde-4bae-b481-4bad368cd72e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:49.021445 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ef226-6cde-4bae-b481-4bad368cd72e admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:49.115362 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1072/2136] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:34:49 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:34:49.119331 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c6710-c0d5-44b9-87d3-c1e7a0f2b9ed admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:49.130482 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c6710-c0d5-44b9-87d3-c1e7a0f2b9ed admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:49.190708 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b71c5-531e-4e01-a7bc-d143a13cb55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:49.191342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b71c5-531e-4e01-a7bc-d143a13cb55c admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:49.191668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b71c5-531e-4e01-a7bc-d143a13cb55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:49.191971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b71c5-531e-4e01-a7bc-d143a13cb55c admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:49.192641 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b71c5-531e-4e01-a7bc-d143a13cb55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:49.195110 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b71c5-531e-4e01-a7bc-d143a13cb55c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:49.289561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1065/2137] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:34:49 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:34:49.291008 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ef226-6cde-4bae-b481-4bad368cd72e admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:49.301824 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ef226-6cde-4bae-b481-4bad368cd72e admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:49.306556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a4d61-6aaa-4230-aa7c-9f225adf7082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:49.307346 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a4d61-6aaa-4230-aa7c-9f225adf7082 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:49.307528 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a4d61-6aaa-4230-aa7c-9f225adf7082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:49.307835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a4d61-6aaa-4230-aa7c-9f225adf7082 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:49.308473 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a4d61-6aaa-4230-aa7c-9f225adf7082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:49.310526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a4d61-6aaa-4230-aa7c-9f225adf7082 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:49.324166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1073/2138] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:34:49.325534 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b71c5-531e-4e01-a7bc-d143a13cb55c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:49.335823 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b71c5-531e-4e01-a7bc-d143a13cb55c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:49.341812 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001bcab-6863-4563-804b-c3736642520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:49.342532 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001bcab-6863-4563-804b-c3736642520f admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:49.342819 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001bcab-6863-4563-804b-c3736642520f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:49.343097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001bcab-6863-4563-804b-c3736642520f admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:49.343838 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001bcab-6863-4563-804b-c3736642520f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:49.345443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001bcab-6863-4563-804b-c3736642520f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:49.356792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1066/2139] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:34:49.361005 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a4d61-6aaa-4230-aa7c-9f225adf7082 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:49.371442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a4d61-6aaa-4230-aa7c-9f225adf7082 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:49.376208 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c657165-c399-4a74-8e78-42bf52e2d733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:49.376877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c657165-c399-4a74-8e78-42bf52e2d733 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:49.377156 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c657165-c399-4a74-8e78-42bf52e2d733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:49.377428 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c657165-c399-4a74-8e78-42bf52e2d733 admin admin] PATH_INFO: `/v3/projects/6ce7104e69fe4e15b070558784aa40d6/users/c3310483e0e64521999dfcafec143f0f/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:49.379992 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:49.394258 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c657165-c399-4a74-8e78-42bf52e2d733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce7104e69fe4e15b070558784aa40d6, user_id=c3310483e0e64521999dfcafec143f0f, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:49.397356 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c657165-c399-4a74-8e78-42bf52e2d733 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:49.509407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1074/2140] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:34:49 2022] PUT /identity/v3/projects/6ce7104e69fe4e15b070558784aa40d6/users/c3310483e0e64521999dfcafec143f0f/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:34:49.515330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483abfed-4c35-4e10-adcf-f1ed7ac0e1e5 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:49.515622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483abfed-4c35-4e10-adcf-f1ed7ac0e1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:49.515898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483abfed-4c35-4e10-adcf-f1ed7ac0e1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:49.543766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-483abfed-4c35-4e10-adcf-f1ed7ac0e1e5 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:49.545321 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-483abfed-4c35-4e10-adcf-f1ed7ac0e1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:49.562483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:49.615638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1067/2141] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:49.625679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c657165-c399-4a74-8e78-42bf52e2d733 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:49.627550 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-0c657165-c399-4a74-8e78-42bf52e2d733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:49.685646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c657165-c399-4a74-8e78-42bf52e2d733 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:49.689439 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d73d2-f746-4d38-9867-2544eee36dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:49.690106 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d73d2-f746-4d38-9867-2544eee36dbb service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:49.690588 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d73d2-f746-4d38-9867-2544eee36dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:49.690877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d73d2-f746-4d38-9867-2544eee36dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:49.701800 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d73d2-f746-4d38-9867-2544eee36dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:49.703239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d73d2-f746-4d38-9867-2544eee36dbb service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:49.713238 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1075/2142] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:50.906256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54089457-ac23-4a8a-b9a8-b1f1e5927488 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:50.910291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54089457-ac23-4a8a-b9a8-b1f1e5927488 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:50.910291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54089457-ac23-4a8a-b9a8-b1f1e5927488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:50.942820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-54089457-ac23-4a8a-b9a8-b1f1e5927488 None None] MFA Rules not processed for user `c3310483e0e64521999dfcafec143f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:50.944269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-54089457-ac23-4a8a-b9a8-b1f1e5927488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:51.023590 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1068/2143] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:51.031305 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d73d2-f746-4d38-9867-2544eee36dbb service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:51.033913 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-cd5d73d2-f746-4d38-9867-2544eee36dbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:51.099525 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d73d2-f746-4d38-9867-2544eee36dbb service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:51.103292 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47b835-0c78-4a04-b669-e12a3810c2c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:51.103908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47b835-0c78-4a04-b669-e12a3810c2c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:51.104188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47b835-0c78-4a04-b669-e12a3810c2c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:51.104462 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47b835-0c78-4a04-b669-e12a3810c2c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:51.113276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47b835-0c78-4a04-b669-e12a3810c2c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:51.114739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47b835-0c78-4a04-b669-e12a3810c2c5 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:51.124969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1076/2144] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:52.831425 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30b4e4-7edc-42d2-9960-76f08e10ef7e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:52.831924 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30b4e4-7edc-42d2-9960-76f08e10ef7e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:52.832039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30b4e4-7edc-42d2-9960-76f08e10ef7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:52.851015 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-5b30b4e4-7edc-42d2-9960-76f08e10ef7e None None] MFA Rules not processed for user `c3310483e0e64521999dfcafec143f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:52.852758 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5b30b4e4-7edc-42d2-9960-76f08e10ef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:52.859742 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1069/2145] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:34:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:53.733800 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbb8f1-a54c-4cb5-8991-e529b937370f None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:53.740033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbb8f1-a54c-4cb5-8991-e529b937370f None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:53.740033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbb8f1-a54c-4cb5-8991-e529b937370f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:53.763126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-73cbb8f1-a54c-4cb5-8991-e529b937370f None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:53.764340 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-73cbb8f1-a54c-4cb5-8991-e529b937370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:53.822150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1077/2146] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jul 28 05:34:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:53.845928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30b4e4-7edc-42d2-9960-76f08e10ef7e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:53.847364 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5b30b4e4-7edc-42d2-9960-76f08e10ef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:53.921395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30b4e4-7edc-42d2-9960-76f08e10ef7e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:53.926483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff25952-c131-4cd7-91bf-7179e4d4fb0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:53.927101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff25952-c131-4cd7-91bf-7179e4d4fb0e service swift] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:53.927386 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff25952-c131-4cd7-91bf-7179e4d4fb0e service swift] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:53.927666 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff25952-c131-4cd7-91bf-7179e4d4fb0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:53.935924 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff25952-c131-4cd7-91bf-7179e4d4fb0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:53.937532 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff25952-c131-4cd7-91bf-7179e4d4fb0e service swift] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:53.946095 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1070/2147] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:34:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 05:35:03.814440 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=84,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:03.942356 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=86 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:24.351809 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9483b59-68ad-47d7-8331-9f6eae5b6754 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:35:24.352339 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9483b59-68ad-47d7-8331-9f6eae5b6754 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:35:24.352339 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9483b59-68ad-47d7-8331-9f6eae5b6754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:35:24.371956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-d9483b59-68ad-47d7-8331-9f6eae5b6754 None None] MFA Rules not processed for user `4fcc81558e8f4224ad2ea6fb2b7bf0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:35:24.373162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d9483b59-68ad-47d7-8331-9f6eae5b6754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:35:24.429047 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1078/2148] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:35:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:35:34.422454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=25 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:35.380103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d683f-b5be-4a78-ae02-4be3c0445840 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:35:35.380977 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d683f-b5be-4a78-ae02-4be3c0445840 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:35:35.380977 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d683f-b5be-4a78-ae02-4be3c0445840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:35:35.400335 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-bb0d683f-b5be-4a78-ae02-4be3c0445840 None None] MFA Rules not processed for user `0002ebbc629b4dafb109dc94450fe1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:35:35.401651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bb0d683f-b5be-4a78-ae02-4be3c0445840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:35:35.457218 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1071/2149] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:35:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:35:45.450212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=25 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:53.383986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9483b59-68ad-47d7-8331-9f6eae5b6754 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:35:53.385561 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d9483b59-68ad-47d7-8331-9f6eae5b6754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:35:53.404825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9483b59-68ad-47d7-8331-9f6eae5b6754 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:35:53.406693 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc449d9-ab3c-485d-8bdc-ae745e43fc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:35:53.407531 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc449d9-ab3c-485d-8bdc-ae745e43fc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:35:53.407985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc449d9-ab3c-485d-8bdc-ae745e43fc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:35:53.408420 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc449d9-ab3c-485d-8bdc-ae745e43fc47 admin admin] PATH_INFO: `/v3/users/02142b6537394571912b52f061aeb082` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:35:53.409625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc449d9-ab3c-485d-8bdc-ae745e43fc47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02142b6537394571912b52f061aeb082)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:35:53.411716 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc449d9-ab3c-485d-8bdc-ae745e43fc47 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:35:53.572477 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4dc449d9-ab3c-485d-8bdc-ae745e43fc47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02142b6537394571912b52f061aeb082'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:35:53.573649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4dc449d9-ab3c-485d-8bdc-ae745e43fc47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02142b6537394571912b52f061aeb082'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:35:53.645968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4dc449d9-ab3c-485d-8bdc-ae745e43fc47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02142b6537394571912b52f061aeb082'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:35:53.655701 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4dc449d9-ab3c-485d-8bdc-ae745e43fc47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02142b6537394571912b52f061aeb082'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:35:53.671237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4dc449d9-ab3c-485d-8bdc-ae745e43fc47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02142b6537394571912b52f061aeb082'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:35:53.681728 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1079/2150] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:35:53 2022] DELETE /identity/v3/users/02142b6537394571912b52f061aeb082 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:35:53.962618 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d683f-b5be-4a78-ae02-4be3c0445840 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:35:54.006012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d683f-b5be-4a78-ae02-4be3c0445840 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:35:54.069264 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13995065-5a7e-4530-9caf-3c9a7234a325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:35:54.070216 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995065-5a7e-4530-9caf-3c9a7234a325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:35:54.070685 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995065-5a7e-4530-9caf-3c9a7234a325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:35:54.071434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995065-5a7e-4530-9caf-3c9a7234a325 admin admin] PATH_INFO: `/v3/projects/0fafe3a7726844018a6c308f8acdbb49` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:35:54.073169 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13995065-5a7e-4530-9caf-3c9a7234a325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fafe3a7726844018a6c308f8acdbb49)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:35:54.075705 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13995065-5a7e-4530-9caf-3c9a7234a325 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:35:54.190997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13995065-5a7e-4530-9caf-3c9a7234a325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fafe3a7726844018a6c308f8acdbb49', 'request_id': 'req-13995065-5a7e-4530-9caf-3c9a7234a325'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:35:54.264628 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13995065-5a7e-4530-9caf-3c9a7234a325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fafe3a7726844018a6c308f8acdbb49', 'request_id': 'req-13995065-5a7e-4530-9caf-3c9a7234a325'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:35:54.274790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13995065-5a7e-4530-9caf-3c9a7234a325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fafe3a7726844018a6c308f8acdbb49', 'request_id': 'req-13995065-5a7e-4530-9caf-3c9a7234a325'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:35:54.289110 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13995065-5a7e-4530-9caf-3c9a7234a325 admin admin] The token cache is being invalidate because project 0fafe3a7726844018a6c308f8acdbb49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:35:54.289590 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13995065-5a7e-4530-9caf-3c9a7234a325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:35:54.290459 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13995065-5a7e-4530-9caf-3c9a7234a325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:35:54.292268 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1072/2151] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:35:53 2022] DELETE /identity/v3/projects/0fafe3a7726844018a6c308f8acdbb49 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:35:54.297150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48e9c2-0478-4ace-b498-fc85e65b0162 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:35:54.304108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48e9c2-0478-4ace-b498-fc85e65b0162 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:35:54.304108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48e9c2-0478-4ace-b498-fc85e65b0162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:35:54.320429 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-6c48e9c2-0478-4ace-b498-fc85e65b0162 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:35:54.321605 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6c48e9c2-0478-4ace-b498-fc85e65b0162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:35:54.389611 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1080/2152] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:35:54.396698 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427120c2-beb7-47ce-a7d4-350d99cdb7ec None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:35:54.397238 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427120c2-beb7-47ce-a7d4-350d99cdb7ec None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:35:54.397559 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427120c2-beb7-47ce-a7d4-350d99cdb7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:35:54.425036 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-427120c2-beb7-47ce-a7d4-350d99cdb7ec None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:35:54.426296 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-427120c2-beb7-47ce-a7d4-350d99cdb7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:35:54.436172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1073/2153] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:35:54.440240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48e9c2-0478-4ace-b498-fc85e65b0162 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:35:54.451338 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48e9c2-0478-4ace-b498-fc85e65b0162 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:35:54.456264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481762e-7ba7-420a-b83f-8154c4d03dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:35:54.457341 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481762e-7ba7-420a-b83f-8154c4d03dba admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:35:54.457341 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481762e-7ba7-420a-b83f-8154c4d03dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:35:54.457631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481762e-7ba7-420a-b83f-8154c4d03dba admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:35:54.458544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481762e-7ba7-420a-b83f-8154c4d03dba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:35:54.458920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481762e-7ba7-420a-b83f-8154c4d03dba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:35:54.462085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481762e-7ba7-420a-b83f-8154c4d03dba admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:35:54.474164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1081/2154] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:35:54.483325 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427120c2-beb7-47ce-a7d4-350d99cdb7ec None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:35:54.501142 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427120c2-beb7-47ce-a7d4-350d99cdb7ec None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:35:54.506418 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d17c9a-ad45-49fe-bce9-4f35af20a1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:35:54.507049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d17c9a-ad45-49fe-bce9-4f35af20a1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:35:54.507330 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d17c9a-ad45-49fe-bce9-4f35af20a1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:35:54.508088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d17c9a-ad45-49fe-bce9-4f35af20a1b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:35:54.508782 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d17c9a-ad45-49fe-bce9-4f35af20a1b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:35:54.511465 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d17c9a-ad45-49fe-bce9-4f35af20a1b8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:35:54.599288 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1074/2155] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:35:54 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:35:54.603322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481762e-7ba7-420a-b83f-8154c4d03dba admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:35:54.615094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481762e-7ba7-420a-b83f-8154c4d03dba admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:35:54.693406 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d76669-d4e0-439a-9ea2-cdc39cf8209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:35:54.694079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d76669-d4e0-439a-9ea2-cdc39cf8209e admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:35:54.694430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d76669-d4e0-439a-9ea2-cdc39cf8209e admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:35:54.694634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d76669-d4e0-439a-9ea2-cdc39cf8209e admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:35:54.695339 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d76669-d4e0-439a-9ea2-cdc39cf8209e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:35:54.698178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d76669-d4e0-439a-9ea2-cdc39cf8209e admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:35:54.707127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:54.818837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1082/2156] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:35:54 2022] POST /identity/v3/users => generated 295 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:35:54.822670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d17c9a-ad45-49fe-bce9-4f35af20a1b8 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:35:54.839846 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d17c9a-ad45-49fe-bce9-4f35af20a1b8 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:35:54.853983 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d406f1-5e18-4e06-9c75-f3ceca3ec400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:35:54.854724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d406f1-5e18-4e06-9c75-f3ceca3ec400 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:35:54.855074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d406f1-5e18-4e06-9c75-f3ceca3ec400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:35:54.855509 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d406f1-5e18-4e06-9c75-f3ceca3ec400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:35:54.856867 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d406f1-5e18-4e06-9c75-f3ceca3ec400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:35:54.858695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d406f1-5e18-4e06-9c75-f3ceca3ec400 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:35:54.878764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1075/2157] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:35:54.880214 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d76669-d4e0-439a-9ea2-cdc39cf8209e admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:35:54.891024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d76669-d4e0-439a-9ea2-cdc39cf8209e admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:35:54.900146 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aced03-f1f8-4983-8109-c9f53ab1878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:35:54.900146 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aced03-f1f8-4983-8109-c9f53ab1878f admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:35:54.900146 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aced03-f1f8-4983-8109-c9f53ab1878f admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:35:54.900146 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aced03-f1f8-4983-8109-c9f53ab1878f admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:35:54.900854 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aced03-f1f8-4983-8109-c9f53ab1878f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:35:54.904846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aced03-f1f8-4983-8109-c9f53ab1878f admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:35:54.920775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1083/2158] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:35:54.922097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d406f1-5e18-4e06-9c75-f3ceca3ec400 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:35:54.933277 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d406f1-5e18-4e06-9c75-f3ceca3ec400 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:35:54.939994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a39e37-04f7-4458-8b8f-fc27da9cb1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:35:54.939994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39e37-04f7-4458-8b8f-fc27da9cb1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:35:54.939994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39e37-04f7-4458-8b8f-fc27da9cb1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:35:54.939994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39e37-04f7-4458-8b8f-fc27da9cb1ee admin admin] PATH_INFO: `/v3/projects/d1b7626554a94481be8726d2303cab22/users/ac463999a6fb4ff98ec9ba0fcf840cdc/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:35:54.956844 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a39e37-04f7-4458-8b8f-fc27da9cb1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b7626554a94481be8726d2303cab22, user_id=ac463999a6fb4ff98ec9ba0fcf840cdc, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:35:54.959994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a39e37-04f7-4458-8b8f-fc27da9cb1ee admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:35:55.053385 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1076/2159] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:35:54 2022] PUT /identity/v3/projects/d1b7626554a94481be8726d2303cab22/users/ac463999a6fb4ff98ec9ba0fcf840cdc/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:35:55.063798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d964b-74df-403a-ac63-ee21ec1049f4 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:35:55.064109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d964b-74df-403a-ac63-ee21ec1049f4 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:35:55.064390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d964b-74df-403a-ac63-ee21ec1049f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:35:55.096293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-6a2d964b-74df-403a-ac63-ee21ec1049f4 None None] MFA Rules not processed for user `ac463999a6fb4ff98ec9ba0fcf840cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:35:55.097545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6a2d964b-74df-403a-ac63-ee21ec1049f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:35:55.172528 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1084/2160] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:35:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:35:55.182872 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a39e37-04f7-4458-8b8f-fc27da9cb1ee admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:35:55.184670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-49a39e37-04f7-4458-8b8f-fc27da9cb1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:35:55.220740 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:55.249102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a39e37-04f7-4458-8b8f-fc27da9cb1ee admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:35:55.252767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59f0d2-0360-4e80-b152-02a81bbe3f04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:35:55.253503 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59f0d2-0360-4e80-b152-02a81bbe3f04 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:35:55.253925 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59f0d2-0360-4e80-b152-02a81bbe3f04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:35:55.254072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59f0d2-0360-4e80-b152-02a81bbe3f04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:35:55.263681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59f0d2-0360-4e80-b152-02a81bbe3f04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:35:55.265177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59f0d2-0360-4e80-b152-02a81bbe3f04 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:35:55.275213 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1077/2161] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:35:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:35:59.054279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc36c94-5968-449e-92bd-1a38c1726795 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:35:59.054782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc36c94-5968-449e-92bd-1a38c1726795 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:35:59.054894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc36c94-5968-449e-92bd-1a38c1726795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:35:59.074099 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-8fc36c94-5968-449e-92bd-1a38c1726795 None None] MFA Rules not processed for user `22fddcc9952a459899e48a93d1d962db`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:35:59.075864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-8fc36c94-5968-449e-92bd-1a38c1726795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:35:59.131052 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1085/2162] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:35:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:05.354153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=14 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:09.124208 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:INSERT=3,keystone:SELECT=64 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:10.587334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10d6c7-cd2b-4eb1-9366-44f09ed58544 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:10.587852 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10d6c7-cd2b-4eb1-9366-44f09ed58544 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:10.587957 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10d6c7-cd2b-4eb1-9366-44f09ed58544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:10.607574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3d10d6c7-cd2b-4eb1-9366-44f09ed58544 None None] MFA Rules not processed for user `c3310483e0e64521999dfcafec143f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:10.608998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3d10d6c7-cd2b-4eb1-9366-44f09ed58544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:10.666682 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1078/2163] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:36:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:16.205977 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc36c94-5968-449e-92bd-1a38c1726795 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:16.272040 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc36c94-5968-449e-92bd-1a38c1726795 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:16.276616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0418f0e-2ee5-4454-9b2d-048f92e46280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:16.277260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0418f0e-2ee5-4454-9b2d-048f92e46280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:16.277571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0418f0e-2ee5-4454-9b2d-048f92e46280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:16.277854 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0418f0e-2ee5-4454-9b2d-048f92e46280 admin admin] PATH_INFO: `/v3/users/ac463999a6fb4ff98ec9ba0fcf840cdc` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:16.279657 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0418f0e-2ee5-4454-9b2d-048f92e46280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac463999a6fb4ff98ec9ba0fcf840cdc)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:16.281601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0418f0e-2ee5-4454-9b2d-048f92e46280 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:16.459320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e0418f0e-2ee5-4454-9b2d-048f92e46280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac463999a6fb4ff98ec9ba0fcf840cdc'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:36:16.464674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e0418f0e-2ee5-4454-9b2d-048f92e46280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac463999a6fb4ff98ec9ba0fcf840cdc'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:36:16.530280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e0418f0e-2ee5-4454-9b2d-048f92e46280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac463999a6fb4ff98ec9ba0fcf840cdc'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:36:16.538173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e0418f0e-2ee5-4454-9b2d-048f92e46280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac463999a6fb4ff98ec9ba0fcf840cdc'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:36:16.551116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e0418f0e-2ee5-4454-9b2d-048f92e46280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac463999a6fb4ff98ec9ba0fcf840cdc'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:36:16.557316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1086/2164] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:36:16 2022] DELETE /identity/v3/users/ac463999a6fb4ff98ec9ba0fcf840cdc => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:36:16.561877 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ba14a-f99a-43c3-8b24-2904275db915 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:16.562356 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ba14a-f99a-43c3-8b24-2904275db915 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:16.562473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ba14a-f99a-43c3-8b24-2904275db915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:16.581386 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-cd3ba14a-f99a-43c3-8b24-2904275db915 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:16.582627 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cd3ba14a-f99a-43c3-8b24-2904275db915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:16.643168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1079/2165] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:16.652694 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0418f0e-2ee5-4454-9b2d-048f92e46280 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:16.654138 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e0418f0e-2ee5-4454-9b2d-048f92e46280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:16.712456 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0418f0e-2ee5-4454-9b2d-048f92e46280 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:16.716292 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e5a1a-8705-41b7-80e0-85023fe5ffcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:16.716963 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e5a1a-8705-41b7-80e0-85023fe5ffcc service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:16.717900 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e5a1a-8705-41b7-80e0-85023fe5ffcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:16.718180 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e5a1a-8705-41b7-80e0-85023fe5ffcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:16.727771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e5a1a-8705-41b7-80e0-85023fe5ffcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:16.729185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e5a1a-8705-41b7-80e0-85023fe5ffcc service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:16.738549 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1087/2166] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:17.145611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ba14a-f99a-43c3-8b24-2904275db915 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:17.147116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cd3ba14a-f99a-43c3-8b24-2904275db915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:17.160626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ba14a-f99a-43c3-8b24-2904275db915 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:17.165856 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c42dd0-ddc0-48d3-a7c2-7e5a29e0aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:17.166311 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c42dd0-ddc0-48d3-a7c2-7e5a29e0aa61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:17.166721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c42dd0-ddc0-48d3-a7c2-7e5a29e0aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:17.167007 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c42dd0-ddc0-48d3-a7c2-7e5a29e0aa61 admin admin] PATH_INFO: `/v3/projects/d1b7626554a94481be8726d2303cab22` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:17.168184 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c42dd0-ddc0-48d3-a7c2-7e5a29e0aa61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b7626554a94481be8726d2303cab22)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:17.170430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c42dd0-ddc0-48d3-a7c2-7e5a29e0aa61 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:17.286931 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-67c42dd0-ddc0-48d3-a7c2-7e5a29e0aa61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b7626554a94481be8726d2303cab22', 'request_id': 'req-67c42dd0-ddc0-48d3-a7c2-7e5a29e0aa61'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:36:17.359862 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-67c42dd0-ddc0-48d3-a7c2-7e5a29e0aa61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b7626554a94481be8726d2303cab22', 'request_id': 'req-67c42dd0-ddc0-48d3-a7c2-7e5a29e0aa61'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:36:17.366407 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-67c42dd0-ddc0-48d3-a7c2-7e5a29e0aa61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b7626554a94481be8726d2303cab22', 'request_id': 'req-67c42dd0-ddc0-48d3-a7c2-7e5a29e0aa61'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:36:17.377970 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-67c42dd0-ddc0-48d3-a7c2-7e5a29e0aa61 admin admin] The token cache is being invalidate because project d1b7626554a94481be8726d2303cab22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:36:17.378265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-67c42dd0-ddc0-48d3-a7c2-7e5a29e0aa61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:36:17.378893 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-67c42dd0-ddc0-48d3-a7c2-7e5a29e0aa61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:36:17.380412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1080/2167] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:36:17 2022] DELETE /identity/v3/projects/d1b7626554a94481be8726d2303cab22 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:36:17.385596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc66d-4206-4ffc-a920-da6d326b8d49 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:17.386070 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc66d-4206-4ffc-a920-da6d326b8d49 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:17.386159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc66d-4206-4ffc-a920-da6d326b8d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:17.406638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-969cc66d-4206-4ffc-a920-da6d326b8d49 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:17.407803 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-969cc66d-4206-4ffc-a920-da6d326b8d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:17.426901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:17.476699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1088/2168] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:17.478393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027bf38-56fa-409f-a709-ec6e375fcfeb None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:17.478734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027bf38-56fa-409f-a709-ec6e375fcfeb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:17.479011 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027bf38-56fa-409f-a709-ec6e375fcfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:17.501212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-7027bf38-56fa-409f-a709-ec6e375fcfeb None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:17.502461 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7027bf38-56fa-409f-a709-ec6e375fcfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:17.510405 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1081/2169] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:17.514926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cc66d-4206-4ffc-a920-da6d326b8d49 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:17.524733 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cc66d-4206-4ffc-a920-da6d326b8d49 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:17.530052 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac56b8-d482-4fd4-920f-c116e174f287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:17.530389 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac56b8-d482-4fd4-920f-c116e174f287 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:17.530734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac56b8-d482-4fd4-920f-c116e174f287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:17.531009 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac56b8-d482-4fd4-920f-c116e174f287 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:17.531709 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac56b8-d482-4fd4-920f-c116e174f287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:36:17.532013 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac56b8-d482-4fd4-920f-c116e174f287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:17.533633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac56b8-d482-4fd4-920f-c116e174f287 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:17.552129 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1089/2170] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:36:17.553535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027bf38-56fa-409f-a709-ec6e375fcfeb None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:17.565358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027bf38-56fa-409f-a709-ec6e375fcfeb None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:17.571972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4f519-05cc-4b38-822a-c628000fc7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:17.574072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4f519-05cc-4b38-822a-c628000fc7dc admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:17.574072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4f519-05cc-4b38-822a-c628000fc7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:17.574072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4f519-05cc-4b38-822a-c628000fc7dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:17.574588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4f519-05cc-4b38-822a-c628000fc7dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:17.577210 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4f519-05cc-4b38-822a-c628000fc7dc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:17.681105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:17.681105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1082/2171] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:36:17 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:36:17.685623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac56b8-d482-4fd4-920f-c116e174f287 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:17.696603 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac56b8-d482-4fd4-920f-c116e174f287 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:17.755958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb312c1-393e-4cba-8aeb-b92d2ccd3876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:17.756577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb312c1-393e-4cba-8aeb-b92d2ccd3876 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:17.756856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb312c1-393e-4cba-8aeb-b92d2ccd3876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:17.757132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb312c1-393e-4cba-8aeb-b92d2ccd3876 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:17.757837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb312c1-393e-4cba-8aeb-b92d2ccd3876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:17.761573 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb312c1-393e-4cba-8aeb-b92d2ccd3876 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:17.852832 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1090/2172] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:36:17 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:36:17.856914 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4f519-05cc-4b38-822a-c628000fc7dc admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:17.868648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4f519-05cc-4b38-822a-c628000fc7dc admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:17.873493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3ac43-4439-410f-8d3d-375ae044e22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:17.874403 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3ac43-4439-410f-8d3d-375ae044e22d admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:17.874696 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3ac43-4439-410f-8d3d-375ae044e22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:17.874990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3ac43-4439-410f-8d3d-375ae044e22d admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:17.875634 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3ac43-4439-410f-8d3d-375ae044e22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:17.877206 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3ac43-4439-410f-8d3d-375ae044e22d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:17.894280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1083/2173] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:36:17.898565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb312c1-393e-4cba-8aeb-b92d2ccd3876 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:17.909135 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb312c1-393e-4cba-8aeb-b92d2ccd3876 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:17.913784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4134317-4ab1-4482-abb9-147573e7255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:17.914392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4134317-4ab1-4482-abb9-147573e7255b admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:17.914678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4134317-4ab1-4482-abb9-147573e7255b admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:17.914955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4134317-4ab1-4482-abb9-147573e7255b admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:17.915649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4134317-4ab1-4482-abb9-147573e7255b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:17.917296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4134317-4ab1-4482-abb9-147573e7255b admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:17.928543 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1091/2174] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:36:17.932591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3ac43-4439-410f-8d3d-375ae044e22d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:17.942351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3ac43-4439-410f-8d3d-375ae044e22d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:17.946867 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510ee9b-2376-48c6-9a7e-da1b0518ffd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:17.947515 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510ee9b-2376-48c6-9a7e-da1b0518ffd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:17.947795 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510ee9b-2376-48c6-9a7e-da1b0518ffd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:17.948072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510ee9b-2376-48c6-9a7e-da1b0518ffd0 admin admin] PATH_INFO: `/v3/projects/5989fabc615545eeb4ef987dea566175/users/7d859e797d874c948325f2ce0978edb6/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:17.962182 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510ee9b-2376-48c6-9a7e-da1b0518ffd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5989fabc615545eeb4ef987dea566175, user_id=7d859e797d874c948325f2ce0978edb6, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:17.964814 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510ee9b-2376-48c6-9a7e-da1b0518ffd0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:18.034721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1084/2175] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:36:17 2022] PUT /identity/v3/projects/5989fabc615545eeb4ef987dea566175/users/7d859e797d874c948325f2ce0978edb6/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:36:18.039792 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8547435-e778-4f11-8cb5-ec4a9f375901 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:18.040083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8547435-e778-4f11-8cb5-ec4a9f375901 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:18.040363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8547435-e778-4f11-8cb5-ec4a9f375901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:18.060874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-c8547435-e778-4f11-8cb5-ec4a9f375901 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:18.062128 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c8547435-e778-4f11-8cb5-ec4a9f375901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:18.126521 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1092/2176] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:18.136168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510ee9b-2376-48c6-9a7e-da1b0518ffd0 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:18.138518 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2510ee9b-2376-48c6-9a7e-da1b0518ffd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:18.200121 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510ee9b-2376-48c6-9a7e-da1b0518ffd0 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:18.204355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da77e22-0437-415f-b57c-fb43129760c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:18.205001 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da77e22-0437-415f-b57c-fb43129760c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:18.205282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da77e22-0437-415f-b57c-fb43129760c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:18.205592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da77e22-0437-415f-b57c-fb43129760c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:18.215725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da77e22-0437-415f-b57c-fb43129760c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:18.217855 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da77e22-0437-415f-b57c-fb43129760c4 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:18.228469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1085/2177] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:24.549755 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355ed7f-7e2b-4ca3-872a-27b23b8e2298 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:24.550247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355ed7f-7e2b-4ca3-872a-27b23b8e2298 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:24.550342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355ed7f-7e2b-4ca3-872a-27b23b8e2298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:24.578739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-8355ed7f-7e2b-4ca3-872a-27b23b8e2298 None None] MFA Rules not processed for user `7d859e797d874c948325f2ce0978edb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:24.579969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-8355ed7f-7e2b-4ca3-872a-27b23b8e2298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:24.597558 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:24.646762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1093/2178] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:36:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:24.651274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da77e22-0437-415f-b57c-fb43129760c4 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:24.661790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da77e22-0437-415f-b57c-fb43129760c4 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:24.666473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be08e3-a456-4aa0-91df-b612d9cd192d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:24.667087 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be08e3-a456-4aa0-91df-b612d9cd192d admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:24.669908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be08e3-a456-4aa0-91df-b612d9cd192d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:24.669908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be08e3-a456-4aa0-91df-b612d9cd192d admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:24.669908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be08e3-a456-4aa0-91df-b612d9cd192d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:24.671245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be08e3-a456-4aa0-91df-b612d9cd192d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:24.766568 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1086/2179] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:36:24 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:36:24.770915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355ed7f-7e2b-4ca3-872a-27b23b8e2298 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:24.782430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355ed7f-7e2b-4ca3-872a-27b23b8e2298 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:24.843901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e2490-6c85-468a-becb-be3150379f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:24.844542 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e2490-6c85-468a-becb-be3150379f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:24.844948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e2490-6c85-468a-becb-be3150379f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:24.845238 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e2490-6c85-468a-becb-be3150379f22 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:24.845959 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e2490-6c85-468a-becb-be3150379f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:24.847878 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e2490-6c85-468a-becb-be3150379f22 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:24.947156 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1094/2180] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:36:24 2022] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:36:24.948366 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be08e3-a456-4aa0-91df-b612d9cd192d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:24.961281 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be08e3-a456-4aa0-91df-b612d9cd192d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:24.966936 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ef92-c56a-427c-8cae-19d99dc42d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:24.968284 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ef92-c56a-427c-8cae-19d99dc42d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:24.968578 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ef92-c56a-427c-8cae-19d99dc42d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:24.968862 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ef92-c56a-427c-8cae-19d99dc42d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:24.969636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2ef92-c56a-427c-8cae-19d99dc42d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:24.971364 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2ef92-c56a-427c-8cae-19d99dc42d0c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:24.982842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1087/2181] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:36:24.987325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e2490-6c85-468a-becb-be3150379f22 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:24.998155 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e2490-6c85-468a-becb-be3150379f22 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:25.003036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24bb68-5903-42f9-9927-e112c7585a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:25.003699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24bb68-5903-42f9-9927-e112c7585a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:25.004007 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24bb68-5903-42f9-9927-e112c7585a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:25.004259 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24bb68-5903-42f9-9927-e112c7585a69 admin admin] PATH_INFO: `/v3/projects/3d7fec4638dd49119e677467284e61fb/users/0e2cc85ef6c24532b47bc9884c92d903/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:25.021613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24bb68-5903-42f9-9927-e112c7585a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7fec4638dd49119e677467284e61fb, user_id=0e2cc85ef6c24532b47bc9884c92d903, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:25.024278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24bb68-5903-42f9-9927-e112c7585a69 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:25.130650 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1095/2182] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:36:24 2022] PUT /identity/v3/projects/3d7fec4638dd49119e677467284e61fb/users/0e2cc85ef6c24532b47bc9884c92d903/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:36:25.134611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ef92-c56a-427c-8cae-19d99dc42d0c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:25.146340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ef92-c56a-427c-8cae-19d99dc42d0c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:25.215011 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24bb68-5903-42f9-9927-e112c7585a69 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:25.216004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e475a-fef8-43fe-8d0e-1cbb506dfb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:25.216717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e475a-fef8-43fe-8d0e-1cbb506dfb42 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:25.217691 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e475a-fef8-43fe-8d0e-1cbb506dfb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:25.218232 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e475a-fef8-43fe-8d0e-1cbb506dfb42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:25.219094 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e475a-fef8-43fe-8d0e-1cbb506dfb42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:25.220766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e475a-fef8-43fe-8d0e-1cbb506dfb42 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:25.232744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1088/2183] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:36:25.236063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e475a-fef8-43fe-8d0e-1cbb506dfb42 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:25.246798 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e475a-fef8-43fe-8d0e-1cbb506dfb42 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:25.254692 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb543ae3-77b7-4f4b-9be5-a7b539b7ec87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:25.255397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb543ae3-77b7-4f4b-9be5-a7b539b7ec87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:25.255750 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb543ae3-77b7-4f4b-9be5-a7b539b7ec87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:25.256033 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb543ae3-77b7-4f4b-9be5-a7b539b7ec87 admin admin] PATH_INFO: `/v3/projects/3d7fec4638dd49119e677467284e61fb/users/0e2cc85ef6c24532b47bc9884c92d903/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:25.267874 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb543ae3-77b7-4f4b-9be5-a7b539b7ec87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7fec4638dd49119e677467284e61fb, user_id=0e2cc85ef6c24532b47bc9884c92d903, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:25.271531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb543ae3-77b7-4f4b-9be5-a7b539b7ec87 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:25.284820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24bb68-5903-42f9-9927-e112c7585a69 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:25.286829 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1089/2184] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:36:25 2022] PUT /identity/v3/projects/3d7fec4638dd49119e677467284e61fb/users/0e2cc85ef6c24532b47bc9884c92d903/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:36:25.326928 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:25.338502 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85995a-9597-43b7-abe8-c9e3b8bc7a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:25.339236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85995a-9597-43b7-abe8-c9e3b8bc7a15 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:25.339592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85995a-9597-43b7-abe8-c9e3b8bc7a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:25.339939 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85995a-9597-43b7-abe8-c9e3b8bc7a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:25.341846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-dd85995a-9597-43b7-abe8-c9e3b8bc7a15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:25.415924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85995a-9597-43b7-abe8-c9e3b8bc7a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:25.417457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85995a-9597-43b7-abe8-c9e3b8bc7a15 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:25.430396 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1096/2185] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:36:32.585786 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6eef7-ab50-41a6-9ff1-89aabe60e8f3 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:32.586363 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6eef7-ab50-41a6-9ff1-89aabe60e8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:32.586474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6eef7-ab50-41a6-9ff1-89aabe60e8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:32.631498 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-91b6eef7-ab50-41a6-9ff1-89aabe60e8f3 None None] MFA Rules not processed for user `0e2cc85ef6c24532b47bc9884c92d903`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:32.632625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-91b6eef7-ab50-41a6-9ff1-89aabe60e8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:32.638168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:32.719864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1090/2186] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:36:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:32.732994 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85995a-9597-43b7-abe8-c9e3b8bc7a15 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:32.734534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-dd85995a-9597-43b7-abe8-c9e3b8bc7a15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:32.797591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85995a-9597-43b7-abe8-c9e3b8bc7a15 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:32.801499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a6658-b966-44be-bd6e-a0ae057de35f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628ef75fa7194253bcf6cd6c85211738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:32.802144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a6658-b966-44be-bd6e-a0ae057de35f service glance] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:32.804367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a6658-b966-44be-bd6e-a0ae057de35f service glance] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:32.804367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a6658-b966-44be-bd6e-a0ae057de35f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:32.862325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a6658-b966-44be-bd6e-a0ae057de35f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:32.863745 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a6658-b966-44be-bd6e-a0ae057de35f service glance] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:32.872620 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1097/2187] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:33.132780 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c095422-36a3-4380-beb8-8b2e88b6d754 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:33.133063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c095422-36a3-4380-beb8-8b2e88b6d754 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:33.133335 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c095422-36a3-4380-beb8-8b2e88b6d754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:33.153742 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-0c095422-36a3-4380-beb8-8b2e88b6d754 None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:33.155246 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0c095422-36a3-4380-beb8-8b2e88b6d754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:33.210919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1091/2188] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jul 28 05:36:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:33.351446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a6658-b966-44be-bd6e-a0ae057de35f service glance] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:33.352873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-fa9a6658-b966-44be-bd6e-a0ae057de35f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:33.397599 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:33.427210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a6658-b966-44be-bd6e-a0ae057de35f service glance] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:33.432562 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726425f-f58c-4558-b793-01b2b5158cf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:33.433206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726425f-f58c-4558-b793-01b2b5158cf3 service swift] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:33.433513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726425f-f58c-4558-b793-01b2b5158cf3 service swift] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:33.433797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726425f-f58c-4558-b793-01b2b5158cf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:33.442474 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726425f-f58c-4558-b793-01b2b5158cf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:33.444098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726425f-f58c-4558-b793-01b2b5158cf3 service swift] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:33.452416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1098/2189] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:36:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:36:36.196373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c095422-36a3-4380-beb8-8b2e88b6d754 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:36.199781 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0c095422-36a3-4380-beb8-8b2e88b6d754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:36.322309 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c095422-36a3-4380-beb8-8b2e88b6d754 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:36.330276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63827eed-1113-4aed-8596-3c73da4a9b08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:36.330953 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63827eed-1113-4aed-8596-3c73da4a9b08 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:36.331218 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63827eed-1113-4aed-8596-3c73da4a9b08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:36.331532 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63827eed-1113-4aed-8596-3c73da4a9b08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:36.334149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-63827eed-1113-4aed-8596-3c73da4a9b08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:36.414265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63827eed-1113-4aed-8596-3c73da4a9b08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:36.415731 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63827eed-1113-4aed-8596-3c73da4a9b08 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:36.471296 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1092/2190] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:36.605317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853509c5-3248-4d80-a54c-daf636fc223c None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:36.605815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853509c5-3248-4d80-a54c-daf636fc223c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:36.605932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853509c5-3248-4d80-a54c-daf636fc223c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:36.628000 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-853509c5-3248-4d80-a54c-daf636fc223c None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:36.629235 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-853509c5-3248-4d80-a54c-daf636fc223c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:36.648091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1099/2191] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jul 28 05:36:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:36.677840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63827eed-1113-4aed-8596-3c73da4a9b08 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:36.687433 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:36.701880 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63827eed-1113-4aed-8596-3c73da4a9b08 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:36.711859 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc962f1b-258c-4742-a68f-aba0c0cd0074 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:36.712493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc962f1b-258c-4742-a68f-aba0c0cd0074 service swift] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:36.712775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc962f1b-258c-4742-a68f-aba0c0cd0074 service swift] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:36.713053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc962f1b-258c-4742-a68f-aba0c0cd0074 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:36.745457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc962f1b-258c-4742-a68f-aba0c0cd0074 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:36.747338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc962f1b-258c-4742-a68f-aba0c0cd0074 service swift] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:36.759160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1093/2192] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:36:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:36:39.763388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853509c5-3248-4d80-a54c-daf636fc223c None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:39.775106 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853509c5-3248-4d80-a54c-daf636fc223c None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:39.784666 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be78c5-6f15-45b6-bbb1-17b07f3a1ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:39.785877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be78c5-6f15-45b6-bbb1-17b07f3a1ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:39.786192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be78c5-6f15-45b6-bbb1-17b07f3a1ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:39.786484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be78c5-6f15-45b6-bbb1-17b07f3a1ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:39.790225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e4be78c5-6f15-45b6-bbb1-17b07f3a1ae8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:39.902719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be78c5-6f15-45b6-bbb1-17b07f3a1ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:39.904201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be78c5-6f15-45b6-bbb1-17b07f3a1ae8 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:39.916953 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1100/2193] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:46.143978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7115386-0481-4b63-84e4-fbb1f041258b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:46.150044 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7115386-0481-4b63-84e4-fbb1f041258b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:46.150044 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7115386-0481-4b63-84e4-fbb1f041258b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:46.177719 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c7115386-0481-4b63-84e4-fbb1f041258b None None] MFA Rules not processed for user `7d859e797d874c948325f2ce0978edb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:46.177719 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c7115386-0481-4b63-84e4-fbb1f041258b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:46.192022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1094/2194] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:36:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:46.954740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be78c5-6f15-45b6-bbb1-17b07f3a1ae8 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:46.964616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be78c5-6f15-45b6-bbb1-17b07f3a1ae8 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:46.968962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50098f7a-c7d4-45bf-a8b3-70877f4bd724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:46.969860 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50098f7a-c7d4-45bf-a8b3-70877f4bd724 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:46.970159 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50098f7a-c7d4-45bf-a8b3-70877f4bd724 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:46.970485 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50098f7a-c7d4-45bf-a8b3-70877f4bd724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:46.972280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-50098f7a-c7d4-45bf-a8b3-70877f4bd724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:46.986237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50098f7a-c7d4-45bf-a8b3-70877f4bd724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:46.988191 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50098f7a-c7d4-45bf-a8b3-70877f4bd724 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:47.003014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1101/2195] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:47.488099 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7115386-0481-4b63-84e4-fbb1f041258b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:47.490593 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c7115386-0481-4b63-84e4-fbb1f041258b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:47.616524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7115386-0481-4b63-84e4-fbb1f041258b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:47.673933 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9af7d-9c21-485e-a6c7-e3811787f85d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aae5b2e7bf74805b04d01df47693ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:47.674658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9af7d-9c21-485e-a6c7-e3811787f85d service placement] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:47.677511 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9af7d-9c21-485e-a6c7-e3811787f85d service placement] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:47.677884 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9af7d-9c21-485e-a6c7-e3811787f85d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:47.681064 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e7f9af7d-9c21-485e-a6c7-e3811787f85d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:47.700265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9af7d-9c21-485e-a6c7-e3811787f85d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:47.702916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9af7d-9c21-485e-a6c7-e3811787f85d service placement] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:47.729154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1095/2196] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:48.745707 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50098f7a-c7d4-45bf-a8b3-70877f4bd724 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:48.758503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50098f7a-c7d4-45bf-a8b3-70877f4bd724 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:48.763710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f175cb-92c4-452e-b1d8-152150507d35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:48.764458 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f175cb-92c4-452e-b1d8-152150507d35 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:48.764847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f175cb-92c4-452e-b1d8-152150507d35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:48.765230 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f175cb-92c4-452e-b1d8-152150507d35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:48.767392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-59f175cb-92c4-452e-b1d8-152150507d35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:48.856587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f175cb-92c4-452e-b1d8-152150507d35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:48.859150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f175cb-92c4-452e-b1d8-152150507d35 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:48.882063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1102/2197] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:52.334211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f352f53-1bfe-4220-95f1-48d3615260ad None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:52.334819 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f352f53-1bfe-4220-95f1-48d3615260ad None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:52.334819 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f352f53-1bfe-4220-95f1-48d3615260ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:52.370367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6f352f53-1bfe-4220-95f1-48d3615260ad None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:52.371784 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6f352f53-1bfe-4220-95f1-48d3615260ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:52.380157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1096/2198] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jul 28 05:36:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:36:52.397702 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f175cb-92c4-452e-b1d8-152150507d35 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:52.416643 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f175cb-92c4-452e-b1d8-152150507d35 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:52.417881 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f67ec-6729-4cae-aa00-d4d73a453c5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:52.418907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f67ec-6729-4cae-aa00-d4d73a453c5c service swift] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:52.419484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f67ec-6729-4cae-aa00-d4d73a453c5c service swift] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:52.420029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f67ec-6729-4cae-aa00-d4d73a453c5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:52.432373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f67ec-6729-4cae-aa00-d4d73a453c5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:52.434374 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f67ec-6729-4cae-aa00-d4d73a453c5c service swift] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:52.450459 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1103/2199] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:36:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:36:53.199651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f352f53-1bfe-4220-95f1-48d3615260ad None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:53.206516 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6f352f53-1bfe-4220-95f1-48d3615260ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:53.220830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f352f53-1bfe-4220-95f1-48d3615260ad None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:53.249329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439a763-e8f0-47ed-9e8d-0299699853b9 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:53.249329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439a763-e8f0-47ed-9e8d-0299699853b9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:53.249329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439a763-e8f0-47ed-9e8d-0299699853b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:53.251935 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d890411-b62c-4ab9-b098-e0aee0d53b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:53.254042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d890411-b62c-4ab9-b098-e0aee0d53b29 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:53.255418 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d890411-b62c-4ab9-b098-e0aee0d53b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:53.255769 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d890411-b62c-4ab9-b098-e0aee0d53b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:53.264021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4d890411-b62c-4ab9-b098-e0aee0d53b29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:53.286895 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e439a763-e8f0-47ed-9e8d-0299699853b9 None None] MFA Rules not processed for user `b3c43b517c8a464c93f0ce620826ad35`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:53.287043 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d890411-b62c-4ab9-b098-e0aee0d53b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:53.287152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e439a763-e8f0-47ed-9e8d-0299699853b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:53.287736 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d890411-b62c-4ab9-b098-e0aee0d53b29 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:53.296976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1104/2200] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:36:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:53.322100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1097/2201] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:57.803384 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439a763-e8f0-47ed-9e8d-0299699853b9 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:57.830769 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439a763-e8f0-47ed-9e8d-0299699853b9 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:57.838938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7b704-bf3c-409b-9b04-969b1011d942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:57.839709 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7b704-bf3c-409b-9b04-969b1011d942 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:57.840052 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7b704-bf3c-409b-9b04-969b1011d942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:57.840405 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7b704-bf3c-409b-9b04-969b1011d942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:57.843085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d4f7b704-bf3c-409b-9b04-969b1011d942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:57.907252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:57.987295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7b704-bf3c-409b-9b04-969b1011d942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:57.988819 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7b704-bf3c-409b-9b04-969b1011d942 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:58.008076 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1105/2202] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:58.128963 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d890411-b62c-4ab9-b098-e0aee0d53b29 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:58.130428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4d890411-b62c-4ab9-b098-e0aee0d53b29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:58.165720 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d890411-b62c-4ab9-b098-e0aee0d53b29 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:58.175362 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482c0ce-4f99-4cda-8bf8-e8f2e266c608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:58.175980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482c0ce-4f99-4cda-8bf8-e8f2e266c608 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:58.176264 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482c0ce-4f99-4cda-8bf8-e8f2e266c608 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:58.176541 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482c0ce-4f99-4cda-8bf8-e8f2e266c608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:58.180079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a482c0ce-4f99-4cda-8bf8-e8f2e266c608 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:58.189846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fecb6-97c6-4a43-ae45-19a82fb0653b None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:58.190246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fecb6-97c6-4a43-ae45-19a82fb0653b None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:58.190601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fecb6-97c6-4a43-ae45-19a82fb0653b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:58.240036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-315fecb6-97c6-4a43-ae45-19a82fb0653b None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:58.241520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-315fecb6-97c6-4a43-ae45-19a82fb0653b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:58.270473 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1106/2203] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jul 28 05:36:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:36:58.285448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482c0ce-4f99-4cda-8bf8-e8f2e266c608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:58.290155 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482c0ce-4f99-4cda-8bf8-e8f2e266c608 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:58.296203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fecb6-97c6-4a43-ae45-19a82fb0653b None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:58.315128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1098/2204] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:58.329024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fecb6-97c6-4a43-ae45-19a82fb0653b None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:58.344193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78305641-87b8-4902-bbf9-716ca30f53c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:58.345262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78305641-87b8-4902-bbf9-716ca30f53c8 service swift] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:58.345815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78305641-87b8-4902-bbf9-716ca30f53c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:58.348718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78305641-87b8-4902-bbf9-716ca30f53c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:58.368429 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78305641-87b8-4902-bbf9-716ca30f53c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:58.370518 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78305641-87b8-4902-bbf9-716ca30f53c8 service swift] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:58.388960 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1107/2205] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:36:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:37:03.319885 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482c0ce-4f99-4cda-8bf8-e8f2e266c608 service nova] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:03.321804 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a482c0ce-4f99-4cda-8bf8-e8f2e266c608 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:03.339433 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482c0ce-4f99-4cda-8bf8-e8f2e266c608 service nova] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:03.345976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bc6ca-7fbe-4141-af92-076c1c52ee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:03.346941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bc6ca-7fbe-4141-af92-076c1c52ee06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:03.347218 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bc6ca-7fbe-4141-af92-076c1c52ee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:03.347787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bc6ca-7fbe-4141-af92-076c1c52ee06 admin admin] PATH_INFO: `/v3/users/4fcc81558e8f4224ad2ea6fb2b7bf0f9` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:03.349097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bc6ca-7fbe-4141-af92-076c1c52ee06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fcc81558e8f4224ad2ea6fb2b7bf0f9)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:03.351131 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bc6ca-7fbe-4141-af92-076c1c52ee06 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:03.603479 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:03.604797 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-bc3bc6ca-7fbe-4141-af92-076c1c52ee06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fcc81558e8f4224ad2ea6fb2b7bf0f9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:03.605483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-bc3bc6ca-7fbe-4141-af92-076c1c52ee06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fcc81558e8f4224ad2ea6fb2b7bf0f9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:03.672952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-bc3bc6ca-7fbe-4141-af92-076c1c52ee06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fcc81558e8f4224ad2ea6fb2b7bf0f9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:03.698899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-bc3bc6ca-7fbe-4141-af92-076c1c52ee06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fcc81558e8f4224ad2ea6fb2b7bf0f9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:03.699646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-bc3bc6ca-7fbe-4141-af92-076c1c52ee06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fcc81558e8f4224ad2ea6fb2b7bf0f9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:03.714427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1099/2206] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:37:03 2022] DELETE /identity/v3/users/4fcc81558e8f4224ad2ea6fb2b7bf0f9 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:03.970065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78305641-87b8-4902-bbf9-716ca30f53c8 service swift] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:03.985077 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78305641-87b8-4902-bbf9-716ca30f53c8 service swift] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:04.047148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb7447-6a7a-48e5-ad18-a93769d37985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:04.048037 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb7447-6a7a-48e5-ad18-a93769d37985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:04.048389 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb7447-6a7a-48e5-ad18-a93769d37985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:04.048738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb7447-6a7a-48e5-ad18-a93769d37985 admin admin] PATH_INFO: `/v3/projects/99f094bca18d4939bb22f8d076d3a35c` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:04.050674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb7447-6a7a-48e5-ad18-a93769d37985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f094bca18d4939bb22f8d076d3a35c)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:04.052697 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb7447-6a7a-48e5-ad18-a93769d37985 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:04.165285 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1dcb7447-6a7a-48e5-ad18-a93769d37985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f094bca18d4939bb22f8d076d3a35c', 'request_id': 'req-1dcb7447-6a7a-48e5-ad18-a93769d37985'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:04.233321 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1dcb7447-6a7a-48e5-ad18-a93769d37985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f094bca18d4939bb22f8d076d3a35c', 'request_id': 'req-1dcb7447-6a7a-48e5-ad18-a93769d37985'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:04.240808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1dcb7447-6a7a-48e5-ad18-a93769d37985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f094bca18d4939bb22f8d076d3a35c', 'request_id': 'req-1dcb7447-6a7a-48e5-ad18-a93769d37985'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:04.253182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1dcb7447-6a7a-48e5-ad18-a93769d37985 admin admin] The token cache is being invalidate because project 99f094bca18d4939bb22f8d076d3a35c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:37:04.253490 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1dcb7447-6a7a-48e5-ad18-a93769d37985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:04.254164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1dcb7447-6a7a-48e5-ad18-a93769d37985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:04.255922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1108/2207] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:37:03 2022] DELETE /identity/v3/projects/99f094bca18d4939bb22f8d076d3a35c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:04.268267 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337980c6-532d-4ba6-80a2-c8ad56a2a209 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:04.268814 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337980c6-532d-4ba6-80a2-c8ad56a2a209 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:04.269191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337980c6-532d-4ba6-80a2-c8ad56a2a209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:04.290307 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-337980c6-532d-4ba6-80a2-c8ad56a2a209 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:04.291469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-337980c6-532d-4ba6-80a2-c8ad56a2a209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:04.354430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1100/2208] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:04.363724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd23b7-0fb0-403b-8f78-65509210a68d None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:04.364014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd23b7-0fb0-403b-8f78-65509210a68d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:04.364309 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd23b7-0fb0-403b-8f78-65509210a68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:04.384671 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-57fd23b7-0fb0-403b-8f78-65509210a68d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:04.386206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-57fd23b7-0fb0-403b-8f78-65509210a68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:04.395256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1109/2209] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:04.399539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337980c6-532d-4ba6-80a2-c8ad56a2a209 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:04.410214 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337980c6-532d-4ba6-80a2-c8ad56a2a209 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:04.414519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b27ff5-1038-4666-9ee8-ba7a9b34ed12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:04.415135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b27ff5-1038-4666-9ee8-ba7a9b34ed12 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:04.415411 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b27ff5-1038-4666-9ee8-ba7a9b34ed12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:04.415708 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b27ff5-1038-4666-9ee8-ba7a9b34ed12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:04.416401 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b27ff5-1038-4666-9ee8-ba7a9b34ed12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:37:04.416734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b27ff5-1038-4666-9ee8-ba7a9b34ed12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:04.418357 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b27ff5-1038-4666-9ee8-ba7a9b34ed12 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:04.430953 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1101/2210] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:37:04.435415 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd23b7-0fb0-403b-8f78-65509210a68d None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:04.446345 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd23b7-0fb0-403b-8f78-65509210a68d None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:04.451423 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c6efa-cb36-485b-8c48-75a18ebc3b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:04.452057 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c6efa-cb36-485b-8c48-75a18ebc3b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:04.453047 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c6efa-cb36-485b-8c48-75a18ebc3b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:04.453047 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c6efa-cb36-485b-8c48-75a18ebc3b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:04.453436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c6efa-cb36-485b-8c48-75a18ebc3b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:04.455393 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c6efa-cb36-485b-8c48-75a18ebc3b51 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:04.566701 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:04.577339 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1110/2211] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:37:04 2022] POST /identity/v3/projects => generated 403 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:04.581234 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b27ff5-1038-4666-9ee8-ba7a9b34ed12 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:04.589379 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b27ff5-1038-4666-9ee8-ba7a9b34ed12 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:04.650635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db3b36-9dca-46a6-aec5-af205c32677d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:04.651266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db3b36-9dca-46a6-aec5-af205c32677d admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:04.651550 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db3b36-9dca-46a6-aec5-af205c32677d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:04.651828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db3b36-9dca-46a6-aec5-af205c32677d admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:04.652500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db3b36-9dca-46a6-aec5-af205c32677d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:04.655354 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db3b36-9dca-46a6-aec5-af205c32677d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:04.767390 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1102/2212] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:37:04 2022] POST /identity/v3/users => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:04.771815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c6efa-cb36-485b-8c48-75a18ebc3b51 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:04.783120 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c6efa-cb36-485b-8c48-75a18ebc3b51 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:04.787943 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b7ce9-10eb-44c8-a8a8-6764321fd878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:04.788562 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b7ce9-10eb-44c8-a8a8-6764321fd878 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:04.788844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b7ce9-10eb-44c8-a8a8-6764321fd878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:04.789121 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b7ce9-10eb-44c8-a8a8-6764321fd878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:04.789855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b7ce9-10eb-44c8-a8a8-6764321fd878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:04.791573 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b7ce9-10eb-44c8-a8a8-6764321fd878 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:04.805498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1111/2213] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:04.806610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db3b36-9dca-46a6-aec5-af205c32677d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:04.817511 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db3b36-9dca-46a6-aec5-af205c32677d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:04.822430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73313024-2db3-4fa0-bf38-09f5c96d3fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:04.822969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73313024-2db3-4fa0-bf38-09f5c96d3fff admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:04.823329 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73313024-2db3-4fa0-bf38-09f5c96d3fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:04.823520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73313024-2db3-4fa0-bf38-09f5c96d3fff admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:04.824906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73313024-2db3-4fa0-bf38-09f5c96d3fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:04.825872 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73313024-2db3-4fa0-bf38-09f5c96d3fff admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:04.841023 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1103/2214] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:04.842074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b7ce9-10eb-44c8-a8a8-6764321fd878 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:04.846442 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73313024-2db3-4fa0-bf38-09f5c96d3fff admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:04.857078 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-73313024-2db3-4fa0-bf38-09f5c96d3fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:04.857606 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b7ce9-10eb-44c8-a8a8-6764321fd878 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:04.860420 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed63589-4847-40f9-b321-5bb16ba489f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:04.861582 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed63589-4847-40f9-b321-5bb16ba489f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:04.861766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed63589-4847-40f9-b321-5bb16ba489f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:04.862053 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed63589-4847-40f9-b321-5bb16ba489f9 admin admin] PATH_INFO: `/v3/projects/7e8a90930be148bea235087faa37735d/users/139a961fa72344debf7ac8e4f54a0e68/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:04.868352 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73313024-2db3-4fa0-bf38-09f5c96d3fff admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:04.874799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06954d-578a-40e5-b9ef-1696544900fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:04.875522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06954d-578a-40e5-b9ef-1696544900fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:04.875884 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06954d-578a-40e5-b9ef-1696544900fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:04.876222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06954d-578a-40e5-b9ef-1696544900fd admin admin] PATH_INFO: `/v3/users/c3310483e0e64521999dfcafec143f0f` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:04.877617 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06954d-578a-40e5-b9ef-1696544900fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3310483e0e64521999dfcafec143f0f)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:04.879603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06954d-578a-40e5-b9ef-1696544900fd admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:04.880036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed63589-4847-40f9-b321-5bb16ba489f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8a90930be148bea235087faa37735d, user_id=139a961fa72344debf7ac8e4f54a0e68, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:04.882942 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed63589-4847-40f9-b321-5bb16ba489f9 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:04.912229 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:04.988144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1112/2215] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:37:04 2022] PUT /identity/v3/projects/7e8a90930be148bea235087faa37735d/users/139a961fa72344debf7ac8e4f54a0e68/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:37:04.993255 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddf7e9-3780-4deb-b13f-d80bcbf20a15 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:04.993648 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddf7e9-3780-4deb-b13f-d80bcbf20a15 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:04.994009 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddf7e9-3780-4deb-b13f-d80bcbf20a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:05.019349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-d8ddf7e9-3780-4deb-b13f-d80bcbf20a15 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:05.022712 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d8ddf7e9-3780-4deb-b13f-d80bcbf20a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:05.095582 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1113/2216] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:05.103039 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddf7e9-3780-4deb-b13f-d80bcbf20a15 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:05.104873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d8ddf7e9-3780-4deb-b13f-d80bcbf20a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:05.114827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7e06954d-578a-40e5-b9ef-1696544900fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3310483e0e64521999dfcafec143f0f'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:05.116177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7e06954d-578a-40e5-b9ef-1696544900fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3310483e0e64521999dfcafec143f0f'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:05.175685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddf7e9-3780-4deb-b13f-d80bcbf20a15 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:05.180603 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96831c-2034-4e16-bbae-e0efbe88f718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:05.181555 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96831c-2034-4e16-bbae-e0efbe88f718 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:05.181949 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96831c-2034-4e16-bbae-e0efbe88f718 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:05.182301 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96831c-2034-4e16-bbae-e0efbe88f718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:05.198499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5e96831c-2034-4e16-bbae-e0efbe88f718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:05.214506 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96831c-2034-4e16-bbae-e0efbe88f718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:05.216627 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96831c-2034-4e16-bbae-e0efbe88f718 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:05.219022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7e06954d-578a-40e5-b9ef-1696544900fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3310483e0e64521999dfcafec143f0f'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:05.229276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1114/2217] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:37:05.241581 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7e06954d-578a-40e5-b9ef-1696544900fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3310483e0e64521999dfcafec143f0f'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:05.245599 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7e06954d-578a-40e5-b9ef-1696544900fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3310483e0e64521999dfcafec143f0f'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:05.275135 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1104/2218] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:37:04 2022] DELETE /identity/v3/users/c3310483e0e64521999dfcafec143f0f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:05.652908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96831c-2034-4e16-bbae-e0efbe88f718 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:05.654547 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5e96831c-2034-4e16-bbae-e0efbe88f718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:05.667282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96831c-2034-4e16-bbae-e0efbe88f718 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:05.733133 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2333bc4-192e-4d7d-b29f-97596ff112df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:05.733830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2333bc4-192e-4d7d-b29f-97596ff112df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:05.738246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2333bc4-192e-4d7d-b29f-97596ff112df admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:05.738246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2333bc4-192e-4d7d-b29f-97596ff112df admin admin] PATH_INFO: `/v3/projects/6ce7104e69fe4e15b070558784aa40d6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:05.738246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2333bc4-192e-4d7d-b29f-97596ff112df admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce7104e69fe4e15b070558784aa40d6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:05.738246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2333bc4-192e-4d7d-b29f-97596ff112df admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:05.745975 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:05.894225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e2333bc4-192e-4d7d-b29f-97596ff112df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce7104e69fe4e15b070558784aa40d6', 'request_id': 'req-e2333bc4-192e-4d7d-b29f-97596ff112df'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:05.994683 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e2333bc4-192e-4d7d-b29f-97596ff112df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce7104e69fe4e15b070558784aa40d6', 'request_id': 'req-e2333bc4-192e-4d7d-b29f-97596ff112df'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:06.003742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e2333bc4-192e-4d7d-b29f-97596ff112df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce7104e69fe4e15b070558784aa40d6', 'request_id': 'req-e2333bc4-192e-4d7d-b29f-97596ff112df'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:06.028126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e2333bc4-192e-4d7d-b29f-97596ff112df admin admin] The token cache is being invalidate because project 6ce7104e69fe4e15b070558784aa40d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:37:06.029535 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e2333bc4-192e-4d7d-b29f-97596ff112df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:06.030079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e2333bc4-192e-4d7d-b29f-97596ff112df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:06.032186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1115/2219] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:37:05 2022] DELETE /identity/v3/projects/6ce7104e69fe4e15b070558784aa40d6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:07.316971 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06954d-578a-40e5-b9ef-1696544900fd admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:07.321661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7e06954d-578a-40e5-b9ef-1696544900fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:07.442608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06954d-578a-40e5-b9ef-1696544900fd admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:07.505901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc736007-3948-4b71-bf37-8259f3ce2e6b None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:07.506947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc736007-3948-4b71-bf37-8259f3ce2e6b None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:07.507597 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc736007-3948-4b71-bf37-8259f3ce2e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:07.552453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-cc736007-3948-4b71-bf37-8259f3ce2e6b None None] MFA Rules not processed for user `139a961fa72344debf7ac8e4f54a0e68`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:07.554663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-cc736007-3948-4b71-bf37-8259f3ce2e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:07.602363 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6355810-bb2b-4aee-84c6-39696ce00029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:07.606665 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6355810-bb2b-4aee-84c6-39696ce00029 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:07.606665 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6355810-bb2b-4aee-84c6-39696ce00029 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:07.606665 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6355810-bb2b-4aee-84c6-39696ce00029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:07.609030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c6355810-bb2b-4aee-84c6-39696ce00029 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:07.627216 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6355810-bb2b-4aee-84c6-39696ce00029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:07.665588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6355810-bb2b-4aee-84c6-39696ce00029 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:07.693708 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1116/2220] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:37:07.697831 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc736007-3948-4b71-bf37-8259f3ce2e6b None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:07.699499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-cc736007-3948-4b71-bf37-8259f3ce2e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:07.722790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1105/2221] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:37:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:37:07.791678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc736007-3948-4b71-bf37-8259f3ce2e6b None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:07.796949 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708ad52-2d89-48da-b3f0-d19c1b696c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:07.797697 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708ad52-2d89-48da-b3f0-d19c1b696c54 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:07.798073 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708ad52-2d89-48da-b3f0-d19c1b696c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:07.798397 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708ad52-2d89-48da-b3f0-d19c1b696c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:07.799175 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708ad52-2d89-48da-b3f0-d19c1b696c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:07.801912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708ad52-2d89-48da-b3f0-d19c1b696c54 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:07.896102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1117/2222] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:37:07 2022] POST /identity/v3/projects => generated 401 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:37:07.897340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6355810-bb2b-4aee-84c6-39696ce00029 service nova] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:07.917802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6355810-bb2b-4aee-84c6-39696ce00029 service nova] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:07.954430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:08.029113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afeca8-0040-4d6a-afda-fee3b1d2fdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:08.029786 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708ad52-2d89-48da-b3f0-d19c1b696c54 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:08.030966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afeca8-0040-4d6a-afda-fee3b1d2fdcc admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:08.031475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afeca8-0040-4d6a-afda-fee3b1d2fdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:08.032188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d708ad52-2d89-48da-b3f0-d19c1b696c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:08.032713 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afeca8-0040-4d6a-afda-fee3b1d2fdcc admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:08.033911 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afeca8-0040-4d6a-afda-fee3b1d2fdcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:08.037756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afeca8-0040-4d6a-afda-fee3b1d2fdcc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:08.065789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:08.154409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708ad52-2d89-48da-b3f0-d19c1b696c54 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:08.163460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d82ed1-69a2-49ba-8efe-620c89203845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:08.164794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d82ed1-69a2-49ba-8efe-620c89203845 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:08.164794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d82ed1-69a2-49ba-8efe-620c89203845 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:08.164794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d82ed1-69a2-49ba-8efe-620c89203845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:08.166685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f0d82ed1-69a2-49ba-8efe-620c89203845 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:08.179597 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d82ed1-69a2-49ba-8efe-620c89203845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:08.181183 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d82ed1-69a2-49ba-8efe-620c89203845 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:08.193933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1118/2223] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:37:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:37:08.264766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1106/2224] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:37:07 2022] POST /identity/v3/users => generated 307 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:08.265088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d82ed1-69a2-49ba-8efe-620c89203845 service nova] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:08.284066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d82ed1-69a2-49ba-8efe-620c89203845 service nova] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:08.292823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077e077-9c76-4c6f-8297-ad411ef93632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:08.293556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077e077-9c76-4c6f-8297-ad411ef93632 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:08.293844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077e077-9c76-4c6f-8297-ad411ef93632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:08.294247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077e077-9c76-4c6f-8297-ad411ef93632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:08.295142 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077e077-9c76-4c6f-8297-ad411ef93632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:08.296740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077e077-9c76-4c6f-8297-ad411ef93632 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:08.307569 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1119/2225] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:08.312625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afeca8-0040-4d6a-afda-fee3b1d2fdcc admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:08.323324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afeca8-0040-4d6a-afda-fee3b1d2fdcc admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:08.330768 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526f02c-556e-47c5-b4b9-e31530bd9442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:08.331555 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f02c-556e-47c5-b4b9-e31530bd9442 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:08.331754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f02c-556e-47c5-b4b9-e31530bd9442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:08.332037 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f02c-556e-47c5-b4b9-e31530bd9442 admin admin] PATH_INFO: `/v3/projects/e478b4bf96c743688952cdf24dd4d0ba/users/a6905a1dbd2e4bb3bf8023cc53a46498/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:08.350295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526f02c-556e-47c5-b4b9-e31530bd9442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e478b4bf96c743688952cdf24dd4d0ba, user_id=a6905a1dbd2e4bb3bf8023cc53a46498, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:08.353345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526f02c-556e-47c5-b4b9-e31530bd9442 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:08.461558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1107/2226] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:37:08 2022] PUT /identity/v3/projects/e478b4bf96c743688952cdf24dd4d0ba/users/a6905a1dbd2e4bb3bf8023cc53a46498/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:08.465781 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077e077-9c76-4c6f-8297-ad411ef93632 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:08.477356 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077e077-9c76-4c6f-8297-ad411ef93632 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:08.583839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953adcd-b074-4c70-9bed-c8f833a13c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:08.585179 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953adcd-b074-4c70-9bed-c8f833a13c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:08.585685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953adcd-b074-4c70-9bed-c8f833a13c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:08.585967 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953adcd-b074-4c70-9bed-c8f833a13c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:08.586668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953adcd-b074-4c70-9bed-c8f833a13c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:08.588291 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953adcd-b074-4c70-9bed-c8f833a13c54 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:08.599041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1120/2227] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:08.602947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526f02c-556e-47c5-b4b9-e31530bd9442 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:08.615585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526f02c-556e-47c5-b4b9-e31530bd9442 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:08.620539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbbc3a-615e-440b-b175-cf25c1914507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:08.621225 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbbc3a-615e-440b-b175-cf25c1914507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:08.625550 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbbc3a-615e-440b-b175-cf25c1914507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:08.625550 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbbc3a-615e-440b-b175-cf25c1914507 admin admin] PATH_INFO: `/v3/projects/e478b4bf96c743688952cdf24dd4d0ba/users/a6905a1dbd2e4bb3bf8023cc53a46498/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:08.625550 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbbc3a-615e-440b-b175-cf25c1914507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e478b4bf96c743688952cdf24dd4d0ba, user_id=a6905a1dbd2e4bb3bf8023cc53a46498, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:08.627749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbbc3a-615e-440b-b175-cf25c1914507 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:08.641153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1108/2228] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:37:08 2022] PUT /identity/v3/projects/e478b4bf96c743688952cdf24dd4d0ba/users/a6905a1dbd2e4bb3bf8023cc53a46498/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:10.239224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9fafd-8930-4603-a507-1ee99aa33eda None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:10.239761 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9fafd-8930-4603-a507-1ee99aa33eda None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:10.239761 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9fafd-8930-4603-a507-1ee99aa33eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:10.300224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-8bc9fafd-8930-4603-a507-1ee99aa33eda None None] MFA Rules not processed for user `a6905a1dbd2e4bb3bf8023cc53a46498`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:10.301674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-8bc9fafd-8930-4603-a507-1ee99aa33eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:10.405546 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1121/2229] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:10 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:12.039496 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbbc3a-615e-440b-b175-cf25c1914507 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:12.112685 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbbc3a-615e-440b-b175-cf25c1914507 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:12.117432 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa6a23-0048-4cb6-9fef-802e6efe2e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:12.118257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa6a23-0048-4cb6-9fef-802e6efe2e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:12.118608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa6a23-0048-4cb6-9fef-802e6efe2e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:12.119123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa6a23-0048-4cb6-9fef-802e6efe2e88 admin admin] PATH_INFO: `/v3/users/139a961fa72344debf7ac8e4f54a0e68` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:12.120380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa6a23-0048-4cb6-9fef-802e6efe2e88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139a961fa72344debf7ac8e4f54a0e68)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:12.122440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa6a23-0048-4cb6-9fef-802e6efe2e88 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:12.295868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-29fa6a23-0048-4cb6-9fef-802e6efe2e88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139a961fa72344debf7ac8e4f54a0e68'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:12.296877 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-29fa6a23-0048-4cb6-9fef-802e6efe2e88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139a961fa72344debf7ac8e4f54a0e68'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:12.383329 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-29fa6a23-0048-4cb6-9fef-802e6efe2e88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139a961fa72344debf7ac8e4f54a0e68'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:12.401546 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-29fa6a23-0048-4cb6-9fef-802e6efe2e88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139a961fa72344debf7ac8e4f54a0e68'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:12.402260 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-29fa6a23-0048-4cb6-9fef-802e6efe2e88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139a961fa72344debf7ac8e4f54a0e68'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:12.408513 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:12.419677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1109/2230] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:37:12 2022] DELETE /identity/v3/users/139a961fa72344debf7ac8e4f54a0e68 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:37:12.613155 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc1da1-581b-4fb2-ab67-a78e9e056dff None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:12.613760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc1da1-581b-4fb2-ab67-a78e9e056dff None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:12.613936 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc1da1-581b-4fb2-ab67-a78e9e056dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:12.627851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:12.633756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-1cfc1da1-581b-4fb2-ab67-a78e9e056dff None None] MFA Rules not processed for user `0002ebbc629b4dafb109dc94450fe1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:12.634974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-1cfc1da1-581b-4fb2-ab67-a78e9e056dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:12.691816 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1122/2231] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:12.699109 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa6a23-0048-4cb6-9fef-802e6efe2e88 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:12.701521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-29fa6a23-0048-4cb6-9fef-802e6efe2e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:12.777398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa6a23-0048-4cb6-9fef-802e6efe2e88 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:12.782304 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:12.782949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:12.783229 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:12.783500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6 admin admin] PATH_INFO: `/v3/projects/7e8a90930be148bea235087faa37735d` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:12.784781 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8a90930be148bea235087faa37735d)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:12.786832 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:12.887237 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8a90930be148bea235087faa37735d', 'request_id': 'req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:12.946981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8a90930be148bea235087faa37735d', 'request_id': 'req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:12.954254 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8a90930be148bea235087faa37735d', 'request_id': 'req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:12.965264 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6 admin admin] The token cache is being invalidate because project 7e8a90930be148bea235087faa37735d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:37:12.965608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:12.966307 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:12.967933 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1110/2232] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:37:12 2022] DELETE /identity/v3/projects/7e8a90930be148bea235087faa37735d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:12.972116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc1da1-581b-4fb2-ab67-a78e9e056dff None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:12.984188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc1da1-581b-4fb2-ab67-a78e9e056dff None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:13.054878 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c23d7-aaee-47ca-be5f-c5323520f7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:13.055615 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c23d7-aaee-47ca-be5f-c5323520f7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:13.055962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c23d7-aaee-47ca-be5f-c5323520f7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:13.056629 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c23d7-aaee-47ca-be5f-c5323520f7b6 admin admin] PATH_INFO: `/v3/users/a6905a1dbd2e4bb3bf8023cc53a46498` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:13.057707 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c23d7-aaee-47ca-be5f-c5323520f7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6905a1dbd2e4bb3bf8023cc53a46498)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:13.060461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c23d7-aaee-47ca-be5f-c5323520f7b6 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:13.267207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e29c23d7-aaee-47ca-be5f-c5323520f7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6905a1dbd2e4bb3bf8023cc53a46498'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:13.270390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e29c23d7-aaee-47ca-be5f-c5323520f7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6905a1dbd2e4bb3bf8023cc53a46498'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:13.375347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e29c23d7-aaee-47ca-be5f-c5323520f7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6905a1dbd2e4bb3bf8023cc53a46498'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:13.382837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e29c23d7-aaee-47ca-be5f-c5323520f7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6905a1dbd2e4bb3bf8023cc53a46498'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:13.395557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-e29c23d7-aaee-47ca-be5f-c5323520f7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6905a1dbd2e4bb3bf8023cc53a46498'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:13.401423 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1123/2233] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:37:12 2022] DELETE /identity/v3/users/a6905a1dbd2e4bb3bf8023cc53a46498 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:13.760528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:13.762042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:13.775835 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d4af-0e9c-4aa9-b9c0-04e3a47449e6 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:13.845809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051071e3-1d4e-4a62-aa7c-f0cc24b84842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:13.846547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051071e3-1d4e-4a62-aa7c-f0cc24b84842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:13.846868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051071e3-1d4e-4a62-aa7c-f0cc24b84842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:13.847196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051071e3-1d4e-4a62-aa7c-f0cc24b84842 admin admin] PATH_INFO: `/v3/projects/e478b4bf96c743688952cdf24dd4d0ba` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:13.848420 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051071e3-1d4e-4a62-aa7c-f0cc24b84842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e478b4bf96c743688952cdf24dd4d0ba)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:13.850709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051071e3-1d4e-4a62-aa7c-f0cc24b84842 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:13.939158 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:13.956154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-051071e3-1d4e-4a62-aa7c-f0cc24b84842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e478b4bf96c743688952cdf24dd4d0ba', 'request_id': 'req-051071e3-1d4e-4a62-aa7c-f0cc24b84842'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:14.062020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-051071e3-1d4e-4a62-aa7c-f0cc24b84842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e478b4bf96c743688952cdf24dd4d0ba', 'request_id': 'req-051071e3-1d4e-4a62-aa7c-f0cc24b84842'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:14.069043 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-051071e3-1d4e-4a62-aa7c-f0cc24b84842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e478b4bf96c743688952cdf24dd4d0ba', 'request_id': 'req-051071e3-1d4e-4a62-aa7c-f0cc24b84842'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:14.080980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-051071e3-1d4e-4a62-aa7c-f0cc24b84842 admin admin] The token cache is being invalidate because project e478b4bf96c743688952cdf24dd4d0ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:37:14.081260 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-051071e3-1d4e-4a62-aa7c-f0cc24b84842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:14.081931 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-051071e3-1d4e-4a62-aa7c-f0cc24b84842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:14.083717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1111/2234] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:37:13 2022] DELETE /identity/v3/projects/e478b4bf96c743688952cdf24dd4d0ba => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:37:14.088611 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e4143-479a-42dc-9022-f9b1ab10f815 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:14.089124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e4143-479a-42dc-9022-f9b1ab10f815 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:14.089222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e4143-479a-42dc-9022-f9b1ab10f815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:14.109058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e93e4143-479a-42dc-9022-f9b1ab10f815 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:14.110346 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e93e4143-479a-42dc-9022-f9b1ab10f815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:14.141454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:14.176315 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1124/2235] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:14.184057 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2f04c-e098-4c4f-b5f6-92708c5308cc None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:14.184324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2f04c-e098-4c4f-b5f6-92708c5308cc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:14.185145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2f04c-e098-4c4f-b5f6-92708c5308cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:14.206406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d2c2f04c-e098-4c4f-b5f6-92708c5308cc None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:14.207736 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d2c2f04c-e098-4c4f-b5f6-92708c5308cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:14.216271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1112/2236] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:14.220605 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e4143-479a-42dc-9022-f9b1ab10f815 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:14.230750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e4143-479a-42dc-9022-f9b1ab10f815 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:14.235847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b1457-bc3d-43b7-a365-e2efc4603886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:14.236472 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b1457-bc3d-43b7-a365-e2efc4603886 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:14.236755 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b1457-bc3d-43b7-a365-e2efc4603886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:14.237031 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b1457-bc3d-43b7-a365-e2efc4603886 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:14.237775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b1457-bc3d-43b7-a365-e2efc4603886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:37:14.238080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b1457-bc3d-43b7-a365-e2efc4603886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:14.239949 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b1457-bc3d-43b7-a365-e2efc4603886 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:14.253210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1125/2237] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:37:14.257901 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2f04c-e098-4c4f-b5f6-92708c5308cc None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:14.268755 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2f04c-e098-4c4f-b5f6-92708c5308cc None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:14.274038 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447d52c-48eb-4ef5-aad8-634fb441926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:14.274732 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447d52c-48eb-4ef5-aad8-634fb441926a admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:14.275009 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447d52c-48eb-4ef5-aad8-634fb441926a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:14.275280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447d52c-48eb-4ef5-aad8-634fb441926a admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:14.276020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447d52c-48eb-4ef5-aad8-634fb441926a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:14.277964 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447d52c-48eb-4ef5-aad8-634fb441926a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:14.394450 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1113/2238] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:37:14 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:14.395796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b1457-bc3d-43b7-a365-e2efc4603886 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:14.406719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b1457-bc3d-43b7-a365-e2efc4603886 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:14.467098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cb359-432c-4264-8ea0-ee1c8929ad45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:14.467719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cb359-432c-4264-8ea0-ee1c8929ad45 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:14.468005 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cb359-432c-4264-8ea0-ee1c8929ad45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:14.468281 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cb359-432c-4264-8ea0-ee1c8929ad45 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:14.468952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271cb359-432c-4264-8ea0-ee1c8929ad45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:14.470972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271cb359-432c-4264-8ea0-ee1c8929ad45 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:14.587284 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1126/2239] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:37:14 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:37:14.588566 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447d52c-48eb-4ef5-aad8-634fb441926a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:14.599786 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447d52c-48eb-4ef5-aad8-634fb441926a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:14.609397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8ab8e-5d8d-4b4c-a04f-eb4b568d252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:14.610270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8ab8e-5d8d-4b4c-a04f-eb4b568d252c admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:14.610668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8ab8e-5d8d-4b4c-a04f-eb4b568d252c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:14.611046 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8ab8e-5d8d-4b4c-a04f-eb4b568d252c admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:14.611887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8ab8e-5d8d-4b4c-a04f-eb4b568d252c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:14.613809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8ab8e-5d8d-4b4c-a04f-eb4b568d252c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:14.627349 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1114/2240] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:14.631808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cb359-432c-4264-8ea0-ee1c8929ad45 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:14.642841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cb359-432c-4264-8ea0-ee1c8929ad45 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:14.648106 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0685bd8-a5a5-4714-a89c-604dc81c94ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:14.648731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0685bd8-a5a5-4714-a89c-604dc81c94ac admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:14.649011 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0685bd8-a5a5-4714-a89c-604dc81c94ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:14.649283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0685bd8-a5a5-4714-a89c-604dc81c94ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:14.650000 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0685bd8-a5a5-4714-a89c-604dc81c94ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:14.651584 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0685bd8-a5a5-4714-a89c-604dc81c94ac admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:14.664743 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1127/2241] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:14.669535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8ab8e-5d8d-4b4c-a04f-eb4b568d252c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:14.679909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8ab8e-5d8d-4b4c-a04f-eb4b568d252c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:14.685435 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7e816-4d23-47b4-9425-89b8e837c41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:14.686165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e816-4d23-47b4-9425-89b8e837c41a admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:14.686437 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e816-4d23-47b4-9425-89b8e837c41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:14.686721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e816-4d23-47b4-9425-89b8e837c41a admin admin] PATH_INFO: `/v3/projects/56ec8b71b1d84780b463aae66e8f8f03/users/0cc3441303dc41c1a076f6f879672f49/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:14.702790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7e816-4d23-47b4-9425-89b8e837c41a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ec8b71b1d84780b463aae66e8f8f03, user_id=0cc3441303dc41c1a076f6f879672f49, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:14.705456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7e816-4d23-47b4-9425-89b8e837c41a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:14.793306 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1115/2242] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:37:14 2022] PUT /identity/v3/projects/56ec8b71b1d84780b463aae66e8f8f03/users/0cc3441303dc41c1a076f6f879672f49/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:14.805789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f8754-2fe4-4ed7-8d3a-17ccd23ab3c3 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:14.806079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f8754-2fe4-4ed7-8d3a-17ccd23ab3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:14.806361 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f8754-2fe4-4ed7-8d3a-17ccd23ab3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:14.835760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-949f8754-2fe4-4ed7-8d3a-17ccd23ab3c3 None None] MFA Rules not processed for user `0cc3441303dc41c1a076f6f879672f49`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:14.836987 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-949f8754-2fe4-4ed7-8d3a-17ccd23ab3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:14.916575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1128/2243] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:14.921274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7e816-4d23-47b4-9425-89b8e837c41a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:14.989831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7e816-4d23-47b4-9425-89b8e837c41a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:14.994610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d46342-8f0f-4aba-b61b-d6ad7c0e95b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:14.995237 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d46342-8f0f-4aba-b61b-d6ad7c0e95b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:14.995522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d46342-8f0f-4aba-b61b-d6ad7c0e95b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:14.995797 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d46342-8f0f-4aba-b61b-d6ad7c0e95b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:14.996482 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d46342-8f0f-4aba-b61b-d6ad7c0e95b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:14.999163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d46342-8f0f-4aba-b61b-d6ad7c0e95b2 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:15.090247 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1116/2244] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:37:14 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:15.091664 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f8754-2fe4-4ed7-8d3a-17ccd23ab3c3 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:15.102653 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f8754-2fe4-4ed7-8d3a-17ccd23ab3c3 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:15.136074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:15.168197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d55ea-1d82-4b31-b544-5648a9c31b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:15.169415 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d55ea-1d82-4b31-b544-5648a9c31b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:15.176340 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d55ea-1d82-4b31-b544-5648a9c31b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:15.176340 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d55ea-1d82-4b31-b544-5648a9c31b68 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:15.176340 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d55ea-1d82-4b31-b544-5648a9c31b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:15.176340 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d55ea-1d82-4b31-b544-5648a9c31b68 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:15.276380 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1129/2245] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:37:15 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:15.277963 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d46342-8f0f-4aba-b61b-d6ad7c0e95b2 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:15.289715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d46342-8f0f-4aba-b61b-d6ad7c0e95b2 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:15.294450 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d76c5f-53c1-405f-bc54-dca9b062e71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:15.295632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d76c5f-53c1-405f-bc54-dca9b062e71e admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:15.295914 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d76c5f-53c1-405f-bc54-dca9b062e71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:15.296189 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d76c5f-53c1-405f-bc54-dca9b062e71e admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:15.296893 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d76c5f-53c1-405f-bc54-dca9b062e71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:15.298522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d76c5f-53c1-405f-bc54-dca9b062e71e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:15.309586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1117/2246] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:15.313918 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d55ea-1d82-4b31-b544-5648a9c31b68 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:15.324195 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d55ea-1d82-4b31-b544-5648a9c31b68 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:15.329673 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c9114-feae-41a0-b9c0-b696a426386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:15.330482 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c9114-feae-41a0-b9c0-b696a426386d admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:15.330762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c9114-feae-41a0-b9c0-b696a426386d admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:15.331044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c9114-feae-41a0-b9c0-b696a426386d admin admin] PATH_INFO: `/v3/projects/c3ad7b53805643b4b565f49bc8ee1cd7/users/50a5bf435c15456db4e447607f5916ce/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:15.346505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c9114-feae-41a0-b9c0-b696a426386d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ad7b53805643b4b565f49bc8ee1cd7, user_id=50a5bf435c15456db4e447607f5916ce, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:15.349211 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c9114-feae-41a0-b9c0-b696a426386d admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:15.412069 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1130/2247] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:37:15 2022] PUT /identity/v3/projects/c3ad7b53805643b4b565f49bc8ee1cd7/users/50a5bf435c15456db4e447607f5916ce/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:15.416269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d76c5f-53c1-405f-bc54-dca9b062e71e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:15.430468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d76c5f-53c1-405f-bc54-dca9b062e71e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:15.455920 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:15.488964 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3ad8d-2870-4869-bd66-2a9015b482e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:15.489697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3ad8d-2870-4869-bd66-2a9015b482e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:15.489990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3ad8d-2870-4869-bd66-2a9015b482e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:15.490294 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3ad8d-2870-4869-bd66-2a9015b482e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:15.491013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3ad8d-2870-4869-bd66-2a9015b482e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:15.493972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3ad8d-2870-4869-bd66-2a9015b482e3 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:15.509850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1118/2248] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:15.511140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c9114-feae-41a0-b9c0-b696a426386d admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:15.523612 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c9114-feae-41a0-b9c0-b696a426386d admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:15.529344 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b508e-ec08-4c30-ad39-d89970628a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:15.530154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b508e-ec08-4c30-ad39-d89970628a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:15.530500 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b508e-ec08-4c30-ad39-d89970628a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:15.531378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b508e-ec08-4c30-ad39-d89970628a50 admin admin] PATH_INFO: `/v3/projects/c3ad7b53805643b4b565f49bc8ee1cd7/users/50a5bf435c15456db4e447607f5916ce/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:15.532918 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b508e-ec08-4c30-ad39-d89970628a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ad7b53805643b4b565f49bc8ee1cd7, user_id=50a5bf435c15456db4e447607f5916ce, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:15.535611 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b508e-ec08-4c30-ad39-d89970628a50 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:15.546328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1131/2249] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:37:15 2022] PUT /identity/v3/projects/c3ad7b53805643b4b565f49bc8ee1cd7/users/50a5bf435c15456db4e447607f5916ce/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:15.556584 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9084f14-a1e7-4d62-bd22-f661ce54a8c9 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:15.556876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9084f14-a1e7-4d62-bd22-f661ce54a8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:15.557159 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9084f14-a1e7-4d62-bd22-f661ce54a8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:15.587186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d9084f14-a1e7-4d62-bd22-f661ce54a8c9 None None] MFA Rules not processed for user `50a5bf435c15456db4e447607f5916ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:15.588426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d9084f14-a1e7-4d62-bd22-f661ce54a8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:15.658529 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1119/2250] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:15.669804 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b508e-ec08-4c30-ad39-d89970628a50 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:15.671531 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-525b508e-ec08-4c30-ad39-d89970628a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:15.730067 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b508e-ec08-4c30-ad39-d89970628a50 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:15.733823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe6ff3-d5fa-4e63-8745-51e61f18c506 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:15.734557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe6ff3-d5fa-4e63-8745-51e61f18c506 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:15.734839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe6ff3-d5fa-4e63-8745-51e61f18c506 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:15.735166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe6ff3-d5fa-4e63-8745-51e61f18c506 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:15.793262 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe6ff3-d5fa-4e63-8745-51e61f18c506 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:15.794934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe6ff3-d5fa-4e63-8745-51e61f18c506 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:15.804378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1132/2251] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:37:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:37:22.430050 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9084f14-a1e7-4d62-bd22-f661ce54a8c9 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:22.431431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d9084f14-a1e7-4d62-bd22-f661ce54a8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:22.443326 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9084f14-a1e7-4d62-bd22-f661ce54a8c9 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:22.447065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cc875-c068-40a7-b6ba-f9141c9d2bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:22.447688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cc875-c068-40a7-b6ba-f9141c9d2bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:22.447970 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cc875-c068-40a7-b6ba-f9141c9d2bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:22.448249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cc875-c068-40a7-b6ba-f9141c9d2bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:22.457463 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cc875-c068-40a7-b6ba-f9141c9d2bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:22.458901 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cc875-c068-40a7-b6ba-f9141c9d2bc1 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:22.468919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1120/2252] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:37:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:37:23.944646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe6ff3-d5fa-4e63-8745-51e61f18c506 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:23.946913 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7cbe6ff3-d5fa-4e63-8745-51e61f18c506 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:23.989680 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:24.031861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe6ff3-d5fa-4e63-8745-51e61f18c506 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:24.037632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9ecce-4227-4fbf-afcc-4219ae40cee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:24.038268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ecce-4227-4fbf-afcc-4219ae40cee3 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:24.038554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ecce-4227-4fbf-afcc-4219ae40cee3 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:24.038874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ecce-4227-4fbf-afcc-4219ae40cee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:24.040617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-27b9ecce-4227-4fbf-afcc-4219ae40cee3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:24.054200 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9ecce-4227-4fbf-afcc-4219ae40cee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:24.056260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9ecce-4227-4fbf-afcc-4219ae40cee3 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:24.068077 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1133/2253] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:37:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:37:27.956235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd6573-fea3-428b-9328-ccd9e2d70279 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:27.956713 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd6573-fea3-428b-9328-ccd9e2d70279 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:27.956807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd6573-fea3-428b-9328-ccd9e2d70279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:27.976828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-12fd6573-fea3-428b-9328-ccd9e2d70279 None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:27.977677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-12fd6573-fea3-428b-9328-ccd9e2d70279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:28.032959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1121/2254] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jul 28 05:37:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:28.046175 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9ecce-4227-4fbf-afcc-4219ae40cee3 service nova] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:28.047567 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-27b9ecce-4227-4fbf-afcc-4219ae40cee3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:28.116247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9ecce-4227-4fbf-afcc-4219ae40cee3 service nova] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:28.121563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cd249-c56e-4af7-a171-09efc53aec1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:28.122197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cd249-c56e-4af7-a171-09efc53aec1d service swift] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:28.122505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cd249-c56e-4af7-a171-09efc53aec1d service swift] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:28.122821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cd249-c56e-4af7-a171-09efc53aec1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:28.132150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cd249-c56e-4af7-a171-09efc53aec1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:28.133758 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cd249-c56e-4af7-a171-09efc53aec1d service swift] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:28.142719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1134/2255] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:37:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:37:28.677266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd6573-fea3-428b-9328-ccd9e2d70279 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:28.678924 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-12fd6573-fea3-428b-9328-ccd9e2d70279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:28.738668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:28.753322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd6573-fea3-428b-9328-ccd9e2d70279 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:28.757785 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700c0a0-5c9b-4edd-865f-e00ebf323998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:28.758602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700c0a0-5c9b-4edd-865f-e00ebf323998 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:28.759081 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700c0a0-5c9b-4edd-865f-e00ebf323998 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:28.759521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700c0a0-5c9b-4edd-865f-e00ebf323998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:28.761631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0700c0a0-5c9b-4edd-865f-e00ebf323998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:28.915141 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700c0a0-5c9b-4edd-865f-e00ebf323998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:28.916826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700c0a0-5c9b-4edd-865f-e00ebf323998 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:28.942223 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1122/2256] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:37:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:37:38.139167 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=51 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:38.923814 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=32 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:50.028892 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9bb4f-5745-42f5-b757-14d63d1d6e76 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:50.029517 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9bb4f-5745-42f5-b757-14d63d1d6e76 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:50.029782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9bb4f-5745-42f5-b757-14d63d1d6e76 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:50.031429 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1135/2257] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jul 28 05:37:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:37:50.037662 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55162f74-364a-4983-831e-33737f73b7f0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:50.038134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55162f74-364a-4983-831e-33737f73b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:50.038228 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55162f74-364a-4983-831e-33737f73b7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:50.090349 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-55162f74-364a-4983-831e-33737f73b7f0 None None] MFA Rules not processed for user `99d8c709e6f4462c98c055cb03eebf42`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:50.091564 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-55162f74-364a-4983-831e-33737f73b7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:50.143729 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1123/2258] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jul 28 05:37:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:50.155738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9bb4f-5745-42f5-b757-14d63d1d6e76 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:50.157433 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d6d9bb4f-5745-42f5-b757-14d63d1d6e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:50.217602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9bb4f-5745-42f5-b757-14d63d1d6e76 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:50.221269 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6121e-a398-4417-93f7-bdc8012f05ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628ef75fa7194253bcf6cd6c85211738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:50.221940 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6121e-a398-4417-93f7-bdc8012f05ee service glance] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:50.222226 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6121e-a398-4417-93f7-bdc8012f05ee service glance] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:50.222505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6121e-a398-4417-93f7-bdc8012f05ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:50.232869 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6121e-a398-4417-93f7-bdc8012f05ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:50.234484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6121e-a398-4417-93f7-bdc8012f05ee service glance] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:50.245995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1136/2259] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:37:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:37:50.430385 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d64de-fcee-466e-809c-346ecdec81e6 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:50.430676 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d64de-fcee-466e-809c-346ecdec81e6 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:50.430959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d64de-fcee-466e-809c-346ecdec81e6 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:50.432307 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1124/2260] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jul 28 05:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:37:50.437512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7db010-1a44-402a-ac8e-56d46f7aba33 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:50.437809 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7db010-1a44-402a-ac8e-56d46f7aba33 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:50.438094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7db010-1a44-402a-ac8e-56d46f7aba33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:50.471093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-4d7db010-1a44-402a-ac8e-56d46f7aba33 None None] MFA Rules not processed for user `6907d8a429404b1c92805b364900ba60`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:50.472238 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4d7db010-1a44-402a-ac8e-56d46f7aba33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:50.489166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1137/2261] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jul 28 05:37:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:50.501218 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d64de-fcee-466e-809c-346ecdec81e6 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:50.502965 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1b0d64de-fcee-466e-809c-346ecdec81e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:50.516371 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d64de-fcee-466e-809c-346ecdec81e6 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:50.520238 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5e648-b32d-49c6-9478-bd0761a143ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:50.520840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5e648-b32d-49c6-9478-bd0761a143ee service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:50.521121 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5e648-b32d-49c6-9478-bd0761a143ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:50.521396 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5e648-b32d-49c6-9478-bd0761a143ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:50.528660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5e648-b32d-49c6-9478-bd0761a143ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:50.530797 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5e648-b32d-49c6-9478-bd0761a143ee service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:50.538707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1125/2262] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:37:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:37:50.627896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3223-44c8-4776-81df-c330825f08b3 None None] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:50.628322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3223-44c8-4776-81df-c330825f08b3 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:50.628615 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3223-44c8-4776-81df-c330825f08b3 None None] PATH_INFO: `/` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:50.630070 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1138/2263] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jul 28 05:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:37:50.635647 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1782f5-c8e7-4b69-9815-113cc8454897 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:50.635932 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1782f5-c8e7-4b69-9815-113cc8454897 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:50.636210 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1782f5-c8e7-4b69-9815-113cc8454897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:50.657744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9e1782f5-c8e7-4b69-9815-113cc8454897 None None] MFA Rules not processed for user `99d8c709e6f4462c98c055cb03eebf42`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:50.659023 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9e1782f5-c8e7-4b69-9815-113cc8454897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:50.668886 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1126/2264] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jul 28 05:37:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:37:50.679566 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a3223-44c8-4776-81df-c330825f08b3 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:50.690570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a3223-44c8-4776-81df-c330825f08b3 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:50.694192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc49435-c7f3-461f-b54c-2d0f6ea7de73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:50.694804 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc49435-c7f3-461f-b54c-2d0f6ea7de73 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:50.695088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc49435-c7f3-461f-b54c-2d0f6ea7de73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:50.695367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc49435-c7f3-461f-b54c-2d0f6ea7de73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:50.706544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc49435-c7f3-461f-b54c-2d0f6ea7de73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:50.707974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc49435-c7f3-461f-b54c-2d0f6ea7de73 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:50.719396 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1139/2265] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:37:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:37:51.416821 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1782f5-c8e7-4b69-9815-113cc8454897 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:51.499404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1782f5-c8e7-4b69-9815-113cc8454897 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:51.504184 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e073e-3339-4d36-ae84-c67cef4c253c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:51.504840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e073e-3339-4d36-ae84-c67cef4c253c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:51.505172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e073e-3339-4d36-ae84-c67cef4c253c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:51.505457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e073e-3339-4d36-ae84-c67cef4c253c admin admin] PATH_INFO: `/v3/users/0cc3441303dc41c1a076f6f879672f49` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:51.506653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e073e-3339-4d36-ae84-c67cef4c253c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc3441303dc41c1a076f6f879672f49)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:51.508633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e073e-3339-4d36-ae84-c67cef4c253c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:51.670761 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-eb4e073e-3339-4d36-ae84-c67cef4c253c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc3441303dc41c1a076f6f879672f49'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:51.671332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-eb4e073e-3339-4d36-ae84-c67cef4c253c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc3441303dc41c1a076f6f879672f49'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:51.674978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:51.729348 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-eb4e073e-3339-4d36-ae84-c67cef4c253c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc3441303dc41c1a076f6f879672f49'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:51.741783 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-eb4e073e-3339-4d36-ae84-c67cef4c253c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc3441303dc41c1a076f6f879672f49'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:51.742542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-eb4e073e-3339-4d36-ae84-c67cef4c253c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc3441303dc41c1a076f6f879672f49'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:51.757738 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1127/2266] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:37:51 2022] DELETE /identity/v3/users/0cc3441303dc41c1a076f6f879672f49 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:51.762382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da8383-7b1a-49be-bd56-ef33632978c8 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:51.762866 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da8383-7b1a-49be-bd56-ef33632978c8 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:51.762973 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da8383-7b1a-49be-bd56-ef33632978c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:51.804431 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-89da8383-7b1a-49be-bd56-ef33632978c8 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:51.805677 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-89da8383-7b1a-49be-bd56-ef33632978c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:51.865884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1140/2267] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:51.876306 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e073e-3339-4d36-ae84-c67cef4c253c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:51.877753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-eb4e073e-3339-4d36-ae84-c67cef4c253c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:51.934390 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e073e-3339-4d36-ae84-c67cef4c253c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:51.938661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337833c-a3d6-4a4d-a196-532a0fcee905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:51.939283 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337833c-a3d6-4a4d-a196-532a0fcee905 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:51.939571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337833c-a3d6-4a4d-a196-532a0fcee905 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:51.939849 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337833c-a3d6-4a4d-a196-532a0fcee905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:51.948932 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337833c-a3d6-4a4d-a196-532a0fcee905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:51.950416 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337833c-a3d6-4a4d-a196-532a0fcee905 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:51.960664 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1128/2268] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:37:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:37:52.427737 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da8383-7b1a-49be-bd56-ef33632978c8 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:52.429224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-89da8383-7b1a-49be-bd56-ef33632978c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:52.466285 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da8383-7b1a-49be-bd56-ef33632978c8 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:52.472152 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d2324-5329-4efe-8d22-837ce614b16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:52.472808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d2324-5329-4efe-8d22-837ce614b16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:52.473090 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d2324-5329-4efe-8d22-837ce614b16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:52.473365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d2324-5329-4efe-8d22-837ce614b16f admin admin] PATH_INFO: `/v3/projects/56ec8b71b1d84780b463aae66e8f8f03` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:52.474564 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d2324-5329-4efe-8d22-837ce614b16f admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ec8b71b1d84780b463aae66e8f8f03)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:52.476595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d2324-5329-4efe-8d22-837ce614b16f admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:52.576022 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:52.583633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-de6d2324-5329-4efe-8d22-837ce614b16f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ec8b71b1d84780b463aae66e8f8f03', 'request_id': 'req-de6d2324-5329-4efe-8d22-837ce614b16f'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:52.679709 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-de6d2324-5329-4efe-8d22-837ce614b16f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ec8b71b1d84780b463aae66e8f8f03', 'request_id': 'req-de6d2324-5329-4efe-8d22-837ce614b16f'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:52.685993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-de6d2324-5329-4efe-8d22-837ce614b16f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ec8b71b1d84780b463aae66e8f8f03', 'request_id': 'req-de6d2324-5329-4efe-8d22-837ce614b16f'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:52.697842 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-de6d2324-5329-4efe-8d22-837ce614b16f admin admin] The token cache is being invalidate because project 56ec8b71b1d84780b463aae66e8f8f03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:37:52.698134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-de6d2324-5329-4efe-8d22-837ce614b16f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:52.698841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-de6d2324-5329-4efe-8d22-837ce614b16f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:52.700793 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1141/2269] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:37:52 2022] DELETE /identity/v3/projects/56ec8b71b1d84780b463aae66e8f8f03 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:52.706472 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337833c-a3d6-4a4d-a196-532a0fcee905 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:52.719420 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337833c-a3d6-4a4d-a196-532a0fcee905 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:52.776148 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a211c-3470-438d-8a3e-c0855aaf2fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:52.776803 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a211c-3470-438d-8a3e-c0855aaf2fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:52.777082 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a211c-3470-438d-8a3e-c0855aaf2fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:52.777357 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a211c-3470-438d-8a3e-c0855aaf2fbd admin admin] PATH_INFO: `/v3/users/50a5bf435c15456db4e447607f5916ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:52.778558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a211c-3470-438d-8a3e-c0855aaf2fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a5bf435c15456db4e447607f5916ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:52.781087 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a211c-3470-438d-8a3e-c0855aaf2fbd admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:52.978039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2d8a211c-3470-438d-8a3e-c0855aaf2fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a5bf435c15456db4e447607f5916ce'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:52.978670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2d8a211c-3470-438d-8a3e-c0855aaf2fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a5bf435c15456db4e447607f5916ce'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:53.043194 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2d8a211c-3470-438d-8a3e-c0855aaf2fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a5bf435c15456db4e447607f5916ce'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:53.056571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2d8a211c-3470-438d-8a3e-c0855aaf2fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a5bf435c15456db4e447607f5916ce'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:53.057253 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2d8a211c-3470-438d-8a3e-c0855aaf2fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a5bf435c15456db4e447607f5916ce'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:53.059488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:53.071159 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1129/2270] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:37:52 2022] DELETE /identity/v3/users/50a5bf435c15456db4e447607f5916ce => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:53.131170 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af426be-038f-46d1-95d5-c875fe081ee6 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:53.131631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af426be-038f-46d1-95d5-c875fe081ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:53.131739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af426be-038f-46d1-95d5-c875fe081ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:53.153166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-6af426be-038f-46d1-95d5-c875fe081ee6 None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:53.154408 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6af426be-038f-46d1-95d5-c875fe081ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:53.210688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1142/2271] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jul 28 05:37:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:53.222560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a211c-3470-438d-8a3e-c0855aaf2fbd admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:53.225917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2d8a211c-3470-438d-8a3e-c0855aaf2fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:53.303045 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a211c-3470-438d-8a3e-c0855aaf2fbd admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:53.308920 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d25014-968d-4e21-927b-f8ffbb329b05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:53.309438 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d25014-968d-4e21-927b-f8ffbb329b05 service swift] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:53.309748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d25014-968d-4e21-927b-f8ffbb329b05 service swift] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:53.310069 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d25014-968d-4e21-927b-f8ffbb329b05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:53.319277 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d25014-968d-4e21-927b-f8ffbb329b05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:53.320865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d25014-968d-4e21-927b-f8ffbb329b05 service swift] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:53.330101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1130/2272] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:37:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:37:53.544966 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af426be-038f-46d1-95d5-c875fe081ee6 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:53.549638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6af426be-038f-46d1-95d5-c875fe081ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:53.712725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af426be-038f-46d1-95d5-c875fe081ee6 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:53.724282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44effff-6971-4065-a580-c4726ddfc7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:53.725215 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44effff-6971-4065-a580-c4726ddfc7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:53.726057 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44effff-6971-4065-a580-c4726ddfc7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:53.726488 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44effff-6971-4065-a580-c4726ddfc7a3 admin admin] PATH_INFO: `/v3/projects/c3ad7b53805643b4b565f49bc8ee1cd7` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:53.728692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44effff-6971-4065-a580-c4726ddfc7a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3ad7b53805643b4b565f49bc8ee1cd7)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:53.731306 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44effff-6971-4065-a580-c4726ddfc7a3 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:53.880544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-c44effff-6971-4065-a580-c4726ddfc7a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3ad7b53805643b4b565f49bc8ee1cd7', 'request_id': 'req-c44effff-6971-4065-a580-c4726ddfc7a3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:53.949025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-c44effff-6971-4065-a580-c4726ddfc7a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3ad7b53805643b4b565f49bc8ee1cd7', 'request_id': 'req-c44effff-6971-4065-a580-c4726ddfc7a3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:53.955703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-c44effff-6971-4065-a580-c4726ddfc7a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3ad7b53805643b4b565f49bc8ee1cd7', 'request_id': 'req-c44effff-6971-4065-a580-c4726ddfc7a3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:53.968136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-c44effff-6971-4065-a580-c4726ddfc7a3 admin admin] The token cache is being invalidate because project c3ad7b53805643b4b565f49bc8ee1cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:37:53.968429 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-c44effff-6971-4065-a580-c4726ddfc7a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:53.969096 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-c44effff-6971-4065-a580-c4726ddfc7a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:53.973504 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1143/2273] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:37:53 2022] DELETE /identity/v3/projects/c3ad7b53805643b4b565f49bc8ee1cd7 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:53.975736 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8373f7-e5c1-40b3-9eab-c8e75e918973 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:53.976329 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8373f7-e5c1-40b3-9eab-c8e75e918973 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:53.976329 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8373f7-e5c1-40b3-9eab-c8e75e918973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:54.020982 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9c8373f7-e5c1-40b3-9eab-c8e75e918973 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:54.022236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9c8373f7-e5c1-40b3-9eab-c8e75e918973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:54.087342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1131/2274] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:37:54.096732 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d137b9-71f3-4bfb-b83e-5e7b17354503 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:54.097139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d137b9-71f3-4bfb-b83e-5e7b17354503 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:54.097509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d137b9-71f3-4bfb-b83e-5e7b17354503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:54.107494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:54.125311 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-67d137b9-71f3-4bfb-b83e-5e7b17354503 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:54.126788 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-67d137b9-71f3-4bfb-b83e-5e7b17354503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:54.138361 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1144/2275] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:54.140787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8373f7-e5c1-40b3-9eab-c8e75e918973 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:54.151435 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8373f7-e5c1-40b3-9eab-c8e75e918973 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:54.157507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52829ba5-b92f-448d-b7bd-89d54610d783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:54.158380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52829ba5-b92f-448d-b7bd-89d54610d783 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:54.158924 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52829ba5-b92f-448d-b7bd-89d54610d783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:54.158924 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52829ba5-b92f-448d-b7bd-89d54610d783 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:54.160524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52829ba5-b92f-448d-b7bd-89d54610d783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:37:54.160524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52829ba5-b92f-448d-b7bd-89d54610d783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:54.161564 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52829ba5-b92f-448d-b7bd-89d54610d783 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:54.175070 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1132/2276] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:37:54.181237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d137b9-71f3-4bfb-b83e-5e7b17354503 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:54.192165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d137b9-71f3-4bfb-b83e-5e7b17354503 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:54.198098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c30c3-ac04-4a8f-a04e-22420de58e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:54.199235 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c30c3-ac04-4a8f-a04e-22420de58e42 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:54.199235 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c30c3-ac04-4a8f-a04e-22420de58e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:54.199419 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c30c3-ac04-4a8f-a04e-22420de58e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:54.199998 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c30c3-ac04-4a8f-a04e-22420de58e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:54.202458 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c30c3-ac04-4a8f-a04e-22420de58e42 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:54.305510 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1145/2277] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:37:54 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:54.309487 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52829ba5-b92f-448d-b7bd-89d54610d783 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:54.321034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52829ba5-b92f-448d-b7bd-89d54610d783 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:54.376833 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:54.385674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6339a-b103-481e-a8f0-050ab5bfcb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:54.389616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6339a-b103-481e-a8f0-050ab5bfcb08 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:54.389616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6339a-b103-481e-a8f0-050ab5bfcb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:54.389616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6339a-b103-481e-a8f0-050ab5bfcb08 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:54.389616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6339a-b103-481e-a8f0-050ab5bfcb08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:54.390229 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6339a-b103-481e-a8f0-050ab5bfcb08 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:54.461991 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1133/2278] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:37:54 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:37:54.466336 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c30c3-ac04-4a8f-a04e-22420de58e42 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:54.478045 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c30c3-ac04-4a8f-a04e-22420de58e42 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:54.483000 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07e2f1-7875-4e77-bb61-7353e0ee9c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:54.487927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07e2f1-7875-4e77-bb61-7353e0ee9c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:54.487927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07e2f1-7875-4e77-bb61-7353e0ee9c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:54.487927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07e2f1-7875-4e77-bb61-7353e0ee9c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:54.487927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07e2f1-7875-4e77-bb61-7353e0ee9c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:54.487927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07e2f1-7875-4e77-bb61-7353e0ee9c10 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:54.501653 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1146/2279] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:54.502716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6339a-b103-481e-a8f0-050ab5bfcb08 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:54.513258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6339a-b103-481e-a8f0-050ab5bfcb08 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:54.518865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a94974-0cdd-434a-b4a0-46dc63f5d1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:54.519751 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a94974-0cdd-434a-b4a0-46dc63f5d1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:54.520035 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a94974-0cdd-434a-b4a0-46dc63f5d1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:54.520308 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a94974-0cdd-434a-b4a0-46dc63f5d1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:54.521005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a94974-0cdd-434a-b4a0-46dc63f5d1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:54.522652 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a94974-0cdd-434a-b4a0-46dc63f5d1f4 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:54.534210 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1134/2280] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:37:54.538510 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07e2f1-7875-4e77-bb61-7353e0ee9c10 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:54.549489 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07e2f1-7875-4e77-bb61-7353e0ee9c10 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:54.554315 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22645c49-3a0d-4ea7-8099-9310be62051e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:54.554981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22645c49-3a0d-4ea7-8099-9310be62051e admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:54.555273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22645c49-3a0d-4ea7-8099-9310be62051e admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:54.555611 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22645c49-3a0d-4ea7-8099-9310be62051e admin admin] PATH_INFO: `/v3/projects/74ad6e5b45f540ba9ad46887b7a6fbf6/users/f7ebc478b4ff434d840ecfe64af50f56/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:54.572155 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22645c49-3a0d-4ea7-8099-9310be62051e admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ad6e5b45f540ba9ad46887b7a6fbf6, user_id=f7ebc478b4ff434d840ecfe64af50f56, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:54.574873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22645c49-3a0d-4ea7-8099-9310be62051e admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:54.650520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1147/2281] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:37:54 2022] PUT /identity/v3/projects/74ad6e5b45f540ba9ad46887b7a6fbf6/users/f7ebc478b4ff434d840ecfe64af50f56/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:54.661328 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af10ff9-cff8-4cc5-a509-2a0e1cb143f4 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:54.661779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af10ff9-cff8-4cc5-a509-2a0e1cb143f4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:54.662163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af10ff9-cff8-4cc5-a509-2a0e1cb143f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:54.693172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1af10ff9-cff8-4cc5-a509-2a0e1cb143f4 None None] MFA Rules not processed for user `f7ebc478b4ff434d840ecfe64af50f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:54.694487 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1af10ff9-cff8-4cc5-a509-2a0e1cb143f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:54.762613 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1135/2282] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:54.768158 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22645c49-3a0d-4ea7-8099-9310be62051e admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:54.849323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22645c49-3a0d-4ea7-8099-9310be62051e admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:54.854292 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f5e90-a46b-4ef2-9c83-a447538c7601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:54.854941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f5e90-a46b-4ef2-9c83-a447538c7601 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:54.856081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f5e90-a46b-4ef2-9c83-a447538c7601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:54.856081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f5e90-a46b-4ef2-9c83-a447538c7601 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:54.856333 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f5e90-a46b-4ef2-9c83-a447538c7601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:54.859224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f5e90-a46b-4ef2-9c83-a447538c7601 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:54.966358 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1148/2283] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:37:54 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:54.966900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af10ff9-cff8-4cc5-a509-2a0e1cb143f4 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:54.980106 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af10ff9-cff8-4cc5-a509-2a0e1cb143f4 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:55.041829 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51295a3d-dd9f-4f11-ada8-48d1fdb32146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:55.042596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51295a3d-dd9f-4f11-ada8-48d1fdb32146 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:55.042943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51295a3d-dd9f-4f11-ada8-48d1fdb32146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:55.043288 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51295a3d-dd9f-4f11-ada8-48d1fdb32146 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:55.044097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51295a3d-dd9f-4f11-ada8-48d1fdb32146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:55.046132 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51295a3d-dd9f-4f11-ada8-48d1fdb32146 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:55.145277 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1136/2284] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:37:54 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:55.149282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f5e90-a46b-4ef2-9c83-a447538c7601 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:55.160741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f5e90-a46b-4ef2-9c83-a447538c7601 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:55.165668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3e40f-c7a0-4d78-b681-dd3a4022dcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:55.166268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3e40f-c7a0-4d78-b681-dd3a4022dcbd admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:55.166556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3e40f-c7a0-4d78-b681-dd3a4022dcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:55.166837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3e40f-c7a0-4d78-b681-dd3a4022dcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:55.167540 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3e40f-c7a0-4d78-b681-dd3a4022dcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:55.169170 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3e40f-c7a0-4d78-b681-dd3a4022dcbd admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:55.181386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1149/2285] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:55.185710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51295a3d-dd9f-4f11-ada8-48d1fdb32146 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:55.196257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51295a3d-dd9f-4f11-ada8-48d1fdb32146 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:55.200866 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396726ef-1fa5-4d39-9e98-abe4e5d29f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:55.202163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396726ef-1fa5-4d39-9e98-abe4e5d29f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:55.202455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396726ef-1fa5-4d39-9e98-abe4e5d29f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:55.202736 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396726ef-1fa5-4d39-9e98-abe4e5d29f60 admin admin] PATH_INFO: `/v3/projects/fbf711c1e07d44cabce9b91bceed9992/users/b03d7872808c440c95903cad8e89ca75/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:55.218272 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396726ef-1fa5-4d39-9e98-abe4e5d29f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf711c1e07d44cabce9b91bceed9992, user_id=b03d7872808c440c95903cad8e89ca75, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:55.220964 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396726ef-1fa5-4d39-9e98-abe4e5d29f60 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:55.290234 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1137/2286] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:37:55 2022] PUT /identity/v3/projects/fbf711c1e07d44cabce9b91bceed9992/users/b03d7872808c440c95903cad8e89ca75/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:37:55.294286 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3e40f-c7a0-4d78-b681-dd3a4022dcbd admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:55.305165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3e40f-c7a0-4d78-b681-dd3a4022dcbd admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:55.372884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660902d6-a792-4a6b-9ed1-a83eac080dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:55.374454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660902d6-a792-4a6b-9ed1-a83eac080dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:55.374750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660902d6-a792-4a6b-9ed1-a83eac080dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:55.375032 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660902d6-a792-4a6b-9ed1-a83eac080dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:55.375733 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660902d6-a792-4a6b-9ed1-a83eac080dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:55.377524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660902d6-a792-4a6b-9ed1-a83eac080dc0 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:55.387893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1150/2287] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:55.393491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396726ef-1fa5-4d39-9e98-abe4e5d29f60 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:55.405220 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396726ef-1fa5-4d39-9e98-abe4e5d29f60 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:55.410531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67b61f-cf13-4208-93cc-82bb4d4ab089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:55.411219 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67b61f-cf13-4208-93cc-82bb4d4ab089 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:55.411501 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67b61f-cf13-4208-93cc-82bb4d4ab089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:55.411778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67b61f-cf13-4208-93cc-82bb4d4ab089 admin admin] PATH_INFO: `/v3/projects/fbf711c1e07d44cabce9b91bceed9992/users/b03d7872808c440c95903cad8e89ca75/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:55.413850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67b61f-cf13-4208-93cc-82bb4d4ab089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf711c1e07d44cabce9b91bceed9992, user_id=b03d7872808c440c95903cad8e89ca75, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:55.417009 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67b61f-cf13-4208-93cc-82bb4d4ab089 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:55.428695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1138/2288] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:37:55 2022] PUT /identity/v3/projects/fbf711c1e07d44cabce9b91bceed9992/users/b03d7872808c440c95903cad8e89ca75/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:37:55.439732 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25507e4c-2977-4186-a40c-3c1c6de4c554 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:55.440111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25507e4c-2977-4186-a40c-3c1c6de4c554 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:55.440504 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25507e4c-2977-4186-a40c-3c1c6de4c554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:55.447946 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:55.472202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-25507e4c-2977-4186-a40c-3c1c6de4c554 None None] MFA Rules not processed for user `b03d7872808c440c95903cad8e89ca75`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:55.473509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-25507e4c-2977-4186-a40c-3c1c6de4c554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:55.550362 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1151/2289] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:55.561958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67b61f-cf13-4208-93cc-82bb4d4ab089 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:55.563659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9e67b61f-cf13-4208-93cc-82bb4d4ab089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:55.583402 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:55.663583 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67b61f-cf13-4208-93cc-82bb4d4ab089 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:55.667614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5179d9-e08f-4a81-964d-e0daa7138190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:55.668238 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5179d9-e08f-4a81-964d-e0daa7138190 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:55.668520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5179d9-e08f-4a81-964d-e0daa7138190 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:55.668795 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5179d9-e08f-4a81-964d-e0daa7138190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:55.679218 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5179d9-e08f-4a81-964d-e0daa7138190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:55.680670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5179d9-e08f-4a81-964d-e0daa7138190 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:55.691972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1139/2290] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:37:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:37:55.762132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25507e4c-2977-4186-a40c-3c1c6de4c554 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:55.833017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25507e4c-2977-4186-a40c-3c1c6de4c554 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:55.837741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66896331-c9e8-49af-9123-15f20219c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:55.838472 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66896331-c9e8-49af-9123-15f20219c9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:55.838816 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66896331-c9e8-49af-9123-15f20219c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:55.839120 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66896331-c9e8-49af-9123-15f20219c9bb admin admin] PATH_INFO: `/v3/users/f7ebc478b4ff434d840ecfe64af50f56` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:55.840304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66896331-c9e8-49af-9123-15f20219c9bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ebc478b4ff434d840ecfe64af50f56)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:55.842867 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66896331-c9e8-49af-9123-15f20219c9bb admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:56.020792 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-66896331-c9e8-49af-9123-15f20219c9bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ebc478b4ff434d840ecfe64af50f56'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:56.021792 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-66896331-c9e8-49af-9123-15f20219c9bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ebc478b4ff434d840ecfe64af50f56'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:56.102948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-66896331-c9e8-49af-9123-15f20219c9bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ebc478b4ff434d840ecfe64af50f56'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:56.111981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-66896331-c9e8-49af-9123-15f20219c9bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ebc478b4ff434d840ecfe64af50f56'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:56.124955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-66896331-c9e8-49af-9123-15f20219c9bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ebc478b4ff434d840ecfe64af50f56'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:56.134809 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1152/2291] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:37:55 2022] DELETE /identity/v3/users/f7ebc478b4ff434d840ecfe64af50f56 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:56.139740 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51297d38-9d20-47fe-b943-8d2364798772 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:56.140186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51297d38-9d20-47fe-b943-8d2364798772 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:56.140363 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51297d38-9d20-47fe-b943-8d2364798772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:56.161319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-51297d38-9d20-47fe-b943-8d2364798772 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:56.162567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-51297d38-9d20-47fe-b943-8d2364798772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:56.225392 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1140/2292] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:56.235457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66896331-c9e8-49af-9123-15f20219c9bb admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:56.237203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-66896331-c9e8-49af-9123-15f20219c9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:56.247392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:56.312187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66896331-c9e8-49af-9123-15f20219c9bb admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:56.316919 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583ef0c-5f62-43cf-8e51-faf006ed3c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:56.317570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583ef0c-5f62-43cf-8e51-faf006ed3c84 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:56.317855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583ef0c-5f62-43cf-8e51-faf006ed3c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:56.318128 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583ef0c-5f62-43cf-8e51-faf006ed3c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:56.327835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583ef0c-5f62-43cf-8e51-faf006ed3c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:56.329266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583ef0c-5f62-43cf-8e51-faf006ed3c84 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:56.339167 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1153/2293] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:37:57.449547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51297d38-9d20-47fe-b943-8d2364798772 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:57.452907 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-51297d38-9d20-47fe-b943-8d2364798772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:57.488865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51297d38-9d20-47fe-b943-8d2364798772 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:57.493541 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:57.494190 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:57.494493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:57.494767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2 admin admin] PATH_INFO: `/v3/projects/74ad6e5b45f540ba9ad46887b7a6fbf6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:57.496175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ad6e5b45f540ba9ad46887b7a6fbf6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:57.498889 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:57.666815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ad6e5b45f540ba9ad46887b7a6fbf6', 'request_id': 'req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:57.726236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ad6e5b45f540ba9ad46887b7a6fbf6', 'request_id': 'req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:57.734746 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ad6e5b45f540ba9ad46887b7a6fbf6', 'request_id': 'req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:57.746519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2 admin admin] The token cache is being invalidate because project 74ad6e5b45f540ba9ad46887b7a6fbf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:37:57.746799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:57.747474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:57.750118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1141/2294] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:37:57 2022] DELETE /identity/v3/projects/74ad6e5b45f540ba9ad46887b7a6fbf6 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:57.754318 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583ef0c-5f62-43cf-8e51-faf006ed3c84 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:57.766612 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583ef0c-5f62-43cf-8e51-faf006ed3c84 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:57.834955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a0a64-9236-4f82-bb27-fe84ce573325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:57.835625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a0a64-9236-4f82-bb27-fe84ce573325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:57.836044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a0a64-9236-4f82-bb27-fe84ce573325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:57.836330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a0a64-9236-4f82-bb27-fe84ce573325 admin admin] PATH_INFO: `/v3/users/b03d7872808c440c95903cad8e89ca75` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:57.837555 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a0a64-9236-4f82-bb27-fe84ce573325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b03d7872808c440c95903cad8e89ca75)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:57.839496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a0a64-9236-4f82-bb27-fe84ce573325 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.030703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7c2a0a64-9236-4f82-bb27-fe84ce573325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b03d7872808c440c95903cad8e89ca75'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:58.031346 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7c2a0a64-9236-4f82-bb27-fe84ce573325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b03d7872808c440c95903cad8e89ca75'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:58.160118 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7c2a0a64-9236-4f82-bb27-fe84ce573325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b03d7872808c440c95903cad8e89ca75'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:58.168772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7c2a0a64-9236-4f82-bb27-fe84ce573325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b03d7872808c440c95903cad8e89ca75'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:58.182792 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7c2a0a64-9236-4f82-bb27-fe84ce573325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b03d7872808c440c95903cad8e89ca75'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:58.190144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1154/2295] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:37:57 2022] DELETE /identity/v3/users/b03d7872808c440c95903cad8e89ca75 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:37:58.706224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.709050 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:58.735782 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e40b6-b7b3-4f88-b00b-b2ffd634e9e2 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.757525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:58.808942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9a30e-9828-479c-94f5-1417b13e99ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.809664 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9a30e-9828-479c-94f5-1417b13e99ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.809984 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9a30e-9828-479c-94f5-1417b13e99ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.810266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9a30e-9828-479c-94f5-1417b13e99ca admin admin] PATH_INFO: `/v3/projects/fbf711c1e07d44cabce9b91bceed9992` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.811996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9a30e-9828-479c-94f5-1417b13e99ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf711c1e07d44cabce9b91bceed9992)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.814044 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9a30e-9828-479c-94f5-1417b13e99ca admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.924239 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-88c9a30e-9828-479c-94f5-1417b13e99ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf711c1e07d44cabce9b91bceed9992', 'request_id': 'req-88c9a30e-9828-479c-94f5-1417b13e99ca'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:59.297804 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-88c9a30e-9828-479c-94f5-1417b13e99ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf711c1e07d44cabce9b91bceed9992', 'request_id': 'req-88c9a30e-9828-479c-94f5-1417b13e99ca'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:59.305437 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-88c9a30e-9828-479c-94f5-1417b13e99ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf711c1e07d44cabce9b91bceed9992', 'request_id': 'req-88c9a30e-9828-479c-94f5-1417b13e99ca'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:59.318133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-88c9a30e-9828-479c-94f5-1417b13e99ca admin admin] The token cache is being invalidate because project fbf711c1e07d44cabce9b91bceed9992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:37:59.318574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-88c9a30e-9828-479c-94f5-1417b13e99ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:59.319448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-88c9a30e-9828-479c-94f5-1417b13e99ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:37:59.324868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1142/2296] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:37:58 2022] DELETE /identity/v3/projects/fbf711c1e07d44cabce9b91bceed9992 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:59.327055 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fedb82-09bb-4b9c-b872-16bc040067c4 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.327592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fedb82-09bb-4b9c-b872-16bc040067c4 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.327592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fedb82-09bb-4b9c-b872-16bc040067c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.353605 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-f2fedb82-09bb-4b9c-b872-16bc040067c4 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:59.354855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f2fedb82-09bb-4b9c-b872-16bc040067c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:59.407023 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:59.448553 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1155/2297] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:59.458610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f3c5a-3c94-4dc0-8682-c39c0024b6da None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.462348 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f3c5a-3c94-4dc0-8682-c39c0024b6da None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.462348 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f3c5a-3c94-4dc0-8682-c39c0024b6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.483449 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b89f3c5a-3c94-4dc0-8682-c39c0024b6da None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:59.484890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b89f3c5a-3c94-4dc0-8682-c39c0024b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:59.497643 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1143/2298] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:59.499606 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fedb82-09bb-4b9c-b872-16bc040067c4 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:59.510317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fedb82-09bb-4b9c-b872-16bc040067c4 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:59.519884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90338c8-556c-4f25-8dca-4b5c8115786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:59.519884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90338c8-556c-4f25-8dca-4b5c8115786e admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.519884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90338c8-556c-4f25-8dca-4b5c8115786e admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.519884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90338c8-556c-4f25-8dca-4b5c8115786e admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.520309 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90338c8-556c-4f25-8dca-4b5c8115786e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:37:59.520309 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90338c8-556c-4f25-8dca-4b5c8115786e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:59.520309 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90338c8-556c-4f25-8dca-4b5c8115786e admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:59.537056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1156/2299] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:37:59.538363 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f3c5a-3c94-4dc0-8682-c39c0024b6da None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:59.550320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f3c5a-3c94-4dc0-8682-c39c0024b6da None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:59.555127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9feb24-7c62-4e51-b00f-987f183746a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:59.561380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9feb24-7c62-4e51-b00f-987f183746a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.561380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9feb24-7c62-4e51-b00f-987f183746a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.561380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9feb24-7c62-4e51-b00f-987f183746a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.561380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9feb24-7c62-4e51-b00f-987f183746a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:59.561380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9feb24-7c62-4e51-b00f-987f183746a5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:59.782053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1144/2300] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:37:59 2022] POST /identity/v3/projects => generated 399 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:37:59.786296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90338c8-556c-4f25-8dca-4b5c8115786e admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:59.804688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90338c8-556c-4f25-8dca-4b5c8115786e admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:59.875169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d75693-59c9-4f9a-81e2-27abce353599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:59.875992 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d75693-59c9-4f9a-81e2-27abce353599 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.876276 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d75693-59c9-4f9a-81e2-27abce353599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.876556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d75693-59c9-4f9a-81e2-27abce353599 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.877234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d75693-59c9-4f9a-81e2-27abce353599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:59.879178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d75693-59c9-4f9a-81e2-27abce353599 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:59.973992 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1157/2301] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:37:59 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:37:59.975316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9feb24-7c62-4e51-b00f-987f183746a5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:59.987170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9feb24-7c62-4e51-b00f-987f183746a5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:59.991845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e32366-a2f3-4852-b7d4-a7a867639f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:59.996743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e32366-a2f3-4852-b7d4-a7a867639f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.996870 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e32366-a2f3-4852-b7d4-a7a867639f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.997147 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e32366-a2f3-4852-b7d4-a7a867639f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.997914 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e32366-a2f3-4852-b7d4-a7a867639f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:59.999633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e32366-a2f3-4852-b7d4-a7a867639f68 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.022404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1145/2302] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:00.026912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d75693-59c9-4f9a-81e2-27abce353599 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.039338 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d75693-59c9-4f9a-81e2-27abce353599 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.044779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28485606-d7fe-4fe3-9e02-b5d00764b8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.049617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28485606-d7fe-4fe3-9e02-b5d00764b8ed admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.049617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28485606-d7fe-4fe3-9e02-b5d00764b8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.049617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28485606-d7fe-4fe3-9e02-b5d00764b8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.049617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28485606-d7fe-4fe3-9e02-b5d00764b8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.049617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28485606-d7fe-4fe3-9e02-b5d00764b8ed admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.064936 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1158/2303] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:00.065697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e32366-a2f3-4852-b7d4-a7a867639f68 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.077148 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e32366-a2f3-4852-b7d4-a7a867639f68 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.082579 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b739fd-6fc4-4b65-8bf1-c668c41f5a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.083319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b739fd-6fc4-4b65-8bf1-c668c41f5a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.083551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b739fd-6fc4-4b65-8bf1-c668c41f5a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.083823 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b739fd-6fc4-4b65-8bf1-c668c41f5a9d admin admin] PATH_INFO: `/v3/projects/7d2d95275fcd41f282e7c60922c68f4c/users/c4a4c33e2f4646bbba385152a490fb03/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.101756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b739fd-6fc4-4b65-8bf1-c668c41f5a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2d95275fcd41f282e7c60922c68f4c, user_id=c4a4c33e2f4646bbba385152a490fb03, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.106033 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b739fd-6fc4-4b65-8bf1-c668c41f5a9d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.256148 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1146/2304] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:00 2022] PUT /identity/v3/projects/7d2d95275fcd41f282e7c60922c68f4c/users/c4a4c33e2f4646bbba385152a490fb03/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:00.267020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9e22b-0b5a-4ce3-abe3-4514941b8efc None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.267351 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9e22b-0b5a-4ce3-abe3-4514941b8efc None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.267734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9e22b-0b5a-4ce3-abe3-4514941b8efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.300499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-4fe9e22b-0b5a-4ce3-abe3-4514941b8efc None None] MFA Rules not processed for user `c4a4c33e2f4646bbba385152a490fb03`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:00.301815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4fe9e22b-0b5a-4ce3-abe3-4514941b8efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:00.375830 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1159/2305] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:00.380603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b739fd-6fc4-4b65-8bf1-c668c41f5a9d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.455933 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:00.484789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b739fd-6fc4-4b65-8bf1-c668c41f5a9d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.490747 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afc518-d005-4594-8a66-db7f23bb02b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.491887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc518-d005-4594-8a66-db7f23bb02b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.492398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc518-d005-4594-8a66-db7f23bb02b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.492884 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc518-d005-4594-8a66-db7f23bb02b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.493800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afc518-d005-4594-8a66-db7f23bb02b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.496332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afc518-d005-4594-8a66-db7f23bb02b5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.628564 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1147/2306] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:00 2022] POST /identity/v3/projects => generated 399 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:00.629735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9e22b-0b5a-4ce3-abe3-4514941b8efc None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.645328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9e22b-0b5a-4ce3-abe3-4514941b8efc None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.667700 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:00.706907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e78742-9804-426e-aec8-0d011f6db5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.707646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e78742-9804-426e-aec8-0d011f6db5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.708383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e78742-9804-426e-aec8-0d011f6db5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.709039 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e78742-9804-426e-aec8-0d011f6db5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.710009 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e78742-9804-426e-aec8-0d011f6db5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.712748 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e78742-9804-426e-aec8-0d011f6db5b8 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.832500 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1160/2307] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:00 2022] POST /identity/v3/users => generated 306 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:00.833732 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afc518-d005-4594-8a66-db7f23bb02b5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.844872 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afc518-d005-4594-8a66-db7f23bb02b5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.849511 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c2b0-e512-42d8-bd69-a88a492fd615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.850185 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c2b0-e512-42d8-bd69-a88a492fd615 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.850463 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c2b0-e512-42d8-bd69-a88a492fd615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.850741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c2b0-e512-42d8-bd69-a88a492fd615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.851444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235c2b0-e512-42d8-bd69-a88a492fd615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.853036 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235c2b0-e512-42d8-bd69-a88a492fd615 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.867760 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1148/2308] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:00.869299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e78742-9804-426e-aec8-0d011f6db5b8 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.881091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e78742-9804-426e-aec8-0d011f6db5b8 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.889064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984106d-12fc-4fec-8847-0b641a94022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.889064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984106d-12fc-4fec-8847-0b641a94022d admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.889064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984106d-12fc-4fec-8847-0b641a94022d admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.889064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984106d-12fc-4fec-8847-0b641a94022d admin admin] PATH_INFO: `/v3/projects/75767625d08744e9a00d3a641bcfd145/users/d44214be61b645058f17fb5bed981318/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.918137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984106d-12fc-4fec-8847-0b641a94022d admin admin] RBAC: Authorizing `identity:create_grant(project_id=75767625d08744e9a00d3a641bcfd145, user_id=d44214be61b645058f17fb5bed981318, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.923856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984106d-12fc-4fec-8847-0b641a94022d admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.000011 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1161/2309] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:00 2022] PUT /identity/v3/projects/75767625d08744e9a00d3a641bcfd145/users/d44214be61b645058f17fb5bed981318/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:01.004233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c2b0-e512-42d8-bd69-a88a492fd615 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:01.024023 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c2b0-e512-42d8-bd69-a88a492fd615 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:01.104450 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688030a-de5f-4997-a888-a27505db0b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.105211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688030a-de5f-4997-a888-a27505db0b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.105517 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688030a-de5f-4997-a888-a27505db0b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.105812 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688030a-de5f-4997-a888-a27505db0b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.106574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688030a-de5f-4997-a888-a27505db0b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.109016 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688030a-de5f-4997-a888-a27505db0b02 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.119664 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1149/2310] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:01.124883 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984106d-12fc-4fec-8847-0b641a94022d admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:01.139329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984106d-12fc-4fec-8847-0b641a94022d admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:01.142199 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040ed57-5ed3-44b9-98ae-202159264063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.142995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040ed57-5ed3-44b9-98ae-202159264063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.143383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040ed57-5ed3-44b9-98ae-202159264063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.143785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040ed57-5ed3-44b9-98ae-202159264063 admin admin] PATH_INFO: `/v3/projects/75767625d08744e9a00d3a641bcfd145/users/d44214be61b645058f17fb5bed981318/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.146150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040ed57-5ed3-44b9-98ae-202159264063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75767625d08744e9a00d3a641bcfd145, user_id=d44214be61b645058f17fb5bed981318, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.149368 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040ed57-5ed3-44b9-98ae-202159264063 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.161857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1162/2311] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:01 2022] PUT /identity/v3/projects/75767625d08744e9a00d3a641bcfd145/users/d44214be61b645058f17fb5bed981318/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:01.174171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c9be4-d1e7-494e-9429-9aea8ac02ea5 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.174460 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c9be4-d1e7-494e-9429-9aea8ac02ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.174736 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c9be4-d1e7-494e-9429-9aea8ac02ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.204657 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-158c9be4-d1e7-494e-9429-9aea8ac02ea5 None None] MFA Rules not processed for user `d44214be61b645058f17fb5bed981318`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:01.205919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-158c9be4-d1e7-494e-9429-9aea8ac02ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:01.305239 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1150/2312] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:01 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:01.319420 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040ed57-5ed3-44b9-98ae-202159264063 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:01.321371 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9040ed57-5ed3-44b9-98ae-202159264063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:01.390863 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040ed57-5ed3-44b9-98ae-202159264063 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:01.395519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fa2d2-05e2-4c60-a657-d1399902e3a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.396235 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fa2d2-05e2-4c60-a657-d1399902e3a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.396583 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fa2d2-05e2-4c60-a657-d1399902e3a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.396857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fa2d2-05e2-4c60-a657-d1399902e3a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.408514 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fa2d2-05e2-4c60-a657-d1399902e3a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.410037 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fa2d2-05e2-4c60-a657-d1399902e3a2 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.421233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1163/2313] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:01 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:01.685286 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c9be4-d1e7-494e-9429-9aea8ac02ea5 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:01.704275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c9be4-d1e7-494e-9429-9aea8ac02ea5 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:01.708086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d801ca-0b8e-4988-b71b-0d106dcdc745 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.711623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d801ca-0b8e-4988-b71b-0d106dcdc745 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.711623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d801ca-0b8e-4988-b71b-0d106dcdc745 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.711623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d801ca-0b8e-4988-b71b-0d106dcdc745 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.793854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:01.810995 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d801ca-0b8e-4988-b71b-0d106dcdc745 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.814711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d801ca-0b8e-4988-b71b-0d106dcdc745 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.825495 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1151/2314] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:07.123409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fa2d2-05e2-4c60-a657-d1399902e3a2 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:07.188715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fa2d2-05e2-4c60-a657-d1399902e3a2 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:07.193533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d7850-b0e3-4732-b8a2-edb8157b4272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:07.194178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d7850-b0e3-4732-b8a2-edb8157b4272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:07.194520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d7850-b0e3-4732-b8a2-edb8157b4272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:07.194737 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d7850-b0e3-4732-b8a2-edb8157b4272 admin admin] PATH_INFO: `/v3/users/c4a4c33e2f4646bbba385152a490fb03` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:07.195890 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d7850-b0e3-4732-b8a2-edb8157b4272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a4c33e2f4646bbba385152a490fb03)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:07.197856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d7850-b0e3-4732-b8a2-edb8157b4272 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:07.220697 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:07.420384 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-138d7850-b0e3-4732-b8a2-edb8157b4272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a4c33e2f4646bbba385152a490fb03'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:07.421254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-138d7850-b0e3-4732-b8a2-edb8157b4272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a4c33e2f4646bbba385152a490fb03'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:07.515373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-138d7850-b0e3-4732-b8a2-edb8157b4272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a4c33e2f4646bbba385152a490fb03'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:07.523762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-138d7850-b0e3-4732-b8a2-edb8157b4272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a4c33e2f4646bbba385152a490fb03'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:07.536060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-138d7850-b0e3-4732-b8a2-edb8157b4272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a4c33e2f4646bbba385152a490fb03'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:07.542309 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1164/2315] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:07 2022] DELETE /identity/v3/users/c4a4c33e2f4646bbba385152a490fb03 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:07.546674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d6f8a-69ab-4440-8b95-2662982ca2f4 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:07.547205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d6f8a-69ab-4440-8b95-2662982ca2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:07.547303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d6f8a-69ab-4440-8b95-2662982ca2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:07.568128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-303d6f8a-69ab-4440-8b95-2662982ca2f4 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:07.569357 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-303d6f8a-69ab-4440-8b95-2662982ca2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:07.643746 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1152/2316] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:07.654189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d7850-b0e3-4732-b8a2-edb8157b4272 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:07.655980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-138d7850-b0e3-4732-b8a2-edb8157b4272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:07.736327 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d7850-b0e3-4732-b8a2-edb8157b4272 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:07.740315 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158392d-a555-4d39-8397-7bade06052bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:07.740948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158392d-a555-4d39-8397-7bade06052bd service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:07.741232 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158392d-a555-4d39-8397-7bade06052bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:07.741553 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158392d-a555-4d39-8397-7bade06052bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:07.753356 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158392d-a555-4d39-8397-7bade06052bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:07.754805 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158392d-a555-4d39-8397-7bade06052bd service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:07.764416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1165/2317] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:08.222563 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d6f8a-69ab-4440-8b95-2662982ca2f4 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:08.224121 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-303d6f8a-69ab-4440-8b95-2662982ca2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:08.238488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d6f8a-69ab-4440-8b95-2662982ca2f4 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:08.244262 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0701d2-beba-49c0-92e1-9cd324407bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:08.244951 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0701d2-beba-49c0-92e1-9cd324407bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:08.245207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0701d2-beba-49c0-92e1-9cd324407bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:08.245501 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0701d2-beba-49c0-92e1-9cd324407bb7 admin admin] PATH_INFO: `/v3/projects/7d2d95275fcd41f282e7c60922c68f4c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:08.246654 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0701d2-beba-49c0-92e1-9cd324407bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2d95275fcd41f282e7c60922c68f4c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:08.248556 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0701d2-beba-49c0-92e1-9cd324407bb7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:08.379443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8d0701d2-beba-49c0-92e1-9cd324407bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2d95275fcd41f282e7c60922c68f4c', 'request_id': 'req-8d0701d2-beba-49c0-92e1-9cd324407bb7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:08.489339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8d0701d2-beba-49c0-92e1-9cd324407bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2d95275fcd41f282e7c60922c68f4c', 'request_id': 'req-8d0701d2-beba-49c0-92e1-9cd324407bb7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:08.496512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8d0701d2-beba-49c0-92e1-9cd324407bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2d95275fcd41f282e7c60922c68f4c', 'request_id': 'req-8d0701d2-beba-49c0-92e1-9cd324407bb7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:08.507839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8d0701d2-beba-49c0-92e1-9cd324407bb7 admin admin] The token cache is being invalidate because project 7d2d95275fcd41f282e7c60922c68f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:08.508132 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8d0701d2-beba-49c0-92e1-9cd324407bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:08.508788 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8d0701d2-beba-49c0-92e1-9cd324407bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:08.510451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1153/2318] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:08 2022] DELETE /identity/v3/projects/7d2d95275fcd41f282e7c60922c68f4c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:08.515084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158392d-a555-4d39-8397-7bade06052bd service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:08.528017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158392d-a555-4d39-8397-7bade06052bd service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:08.597801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ff0d0-0e7b-4685-b76a-95aab16bcb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:08.599220 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ff0d0-0e7b-4685-b76a-95aab16bcb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:08.599220 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ff0d0-0e7b-4685-b76a-95aab16bcb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:08.599453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ff0d0-0e7b-4685-b76a-95aab16bcb79 admin admin] PATH_INFO: `/v3/users/d44214be61b645058f17fb5bed981318` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:08.600844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ff0d0-0e7b-4685-b76a-95aab16bcb79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d44214be61b645058f17fb5bed981318)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:08.602858 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ff0d0-0e7b-4685-b76a-95aab16bcb79 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:08.767426 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:08.770383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9f0ff0d0-0e7b-4685-b76a-95aab16bcb79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd44214be61b645058f17fb5bed981318'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:08.771040 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9f0ff0d0-0e7b-4685-b76a-95aab16bcb79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd44214be61b645058f17fb5bed981318'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:08.874839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9f0ff0d0-0e7b-4685-b76a-95aab16bcb79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd44214be61b645058f17fb5bed981318'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:08.883133 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9f0ff0d0-0e7b-4685-b76a-95aab16bcb79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd44214be61b645058f17fb5bed981318'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:08.901764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9f0ff0d0-0e7b-4685-b76a-95aab16bcb79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd44214be61b645058f17fb5bed981318'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:08.908256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1166/2319] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:08 2022] DELETE /identity/v3/users/d44214be61b645058f17fb5bed981318 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:09.342177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0701d2-beba-49c0-92e1-9cd324407bb7 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:09.343724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8d0701d2-beba-49c0-92e1-9cd324407bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:09.357560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0701d2-beba-49c0-92e1-9cd324407bb7 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:09.415635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1b1f-8b38-4674-bb89-03a39de60b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:09.416276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1b1f-8b38-4674-bb89-03a39de60b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:09.416554 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1b1f-8b38-4674-bb89-03a39de60b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:09.416828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1b1f-8b38-4674-bb89-03a39de60b26 admin admin] PATH_INFO: `/v3/projects/75767625d08744e9a00d3a641bcfd145` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:09.417993 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad1b1f-8b38-4674-bb89-03a39de60b26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75767625d08744e9a00d3a641bcfd145)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:09.419896 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad1b1f-8b38-4674-bb89-03a39de60b26 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:09.426626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:09.555473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c9ad1b1f-8b38-4674-bb89-03a39de60b26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75767625d08744e9a00d3a641bcfd145', 'request_id': 'req-c9ad1b1f-8b38-4674-bb89-03a39de60b26'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:09.622608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c9ad1b1f-8b38-4674-bb89-03a39de60b26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75767625d08744e9a00d3a641bcfd145', 'request_id': 'req-c9ad1b1f-8b38-4674-bb89-03a39de60b26'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:09.629132 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c9ad1b1f-8b38-4674-bb89-03a39de60b26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75767625d08744e9a00d3a641bcfd145', 'request_id': 'req-c9ad1b1f-8b38-4674-bb89-03a39de60b26'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:09.640026 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c9ad1b1f-8b38-4674-bb89-03a39de60b26 admin admin] The token cache is being invalidate because project 75767625d08744e9a00d3a641bcfd145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:09.640314 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c9ad1b1f-8b38-4674-bb89-03a39de60b26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:09.640980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c9ad1b1f-8b38-4674-bb89-03a39de60b26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:09.642533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1154/2320] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:09 2022] DELETE /identity/v3/projects/75767625d08744e9a00d3a641bcfd145 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:09.647764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7caf91-0158-4af0-9134-ab0e865139a5 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:09.648217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7caf91-0158-4af0-9134-ab0e865139a5 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:09.648330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7caf91-0158-4af0-9134-ab0e865139a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:09.668244 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-ea7caf91-0158-4af0-9134-ab0e865139a5 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:09.669448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ea7caf91-0158-4af0-9134-ab0e865139a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:09.732124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1167/2321] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:09.739972 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ebd82-3b55-48e7-89e7-720235fc39a0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:09.740257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ebd82-3b55-48e7-89e7-720235fc39a0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:09.740567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ebd82-3b55-48e7-89e7-720235fc39a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:09.760267 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-600ebd82-3b55-48e7-89e7-720235fc39a0 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:09.761507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-600ebd82-3b55-48e7-89e7-720235fc39a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:09.771818 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1155/2322] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:09.774444 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7caf91-0158-4af0-9134-ab0e865139a5 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:09.784699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7caf91-0158-4af0-9134-ab0e865139a5 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:09.789268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02bed2-f0cc-4bb1-881c-f34c0f759270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:09.789924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02bed2-f0cc-4bb1-881c-f34c0f759270 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:09.790204 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02bed2-f0cc-4bb1-881c-f34c0f759270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:09.790477 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02bed2-f0cc-4bb1-881c-f34c0f759270 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:09.791171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02bed2-f0cc-4bb1-881c-f34c0f759270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:09.792264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02bed2-f0cc-4bb1-881c-f34c0f759270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:09.793186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02bed2-f0cc-4bb1-881c-f34c0f759270 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:09.805637 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1168/2323] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:38:09.810138 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ebd82-3b55-48e7-89e7-720235fc39a0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:09.819868 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ebd82-3b55-48e7-89e7-720235fc39a0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:09.825247 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699132f8-d177-4be6-b4cb-c3346f0fd423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:09.825909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699132f8-d177-4be6-b4cb-c3346f0fd423 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:09.826198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699132f8-d177-4be6-b4cb-c3346f0fd423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:09.826476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699132f8-d177-4be6-b4cb-c3346f0fd423 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:09.827716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699132f8-d177-4be6-b4cb-c3346f0fd423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:09.829831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699132f8-d177-4be6-b4cb-c3346f0fd423 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:09.944557 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1156/2324] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:09 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:09.948771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02bed2-f0cc-4bb1-881c-f34c0f759270 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:09.959775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02bed2-f0cc-4bb1-881c-f34c0f759270 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:10.018094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bad47-6440-46bd-b9ef-32f2e59574c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:10.018725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bad47-6440-46bd-b9ef-32f2e59574c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:10.019011 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bad47-6440-46bd-b9ef-32f2e59574c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:10.019541 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bad47-6440-46bd-b9ef-32f2e59574c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:10.020221 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bad47-6440-46bd-b9ef-32f2e59574c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:10.022261 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bad47-6440-46bd-b9ef-32f2e59574c0 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:10.177959 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1169/2325] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:09 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:10.182093 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699132f8-d177-4be6-b4cb-c3346f0fd423 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:10.192769 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699132f8-d177-4be6-b4cb-c3346f0fd423 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:10.197284 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d94566-bc44-45c3-8b4d-1dd31283e3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:10.199176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94566-bc44-45c3-8b4d-1dd31283e3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:10.199176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94566-bc44-45c3-8b4d-1dd31283e3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:10.199176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94566-bc44-45c3-8b4d-1dd31283e3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:10.199176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d94566-bc44-45c3-8b4d-1dd31283e3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:10.200710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d94566-bc44-45c3-8b4d-1dd31283e3f6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:10.211197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1157/2326] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:10.215284 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bad47-6440-46bd-b9ef-32f2e59574c0 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:10.226403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bad47-6440-46bd-b9ef-32f2e59574c0 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:10.231102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985a4e1-a3a0-404f-8971-722a1a4dff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:10.231857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985a4e1-a3a0-404f-8971-722a1a4dff4a admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:10.232145 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985a4e1-a3a0-404f-8971-722a1a4dff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:10.232432 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985a4e1-a3a0-404f-8971-722a1a4dff4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:10.233146 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985a4e1-a3a0-404f-8971-722a1a4dff4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:10.235018 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985a4e1-a3a0-404f-8971-722a1a4dff4a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:10.251125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1170/2327] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:10.251324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f59976-177c-4409-87ed-d4751a4ec22d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:10.251324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f59976-177c-4409-87ed-d4751a4ec22d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:10.251324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f59976-177c-4409-87ed-d4751a4ec22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:10.252177 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985a4e1-a3a0-404f-8971-722a1a4dff4a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:10.267360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985a4e1-a3a0-404f-8971-722a1a4dff4a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:10.269565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d1f59976-177c-4409-87ed-d4751a4ec22d None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:10.274423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d1f59976-177c-4409-87ed-d4751a4ec22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:10.274554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca4080-e113-45a0-9602-c3c73daf1d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:10.274554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca4080-e113-45a0-9602-c3c73daf1d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:10.274554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca4080-e113-45a0-9602-c3c73daf1d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:10.274554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca4080-e113-45a0-9602-c3c73daf1d30 admin admin] PATH_INFO: `/v3/projects/a455edcb25a3413987259877e8e5d01a/users/044654ca306d42958a39ef2f8c3ae549/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:10.289996 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca4080-e113-45a0-9602-c3c73daf1d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a455edcb25a3413987259877e8e5d01a, user_id=044654ca306d42958a39ef2f8c3ae549, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:10.292777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca4080-e113-45a0-9602-c3c73daf1d30 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:10.329739 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1158/2328] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jul 28 05:38:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:10.341855 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f59976-177c-4409-87ed-d4751a4ec22d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:10.343299 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d1f59976-177c-4409-87ed-d4751a4ec22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:10.349407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1171/2329] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:10 2022] PUT /identity/v3/projects/a455edcb25a3413987259877e8e5d01a/users/044654ca306d42958a39ef2f8c3ae549/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:10.360295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d7931-1981-4773-b26d-924b2c4b3b17 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:10.360295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d7931-1981-4773-b26d-924b2c4b3b17 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:10.360295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d7931-1981-4773-b26d-924b2c4b3b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:10.367368 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:10.389331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-4f0d7931-1981-4773-b26d-924b2c4b3b17 None None] MFA Rules not processed for user `044654ca306d42958a39ef2f8c3ae549`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:10.391370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4f0d7931-1981-4773-b26d-924b2c4b3b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:10.408560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:10.413999 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f59976-177c-4409-87ed-d4751a4ec22d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:10.459935 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1172/2330] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:10.464434 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d7931-1981-4773-b26d-924b2c4b3b17 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:10.477377 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d2b97-846c-419e-9568-fd2d21756cf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:10.478054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d2b97-846c-419e-9568-fd2d21756cf9 service swift] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:10.478342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d2b97-846c-419e-9568-fd2d21756cf9 service swift] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:10.478617 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d2b97-846c-419e-9568-fd2d21756cf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:10.525425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d7931-1981-4773-b26d-924b2c4b3b17 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:10.534016 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a54fe-e486-4e29-a720-31c971c5b10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:10.534659 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a54fe-e486-4e29-a720-31c971c5b10f admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:10.534966 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a54fe-e486-4e29-a720-31c971c5b10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:10.535226 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a54fe-e486-4e29-a720-31c971c5b10f admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:10.535936 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a54fe-e486-4e29-a720-31c971c5b10f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:10.538951 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d2b97-846c-419e-9568-fd2d21756cf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:10.539178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a54fe-e486-4e29-a720-31c971c5b10f admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:10.540591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d2b97-846c-419e-9568-fd2d21756cf9 service swift] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:10.550688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1159/2331] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:38:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 05:38:10.677293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1173/2332] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:10 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:10.681459 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d2b97-846c-419e-9568-fd2d21756cf9 service swift] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:10.693676 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d2b97-846c-419e-9568-fd2d21756cf9 service swift] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:10.752674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5917d1d-f852-45c7-866d-ed31be0d1133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:10.753391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917d1d-f852-45c7-866d-ed31be0d1133 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:10.753734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917d1d-f852-45c7-866d-ed31be0d1133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:10.754021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917d1d-f852-45c7-866d-ed31be0d1133 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:10.754781 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5917d1d-f852-45c7-866d-ed31be0d1133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:10.756766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5917d1d-f852-45c7-866d-ed31be0d1133 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:10.861813 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1160/2333] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:10 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:10.865845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a54fe-e486-4e29-a720-31c971c5b10f admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:10.876883 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a54fe-e486-4e29-a720-31c971c5b10f admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:10.884739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d33b0-a4ab-4044-8b42-dfeb83f9e9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:10.884739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d33b0-a4ab-4044-8b42-dfeb83f9e9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:10.884739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d33b0-a4ab-4044-8b42-dfeb83f9e9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:10.884739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d33b0-a4ab-4044-8b42-dfeb83f9e9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:10.886454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d33b0-a4ab-4044-8b42-dfeb83f9e9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:10.886454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d33b0-a4ab-4044-8b42-dfeb83f9e9b7 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:10.896348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1174/2334] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:10.902509 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5917d1d-f852-45c7-866d-ed31be0d1133 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:10.913753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5917d1d-f852-45c7-866d-ed31be0d1133 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:10.918360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06498604-4c23-4ff5-a646-570ac2be1f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:10.919116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06498604-4c23-4ff5-a646-570ac2be1f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:10.919403 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06498604-4c23-4ff5-a646-570ac2be1f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:10.919680 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06498604-4c23-4ff5-a646-570ac2be1f1e admin admin] PATH_INFO: `/v3/projects/4eef2a23e6b8400a93b5859898363378/users/71ae3c5c9aec4c238d74259b7ce5f5dc/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:10.935704 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06498604-4c23-4ff5-a646-570ac2be1f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eef2a23e6b8400a93b5859898363378, user_id=71ae3c5c9aec4c238d74259b7ce5f5dc, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:10.939025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06498604-4c23-4ff5-a646-570ac2be1f1e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:10.985802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1161/2335] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:10 2022] PUT /identity/v3/projects/4eef2a23e6b8400a93b5859898363378/users/71ae3c5c9aec4c238d74259b7ce5f5dc/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:10.989801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d33b0-a4ab-4044-8b42-dfeb83f9e9b7 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:11.000527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d33b0-a4ab-4044-8b42-dfeb83f9e9b7 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:11.065979 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd2477-5797-44a6-9930-4af816f3d465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:11.066626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd2477-5797-44a6-9930-4af816f3d465 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:11.066911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd2477-5797-44a6-9930-4af816f3d465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:11.067189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd2477-5797-44a6-9930-4af816f3d465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:11.070087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd2477-5797-44a6-9930-4af816f3d465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:11.071726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd2477-5797-44a6-9930-4af816f3d465 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:11.082453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1175/2336] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:11.086617 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06498604-4c23-4ff5-a646-570ac2be1f1e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:11.097697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06498604-4c23-4ff5-a646-570ac2be1f1e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:11.102460 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929b836-af31-4bd2-9051-5316f0d8e1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:11.103125 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929b836-af31-4bd2-9051-5316f0d8e1d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:11.103410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929b836-af31-4bd2-9051-5316f0d8e1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:11.103688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929b836-af31-4bd2-9051-5316f0d8e1d9 admin admin] PATH_INFO: `/v3/projects/4eef2a23e6b8400a93b5859898363378/users/71ae3c5c9aec4c238d74259b7ce5f5dc/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:11.105714 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929b836-af31-4bd2-9051-5316f0d8e1d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eef2a23e6b8400a93b5859898363378, user_id=71ae3c5c9aec4c238d74259b7ce5f5dc, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:11.109029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929b836-af31-4bd2-9051-5316f0d8e1d9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:11.112179 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:11.120243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1162/2337] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:11 2022] PUT /identity/v3/projects/4eef2a23e6b8400a93b5859898363378/users/71ae3c5c9aec4c238d74259b7ce5f5dc/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:11.131759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e8d5e-98b5-468e-b76a-a209c8f91186 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:11.132091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e8d5e-98b5-468e-b76a-a209c8f91186 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:11.132375 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e8d5e-98b5-468e-b76a-a209c8f91186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:11.140312 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:11.163991 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-2b2e8d5e-98b5-468e-b76a-a209c8f91186 None None] MFA Rules not processed for user `71ae3c5c9aec4c238d74259b7ce5f5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:11.165281 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2b2e8d5e-98b5-468e-b76a-a209c8f91186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:11.238201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1176/2338] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:11.253409 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929b836-af31-4bd2-9051-5316f0d8e1d9 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:11.255142 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b929b836-af31-4bd2-9051-5316f0d8e1d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:11.322999 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929b836-af31-4bd2-9051-5316f0d8e1d9 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:11.328145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f728c-d47d-4ad9-b778-8dadbc36b352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:11.328782 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f728c-d47d-4ad9-b778-8dadbc36b352 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:11.329054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f728c-d47d-4ad9-b778-8dadbc36b352 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:11.329333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f728c-d47d-4ad9-b778-8dadbc36b352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:11.390515 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f728c-d47d-4ad9-b778-8dadbc36b352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:11.391945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f728c-d47d-4ad9-b778-8dadbc36b352 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:11.401286 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1163/2339] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:16.633050 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e8d5e-98b5-468e-b76a-a209c8f91186 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:16.634566 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2b2e8d5e-98b5-468e-b76a-a209c8f91186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:16.647212 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e8d5e-98b5-468e-b76a-a209c8f91186 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:16.650798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91045de3-2600-4f40-8709-c9ad70f5817f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:16.651413 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91045de3-2600-4f40-8709-c9ad70f5817f service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:16.651710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91045de3-2600-4f40-8709-c9ad70f5817f service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:16.652007 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91045de3-2600-4f40-8709-c9ad70f5817f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:16.660989 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91045de3-2600-4f40-8709-c9ad70f5817f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:16.662445 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91045de3-2600-4f40-8709-c9ad70f5817f service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:16.672763 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1177/2340] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:21.397147 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=50 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:22.473068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f728c-d47d-4ad9-b778-8dadbc36b352 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:22.536997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f728c-d47d-4ad9-b778-8dadbc36b352 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:22.541710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2757cd-7958-4598-a130-8b3d0023c08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:22.549542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2757cd-7958-4598-a130-8b3d0023c08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:22.549542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2757cd-7958-4598-a130-8b3d0023c08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:22.549542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2757cd-7958-4598-a130-8b3d0023c08c admin admin] PATH_INFO: `/v3/users/044654ca306d42958a39ef2f8c3ae549` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:22.549542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2757cd-7958-4598-a130-8b3d0023c08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=044654ca306d42958a39ef2f8c3ae549)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:22.549542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2757cd-7958-4598-a130-8b3d0023c08c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:22.755040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cd2757cd-7958-4598-a130-8b3d0023c08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '044654ca306d42958a39ef2f8c3ae549'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:22.755626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cd2757cd-7958-4598-a130-8b3d0023c08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '044654ca306d42958a39ef2f8c3ae549'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:22.843538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cd2757cd-7958-4598-a130-8b3d0023c08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '044654ca306d42958a39ef2f8c3ae549'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:22.856771 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cd2757cd-7958-4598-a130-8b3d0023c08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '044654ca306d42958a39ef2f8c3ae549'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:22.857444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cd2757cd-7958-4598-a130-8b3d0023c08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '044654ca306d42958a39ef2f8c3ae549'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:22.869560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1164/2341] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:22 2022] DELETE /identity/v3/users/044654ca306d42958a39ef2f8c3ae549 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:22.874128 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f66b7-f136-4fde-a0ca-966e9d674f4d None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:22.874562 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f66b7-f136-4fde-a0ca-966e9d674f4d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:22.874682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f66b7-f136-4fde-a0ca-966e9d674f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:22.895718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-f46f66b7-f136-4fde-a0ca-966e9d674f4d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:22.896974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f46f66b7-f136-4fde-a0ca-966e9d674f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:22.955017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1178/2342] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:22.965398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2757cd-7958-4598-a130-8b3d0023c08c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:22.966878 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cd2757cd-7958-4598-a130-8b3d0023c08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:23.024197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2757cd-7958-4598-a130-8b3d0023c08c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:23.027850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95379aa-26f9-46a1-b6cf-980154dc5324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:23.028527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95379aa-26f9-46a1-b6cf-980154dc5324 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:23.028792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95379aa-26f9-46a1-b6cf-980154dc5324 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:23.029068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95379aa-26f9-46a1-b6cf-980154dc5324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:23.038582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95379aa-26f9-46a1-b6cf-980154dc5324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:23.042463 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95379aa-26f9-46a1-b6cf-980154dc5324 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:23.051945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1165/2343] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:23.487769 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f66b7-f136-4fde-a0ca-966e9d674f4d None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:23.491663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f46f66b7-f136-4fde-a0ca-966e9d674f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:23.501241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f66b7-f136-4fde-a0ca-966e9d674f4d None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:23.507025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0192d-73ca-4250-8d56-4a1c23f5043c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:23.507705 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0192d-73ca-4250-8d56-4a1c23f5043c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:23.507990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0192d-73ca-4250-8d56-4a1c23f5043c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:23.508274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0192d-73ca-4250-8d56-4a1c23f5043c admin admin] PATH_INFO: `/v3/projects/a455edcb25a3413987259877e8e5d01a` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:23.509609 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0192d-73ca-4250-8d56-4a1c23f5043c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a455edcb25a3413987259877e8e5d01a)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:23.511541 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0192d-73ca-4250-8d56-4a1c23f5043c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:23.643525 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ddf0192d-73ca-4250-8d56-4a1c23f5043c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a455edcb25a3413987259877e8e5d01a', 'request_id': 'req-ddf0192d-73ca-4250-8d56-4a1c23f5043c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:23.748758 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ddf0192d-73ca-4250-8d56-4a1c23f5043c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a455edcb25a3413987259877e8e5d01a', 'request_id': 'req-ddf0192d-73ca-4250-8d56-4a1c23f5043c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:23.755348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ddf0192d-73ca-4250-8d56-4a1c23f5043c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a455edcb25a3413987259877e8e5d01a', 'request_id': 'req-ddf0192d-73ca-4250-8d56-4a1c23f5043c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:23.762860 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:23.767449 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ddf0192d-73ca-4250-8d56-4a1c23f5043c admin admin] The token cache is being invalidate because project a455edcb25a3413987259877e8e5d01a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:23.768056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ddf0192d-73ca-4250-8d56-4a1c23f5043c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:23.768737 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ddf0192d-73ca-4250-8d56-4a1c23f5043c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:23.770772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1179/2344] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:23 2022] DELETE /identity/v3/projects/a455edcb25a3413987259877e8e5d01a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:23.774715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95379aa-26f9-46a1-b6cf-980154dc5324 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:23.785340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95379aa-26f9-46a1-b6cf-980154dc5324 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:23.804507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:23.841487 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c9950-6a63-464f-b315-82f2ada9e247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:23.842141 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c9950-6a63-464f-b315-82f2ada9e247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:23.842417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c9950-6a63-464f-b315-82f2ada9e247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:23.842689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c9950-6a63-464f-b315-82f2ada9e247 admin admin] PATH_INFO: `/v3/users/71ae3c5c9aec4c238d74259b7ce5f5dc` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:23.843837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c9950-6a63-464f-b315-82f2ada9e247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ae3c5c9aec4c238d74259b7ce5f5dc)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:23.845829 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c9950-6a63-464f-b315-82f2ada9e247 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:24.065829 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ed0c9950-6a63-464f-b315-82f2ada9e247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ae3c5c9aec4c238d74259b7ce5f5dc'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.066577 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ed0c9950-6a63-464f-b315-82f2ada9e247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ae3c5c9aec4c238d74259b7ce5f5dc'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.169171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ed0c9950-6a63-464f-b315-82f2ada9e247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ae3c5c9aec4c238d74259b7ce5f5dc'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.182231 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ed0c9950-6a63-464f-b315-82f2ada9e247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ae3c5c9aec4c238d74259b7ce5f5dc'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.182866 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ed0c9950-6a63-464f-b315-82f2ada9e247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ae3c5c9aec4c238d74259b7ce5f5dc'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.195620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1166/2345] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:23 2022] DELETE /identity/v3/users/71ae3c5c9aec4c238d74259b7ce5f5dc => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:24.619451 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0192d-73ca-4250-8d56-4a1c23f5043c admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:24.620988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ddf0192d-73ca-4250-8d56-4a1c23f5043c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:24.635740 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0192d-73ca-4250-8d56-4a1c23f5043c admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:24.698765 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb3941-7a7e-4b52-a738-a0a6c037aefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:24.699381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb3941-7a7e-4b52-a738-a0a6c037aefe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:24.699661 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb3941-7a7e-4b52-a738-a0a6c037aefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:24.699938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb3941-7a7e-4b52-a738-a0a6c037aefe admin admin] PATH_INFO: `/v3/projects/4eef2a23e6b8400a93b5859898363378` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:24.701100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb3941-7a7e-4b52-a738-a0a6c037aefe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eef2a23e6b8400a93b5859898363378)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:24.703084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb3941-7a7e-4b52-a738-a0a6c037aefe admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:24.804509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-51bb3941-7a7e-4b52-a738-a0a6c037aefe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eef2a23e6b8400a93b5859898363378', 'request_id': 'req-51bb3941-7a7e-4b52-a738-a0a6c037aefe'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.879864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-51bb3941-7a7e-4b52-a738-a0a6c037aefe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eef2a23e6b8400a93b5859898363378', 'request_id': 'req-51bb3941-7a7e-4b52-a738-a0a6c037aefe'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.885909 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-51bb3941-7a7e-4b52-a738-a0a6c037aefe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eef2a23e6b8400a93b5859898363378', 'request_id': 'req-51bb3941-7a7e-4b52-a738-a0a6c037aefe'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.899828 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-51bb3941-7a7e-4b52-a738-a0a6c037aefe admin admin] The token cache is being invalidate because project 4eef2a23e6b8400a93b5859898363378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:24.900085 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-51bb3941-7a7e-4b52-a738-a0a6c037aefe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.900747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-51bb3941-7a7e-4b52-a738-a0a6c037aefe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.902395 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1180/2346] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:24 2022] DELETE /identity/v3/projects/4eef2a23e6b8400a93b5859898363378 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:24.908267 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668061d-5ec4-46ce-af5b-26acf91a6502 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:24.909087 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668061d-5ec4-46ce-af5b-26acf91a6502 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:24.909087 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668061d-5ec4-46ce-af5b-26acf91a6502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:24.929333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a668061d-5ec4-46ce-af5b-26acf91a6502 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:24.930726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a668061d-5ec4-46ce-af5b-26acf91a6502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:25.034193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1167/2347] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:25.042415 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d2c01-81df-492b-a7c5-a84041b4b5e1 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:25.042709 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d2c01-81df-492b-a7c5-a84041b4b5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:25.049726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d2c01-81df-492b-a7c5-a84041b4b5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:25.074295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-305d2c01-81df-492b-a7c5-a84041b4b5e1 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:25.075697 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-305d2c01-81df-492b-a7c5-a84041b4b5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:25.084801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1181/2348] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:25.089756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668061d-5ec4-46ce-af5b-26acf91a6502 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:25.103539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668061d-5ec4-46ce-af5b-26acf91a6502 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:25.108678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96519b-8345-4049-b527-da273dd359fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:25.109323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96519b-8345-4049-b527-da273dd359fc admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:25.109640 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96519b-8345-4049-b527-da273dd359fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:25.109920 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96519b-8345-4049-b527-da273dd359fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:25.110637 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96519b-8345-4049-b527-da273dd359fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:25.110947 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96519b-8345-4049-b527-da273dd359fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:25.113674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96519b-8345-4049-b527-da273dd359fc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:25.129516 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1168/2349] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:38:25.132440 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d2c01-81df-492b-a7c5-a84041b4b5e1 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:25.143801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d2c01-81df-492b-a7c5-a84041b4b5e1 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:25.149064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329273c-c175-42d6-b763-f42933f45735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:25.149806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329273c-c175-42d6-b763-f42933f45735 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:25.150091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329273c-c175-42d6-b763-f42933f45735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:25.150365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329273c-c175-42d6-b763-f42933f45735 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:25.151044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329273c-c175-42d6-b763-f42933f45735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:25.153005 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329273c-c175-42d6-b763-f42933f45735 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:25.264725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1182/2350] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:25 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:25.270500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96519b-8345-4049-b527-da273dd359fc admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:25.280639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96519b-8345-4049-b527-da273dd359fc admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:25.308826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:25.340766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43686035-d3a8-4958-a06d-408d27d62610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:25.341496 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43686035-d3a8-4958-a06d-408d27d62610 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:25.341790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43686035-d3a8-4958-a06d-408d27d62610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:25.342070 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43686035-d3a8-4958-a06d-408d27d62610 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:25.342740 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43686035-d3a8-4958-a06d-408d27d62610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:25.344641 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43686035-d3a8-4958-a06d-408d27d62610 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:25.469515 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1169/2351] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:25 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:25.470855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329273c-c175-42d6-b763-f42933f45735 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:25.481591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329273c-c175-42d6-b763-f42933f45735 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:25.486274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f98458-6708-4276-be4e-e94b022f270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:25.487406 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f98458-6708-4276-be4e-e94b022f270a admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:25.488747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f98458-6708-4276-be4e-e94b022f270a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:25.489029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f98458-6708-4276-be4e-e94b022f270a admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:25.489767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f98458-6708-4276-be4e-e94b022f270a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:25.492270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f98458-6708-4276-be4e-e94b022f270a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:25.503229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1183/2352] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:25.507500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43686035-d3a8-4958-a06d-408d27d62610 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:25.518105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43686035-d3a8-4958-a06d-408d27d62610 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:25.523101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9752ef-ea9e-422b-9666-bb2fb5ab2638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:25.523716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9752ef-ea9e-422b-9666-bb2fb5ab2638 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:25.523998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9752ef-ea9e-422b-9666-bb2fb5ab2638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:25.524273 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9752ef-ea9e-422b-9666-bb2fb5ab2638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:25.524962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9752ef-ea9e-422b-9666-bb2fb5ab2638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:25.526638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9752ef-ea9e-422b-9666-bb2fb5ab2638 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:25.537397 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1170/2353] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:25.541614 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f98458-6708-4276-be4e-e94b022f270a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:25.553067 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f98458-6708-4276-be4e-e94b022f270a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:25.557888 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad04f1c-5b4e-46a7-937f-0fde3028e904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:25.558649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad04f1c-5b4e-46a7-937f-0fde3028e904 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:25.559807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad04f1c-5b4e-46a7-937f-0fde3028e904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:25.559807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad04f1c-5b4e-46a7-937f-0fde3028e904 admin admin] PATH_INFO: `/v3/projects/aa664194352a4b74bce2cdd2ed7a8375/users/7dd3a82ef479487aabf9708c8539e01f/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:25.574352 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad04f1c-5b4e-46a7-937f-0fde3028e904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa664194352a4b74bce2cdd2ed7a8375, user_id=7dd3a82ef479487aabf9708c8539e01f, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:25.577046 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad04f1c-5b4e-46a7-937f-0fde3028e904 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:25.676896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1184/2354] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:25 2022] PUT /identity/v3/projects/aa664194352a4b74bce2cdd2ed7a8375/users/7dd3a82ef479487aabf9708c8539e01f/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:25.689501 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44587f-a8be-409f-b2a9-b171e6424981 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:25.690612 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44587f-a8be-409f-b2a9-b171e6424981 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:25.690905 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44587f-a8be-409f-b2a9-b171e6424981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:25.718937 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4d44587f-a8be-409f-b2a9-b171e6424981 None None] MFA Rules not processed for user `7dd3a82ef479487aabf9708c8539e01f`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:25.720163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4d44587f-a8be-409f-b2a9-b171e6424981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:25.789876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1171/2355] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:25.804363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad04f1c-5b4e-46a7-937f-0fde3028e904 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:25.806128 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-cad04f1c-5b4e-46a7-937f-0fde3028e904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:25.834043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:25.865973 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad04f1c-5b4e-46a7-937f-0fde3028e904 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:25.869616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd18a94-20af-4cca-bf12-62e6b6fd4588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:25.870230 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd18a94-20af-4cca-bf12-62e6b6fd4588 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:25.870509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd18a94-20af-4cca-bf12-62e6b6fd4588 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:25.870783 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd18a94-20af-4cca-bf12-62e6b6fd4588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:25.879763 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd18a94-20af-4cca-bf12-62e6b6fd4588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:25.881215 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd18a94-20af-4cca-bf12-62e6b6fd4588 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:25.890041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1185/2356] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:25.912471 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44587f-a8be-409f-b2a9-b171e6424981 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:25.976460 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44587f-a8be-409f-b2a9-b171e6424981 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:25.981162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3602b-6cc9-43a8-8af6-1637868fdfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:25.981840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3602b-6cc9-43a8-8af6-1637868fdfe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:25.982128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3602b-6cc9-43a8-8af6-1637868fdfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:25.982411 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3602b-6cc9-43a8-8af6-1637868fdfe6 admin admin] PATH_INFO: `/v3/users/7dd3a82ef479487aabf9708c8539e01f` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:25.983587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3602b-6cc9-43a8-8af6-1637868fdfe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd3a82ef479487aabf9708c8539e01f)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:25.985531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3602b-6cc9-43a8-8af6-1637868fdfe6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:26.199928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:26.206048 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2fb3602b-6cc9-43a8-8af6-1637868fdfe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd3a82ef479487aabf9708c8539e01f'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:26.206705 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2fb3602b-6cc9-43a8-8af6-1637868fdfe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd3a82ef479487aabf9708c8539e01f'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:26.314045 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2fb3602b-6cc9-43a8-8af6-1637868fdfe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd3a82ef479487aabf9708c8539e01f'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:26.326747 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2fb3602b-6cc9-43a8-8af6-1637868fdfe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd3a82ef479487aabf9708c8539e01f'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:26.327321 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2fb3602b-6cc9-43a8-8af6-1637868fdfe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd3a82ef479487aabf9708c8539e01f'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:26.339966 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1172/2357] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:25 2022] DELETE /identity/v3/users/7dd3a82ef479487aabf9708c8539e01f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:26.344474 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9b69e-f3c1-4298-9c50-ee46d05b5f4e None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:26.344777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9b69e-f3c1-4298-9c50-ee46d05b5f4e None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:26.345053 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9b69e-f3c1-4298-9c50-ee46d05b5f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:26.364492 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-1fc9b69e-f3c1-4298-9c50-ee46d05b5f4e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:26.365925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-1fc9b69e-f3c1-4298-9c50-ee46d05b5f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:26.426634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1186/2358] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:26.436391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3602b-6cc9-43a8-8af6-1637868fdfe6 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:26.437817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2fb3602b-6cc9-43a8-8af6-1637868fdfe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:26.494095 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3602b-6cc9-43a8-8af6-1637868fdfe6 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:26.497586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625cfb0-0ad1-45ba-bc4a-224afa7bb300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:26.498198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625cfb0-0ad1-45ba-bc4a-224afa7bb300 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:26.498476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625cfb0-0ad1-45ba-bc4a-224afa7bb300 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:26.498748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625cfb0-0ad1-45ba-bc4a-224afa7bb300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:26.508220 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625cfb0-0ad1-45ba-bc4a-224afa7bb300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:26.509724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625cfb0-0ad1-45ba-bc4a-224afa7bb300 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:26.520092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1173/2359] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:26.924955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9b69e-f3c1-4298-9c50-ee46d05b5f4e None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:26.926627 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-1fc9b69e-f3c1-4298-9c50-ee46d05b5f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:26.943555 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9b69e-f3c1-4298-9c50-ee46d05b5f4e None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:26.949426 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171637f-2437-40bb-aa20-6bc17c77d13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:26.950143 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171637f-2437-40bb-aa20-6bc17c77d13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:26.950498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171637f-2437-40bb-aa20-6bc17c77d13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:26.950664 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171637f-2437-40bb-aa20-6bc17c77d13c admin admin] PATH_INFO: `/v3/projects/aa664194352a4b74bce2cdd2ed7a8375` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:26.951870 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171637f-2437-40bb-aa20-6bc17c77d13c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa664194352a4b74bce2cdd2ed7a8375)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:26.953747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171637f-2437-40bb-aa20-6bc17c77d13c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:27.080759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1171637f-2437-40bb-aa20-6bc17c77d13c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa664194352a4b74bce2cdd2ed7a8375', 'request_id': 'req-1171637f-2437-40bb-aa20-6bc17c77d13c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:27.165864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1171637f-2437-40bb-aa20-6bc17c77d13c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa664194352a4b74bce2cdd2ed7a8375', 'request_id': 'req-1171637f-2437-40bb-aa20-6bc17c77d13c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:27.175702 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1171637f-2437-40bb-aa20-6bc17c77d13c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa664194352a4b74bce2cdd2ed7a8375', 'request_id': 'req-1171637f-2437-40bb-aa20-6bc17c77d13c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:27.183904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1171637f-2437-40bb-aa20-6bc17c77d13c admin admin] The token cache is being invalidate because project aa664194352a4b74bce2cdd2ed7a8375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:27.184197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1171637f-2437-40bb-aa20-6bc17c77d13c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:27.184995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-1171637f-2437-40bb-aa20-6bc17c77d13c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:27.186554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1187/2360] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:26 2022] DELETE /identity/v3/projects/aa664194352a4b74bce2cdd2ed7a8375 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:27.192242 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccd78c-a52f-4332-ac2f-f09c37dd214d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:27.192709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccd78c-a52f-4332-ac2f-f09c37dd214d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:27.192825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccd78c-a52f-4332-ac2f-f09c37dd214d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:27.212131 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-46ccd78c-a52f-4332-ac2f-f09c37dd214d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:27.213323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-46ccd78c-a52f-4332-ac2f-f09c37dd214d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:27.272873 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1174/2361] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:27.281733 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f56d2-4697-4996-9edc-75409b685c84 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:27.282023 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f56d2-4697-4996-9edc-75409b685c84 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:27.282302 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f56d2-4697-4996-9edc-75409b685c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:27.302427 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-ff0f56d2-4697-4996-9edc-75409b685c84 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:27.303636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ff0f56d2-4697-4996-9edc-75409b685c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:27.311550 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1188/2362] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:27.316321 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccd78c-a52f-4332-ac2f-f09c37dd214d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:27.326176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccd78c-a52f-4332-ac2f-f09c37dd214d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:27.330880 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad211e90-5981-4d87-8939-a02cabe93b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:27.331487 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad211e90-5981-4d87-8939-a02cabe93b65 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:27.331771 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad211e90-5981-4d87-8939-a02cabe93b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:27.332057 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad211e90-5981-4d87-8939-a02cabe93b65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:27.332751 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad211e90-5981-4d87-8939-a02cabe93b65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:27.333059 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad211e90-5981-4d87-8939-a02cabe93b65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:27.334686 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad211e90-5981-4d87-8939-a02cabe93b65 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:27.346563 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1175/2363] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:38:27.350641 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f56d2-4697-4996-9edc-75409b685c84 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:27.359729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f56d2-4697-4996-9edc-75409b685c84 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:27.364978 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0055e-8403-43b2-acb8-033c5a57e298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:27.365619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0055e-8403-43b2-acb8-033c5a57e298 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:27.365902 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0055e-8403-43b2-acb8-033c5a57e298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:27.366178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0055e-8403-43b2-acb8-033c5a57e298 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:27.367029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0055e-8403-43b2-acb8-033c5a57e298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:27.369087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0055e-8403-43b2-acb8-033c5a57e298 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:27.467236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1189/2364] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:27 2022] POST /identity/v3/projects => generated 361 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:27.471802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad211e90-5981-4d87-8939-a02cabe93b65 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:27.482104 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad211e90-5981-4d87-8939-a02cabe93b65 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:27.526224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:27.539355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd105a-58bf-4b0d-8bdc-5a8e98eccf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:27.539976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd105a-58bf-4b0d-8bdc-5a8e98eccf3b admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:27.540265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd105a-58bf-4b0d-8bdc-5a8e98eccf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:27.540542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd105a-58bf-4b0d-8bdc-5a8e98eccf3b admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:27.541216 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd105a-58bf-4b0d-8bdc-5a8e98eccf3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:27.543196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd105a-58bf-4b0d-8bdc-5a8e98eccf3b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:27.674912 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1176/2365] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:27 2022] POST /identity/v3/users => generated 281 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:27.679092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0055e-8403-43b2-acb8-033c5a57e298 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:27.689626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0055e-8403-43b2-acb8-033c5a57e298 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:27.698039 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ee01e-4ccf-4ebb-ac00-bca90d1f1932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:27.698668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ee01e-4ccf-4ebb-ac00-bca90d1f1932 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:27.698955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ee01e-4ccf-4ebb-ac00-bca90d1f1932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:27.699236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ee01e-4ccf-4ebb-ac00-bca90d1f1932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:27.699948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ee01e-4ccf-4ebb-ac00-bca90d1f1932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:27.701790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ee01e-4ccf-4ebb-ac00-bca90d1f1932 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:27.712408 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1190/2366] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:27.716462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd105a-58bf-4b0d-8bdc-5a8e98eccf3b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:27.727125 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd105a-58bf-4b0d-8bdc-5a8e98eccf3b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:27.731675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f952c-1f85-4acd-b008-a3237ee8bb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:27.732279 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f952c-1f85-4acd-b008-a3237ee8bb60 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:27.732560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f952c-1f85-4acd-b008-a3237ee8bb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:27.732836 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f952c-1f85-4acd-b008-a3237ee8bb60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:27.733564 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f952c-1f85-4acd-b008-a3237ee8bb60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:27.735153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f952c-1f85-4acd-b008-a3237ee8bb60 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:27.746349 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1177/2367] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:27.750363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ee01e-4ccf-4ebb-ac00-bca90d1f1932 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:27.760343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ee01e-4ccf-4ebb-ac00-bca90d1f1932 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:27.764918 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a4bf7-ac70-421b-90ec-490e6e3ba7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:27.767028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a4bf7-ac70-421b-90ec-490e6e3ba7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:27.767028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a4bf7-ac70-421b-90ec-490e6e3ba7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:27.767028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a4bf7-ac70-421b-90ec-490e6e3ba7a9 admin admin] PATH_INFO: `/v3/projects/226b04e0e5374eb296132aadb784ed64/users/50e87db3ff6c477890ef1bf61225f8af/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:27.775876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:27.782497 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a4bf7-ac70-421b-90ec-490e6e3ba7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=226b04e0e5374eb296132aadb784ed64, user_id=50e87db3ff6c477890ef1bf61225f8af, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:27.793061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a4bf7-ac70-421b-90ec-490e6e3ba7a9 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:27.885668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1191/2368] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:27 2022] PUT /identity/v3/projects/226b04e0e5374eb296132aadb784ed64/users/50e87db3ff6c477890ef1bf61225f8af/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:27.896923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655a29-cf96-41e0-b710-ce71f6c97cd4 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:27.897327 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655a29-cf96-41e0-b710-ce71f6c97cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:27.897659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655a29-cf96-41e0-b710-ce71f6c97cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:27.925575 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8d655a29-cf96-41e0-b710-ce71f6c97cd4 None None] MFA Rules not processed for user `50e87db3ff6c477890ef1bf61225f8af`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:27.926792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8d655a29-cf96-41e0-b710-ce71f6c97cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:27.993462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1178/2369] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:28.005014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a4bf7-ac70-421b-90ec-490e6e3ba7a9 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:28.006854 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-285a4bf7-ac70-421b-90ec-490e6e3ba7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:28.064408 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a4bf7-ac70-421b-90ec-490e6e3ba7a9 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:28.068033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f9a76-2691-45ef-9146-c341708832a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:28.068650 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f9a76-2691-45ef-9146-c341708832a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:28.068932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f9a76-2691-45ef-9146-c341708832a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:28.069239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f9a76-2691-45ef-9146-c341708832a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:28.077614 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f9a76-2691-45ef-9146-c341708832a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:28.079027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f9a76-2691-45ef-9146-c341708832a1 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:28.088374 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1192/2370] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:37.990422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:38.084364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:50.146345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d655a29-cf96-41e0-b710-ce71f6c97cd4 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:50.147801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8d655a29-cf96-41e0-b710-ce71f6c97cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:50.207111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d655a29-cf96-41e0-b710-ce71f6c97cd4 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:50.211041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87323845-d438-4f77-8ed3-943a97ab1508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:50.211661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87323845-d438-4f77-8ed3-943a97ab1508 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:50.211940 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87323845-d438-4f77-8ed3-943a97ab1508 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:50.212217 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87323845-d438-4f77-8ed3-943a97ab1508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:50.214008 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-87323845-d438-4f77-8ed3-943a97ab1508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:50.280894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87323845-d438-4f77-8ed3-943a97ab1508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:50.282362 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87323845-d438-4f77-8ed3-943a97ab1508 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:50.291996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1179/2371] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:50.601413 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f9a76-2691-45ef-9146-c341708832a1 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:50.602895 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2c7f9a76-2691-45ef-9146-c341708832a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:50.615256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f9a76-2691-45ef-9146-c341708832a1 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:50.618923 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b81732-8562-472d-a2ad-e4a6b236b860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:50.619539 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b81732-8562-472d-a2ad-e4a6b236b860 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:50.619821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b81732-8562-472d-a2ad-e4a6b236b860 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:50.620099 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b81732-8562-472d-a2ad-e4a6b236b860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:50.621865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-71b81732-8562-472d-a2ad-e4a6b236b860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:50.641687 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b81732-8562-472d-a2ad-e4a6b236b860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:50.643187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b81732-8562-472d-a2ad-e4a6b236b860 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:50.654226 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1193/2372] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:55.540272 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87323845-d438-4f77-8ed3-943a97ab1508 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:55.550749 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-87323845-d438-4f77-8ed3-943a97ab1508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:55.658181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87323845-d438-4f77-8ed3-943a97ab1508 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:55.664097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ef089-7795-4ec7-9c99-14a4322714f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aae5b2e7bf74805b04d01df47693ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:55.665738 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ef089-7795-4ec7-9c99-14a4322714f9 service placement] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:55.666348 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ef089-7795-4ec7-9c99-14a4322714f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:55.666504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ef089-7795-4ec7-9c99-14a4322714f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:55.668423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e62ef089-7795-4ec7-9c99-14a4322714f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:55.692061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ef089-7795-4ec7-9c99-14a4322714f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:55.693958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ef089-7795-4ec7-9c99-14a4322714f9 service placement] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:55.710317 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1180/2373] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:55.779118 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b81732-8562-472d-a2ad-e4a6b236b860 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:55.781806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-71b81732-8562-472d-a2ad-e4a6b236b860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:55.807442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b81732-8562-472d-a2ad-e4a6b236b860 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:55.813460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bbc9d-ca47-42c6-a85f-45ca4989721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:55.814157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bbc9d-ca47-42c6-a85f-45ca4989721d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:55.814438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bbc9d-ca47-42c6-a85f-45ca4989721d admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:55.814720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bbc9d-ca47-42c6-a85f-45ca4989721d admin admin] PATH_INFO: `/v3/users/0002ebbc629b4dafb109dc94450fe1d8` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:55.816249 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bbc9d-ca47-42c6-a85f-45ca4989721d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0002ebbc629b4dafb109dc94450fe1d8)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:55.818837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bbc9d-ca47-42c6-a85f-45ca4989721d admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:55.922802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ef089-7795-4ec7-9c99-14a4322714f9 service placement] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:55.938174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ef089-7795-4ec7-9c99-14a4322714f9 service placement] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:55.945020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49958f45-30f5-4ff4-9c3d-712362fd933d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aae5b2e7bf74805b04d01df47693ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:55.945809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49958f45-30f5-4ff4-9c3d-712362fd933d service placement] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:55.946205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49958f45-30f5-4ff4-9c3d-712362fd933d service placement] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:55.946634 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49958f45-30f5-4ff4-9c3d-712362fd933d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:55.948606 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-49958f45-30f5-4ff4-9c3d-712362fd933d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:55.961538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49958f45-30f5-4ff4-9c3d-712362fd933d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:55.963565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49958f45-30f5-4ff4-9c3d-712362fd933d service placement] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:55.981821 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1181/2374] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:38:56.032325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d10bbc9d-ca47-42c6-a85f-45ca4989721d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0002ebbc629b4dafb109dc94450fe1d8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.032985 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d10bbc9d-ca47-42c6-a85f-45ca4989721d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0002ebbc629b4dafb109dc94450fe1d8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.063040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49958f45-30f5-4ff4-9c3d-712362fd933d service placement] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:56.064686 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-49958f45-30f5-4ff4-9c3d-712362fd933d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:56.079715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49958f45-30f5-4ff4-9c3d-712362fd933d service placement] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:56.084532 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6059c-78e0-43b7-b569-66354e2fdc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:56.085161 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6059c-78e0-43b7-b569-66354e2fdc11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:56.085446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6059c-78e0-43b7-b569-66354e2fdc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:56.088530 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6059c-78e0-43b7-b569-66354e2fdc11 admin admin] PATH_INFO: `/v3/users/b3c43b517c8a464c93f0ce620826ad35` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:56.088530 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6059c-78e0-43b7-b569-66354e2fdc11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c43b517c8a464c93f0ce620826ad35)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:56.088816 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6059c-78e0-43b7-b569-66354e2fdc11 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:56.113334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:56.141180 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d10bbc9d-ca47-42c6-a85f-45ca4989721d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0002ebbc629b4dafb109dc94450fe1d8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.154856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d10bbc9d-ca47-42c6-a85f-45ca4989721d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0002ebbc629b4dafb109dc94450fe1d8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.168508 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-d10bbc9d-ca47-42c6-a85f-45ca4989721d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0002ebbc629b4dafb109dc94450fe1d8'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.178932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1194/2375] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:55 2022] DELETE /identity/v3/users/0002ebbc629b4dafb109dc94450fe1d8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:56.410015 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d9b6059c-78e0-43b7-b569-66354e2fdc11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c43b517c8a464c93f0ce620826ad35'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.410876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d9b6059c-78e0-43b7-b569-66354e2fdc11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c43b517c8a464c93f0ce620826ad35'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.490809 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bbc9d-ca47-42c6-a85f-45ca4989721d admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:56.492667 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d10bbc9d-ca47-42c6-a85f-45ca4989721d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:56.508108 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d9b6059c-78e0-43b7-b569-66354e2fdc11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c43b517c8a464c93f0ce620826ad35'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.530084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d9b6059c-78e0-43b7-b569-66354e2fdc11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c43b517c8a464c93f0ce620826ad35'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.531067 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d9b6059c-78e0-43b7-b569-66354e2fdc11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c43b517c8a464c93f0ce620826ad35'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.545506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1182/2376] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:56 2022] DELETE /identity/v3/users/b3c43b517c8a464c93f0ce620826ad35 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:56.587342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bbc9d-ca47-42c6-a85f-45ca4989721d admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:56.655660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd3695-8fd9-466a-bd1c-005c02456801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:56.656356 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd3695-8fd9-466a-bd1c-005c02456801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:56.656637 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd3695-8fd9-466a-bd1c-005c02456801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:56.656910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd3695-8fd9-466a-bd1c-005c02456801 admin admin] PATH_INFO: `/v3/projects/ba0b7f7639504a25a73c94335d62b98f` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:56.658199 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd3695-8fd9-466a-bd1c-005c02456801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba0b7f7639504a25a73c94335d62b98f)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:56.660204 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd3695-8fd9-466a-bd1c-005c02456801 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:56.669335 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:56.789994 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-6ecd3695-8fd9-466a-bd1c-005c02456801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba0b7f7639504a25a73c94335d62b98f', 'request_id': 'req-6ecd3695-8fd9-466a-bd1c-005c02456801'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.885936 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-6ecd3695-8fd9-466a-bd1c-005c02456801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba0b7f7639504a25a73c94335d62b98f', 'request_id': 'req-6ecd3695-8fd9-466a-bd1c-005c02456801'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.892207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-6ecd3695-8fd9-466a-bd1c-005c02456801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba0b7f7639504a25a73c94335d62b98f', 'request_id': 'req-6ecd3695-8fd9-466a-bd1c-005c02456801'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.904982 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-6ecd3695-8fd9-466a-bd1c-005c02456801 admin admin] The token cache is being invalidate because project ba0b7f7639504a25a73c94335d62b98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:56.905187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-6ecd3695-8fd9-466a-bd1c-005c02456801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.905841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-6ecd3695-8fd9-466a-bd1c-005c02456801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.907459 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1195/2377] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:56 2022] DELETE /identity/v3/projects/ba0b7f7639504a25a73c94335d62b98f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:56.912989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237fae8-cf7b-4773-9f34-73667499444a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:56.913277 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237fae8-cf7b-4773-9f34-73667499444a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:56.913772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237fae8-cf7b-4773-9f34-73667499444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:56.927712 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd3695-8fd9-466a-bd1c-005c02456801 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:56.929192 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6ecd3695-8fd9-466a-bd1c-005c02456801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:56.945788 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6237fae8-cf7b-4773-9f34-73667499444a None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:56.948951 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6237fae8-cf7b-4773-9f34-73667499444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:57.013207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd3695-8fd9-466a-bd1c-005c02456801 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.018156 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9065c2-5111-4b3e-b2d2-2723eed09672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.019862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9065c2-5111-4b3e-b2d2-2723eed09672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.020137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9065c2-5111-4b3e-b2d2-2723eed09672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.020427 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9065c2-5111-4b3e-b2d2-2723eed09672 admin admin] PATH_INFO: `/v3/projects/7b96e460476f4bc9b35224e38b33f4c7` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.027153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1183/2378] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:57.027340 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9065c2-5111-4b3e-b2d2-2723eed09672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b96e460476f4bc9b35224e38b33f4c7)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.027340 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9065c2-5111-4b3e-b2d2-2723eed09672 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.028456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57798e10-ed19-4006-98e9-4b7690d6ce3c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.028744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57798e10-ed19-4006-98e9-4b7690d6ce3c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.029022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57798e10-ed19-4006-98e9-4b7690d6ce3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.052008 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-57798e10-ed19-4006-98e9-4b7690d6ce3c None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:57.053224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-57798e10-ed19-4006-98e9-4b7690d6ce3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:57.061904 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1184/2379] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:57.066362 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57798e10-ed19-4006-98e9-4b7690d6ce3c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.075705 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57798e10-ed19-4006-98e9-4b7690d6ce3c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.080637 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd106d-8e43-4cf2-a25e-d3d941b325c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.083574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd106d-8e43-4cf2-a25e-d3d941b325c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.083574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd106d-8e43-4cf2-a25e-d3d941b325c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.083574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd106d-8e43-4cf2-a25e-d3d941b325c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.083574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd106d-8e43-4cf2-a25e-d3d941b325c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:57.084260 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd106d-8e43-4cf2-a25e-d3d941b325c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.085273 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd106d-8e43-4cf2-a25e-d3d941b325c0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.098389 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1185/2380] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:38:57.102720 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd106d-8e43-4cf2-a25e-d3d941b325c0 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.113022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd106d-8e43-4cf2-a25e-d3d941b325c0 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.118315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c1a8e-bfb1-450d-832b-d85b2fe52896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.118905 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c1a8e-bfb1-450d-832b-d85b2fe52896 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.119190 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c1a8e-bfb1-450d-832b-d85b2fe52896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.119468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c1a8e-bfb1-450d-832b-d85b2fe52896 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.120132 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c1a8e-bfb1-450d-832b-d85b2fe52896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.122034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c1a8e-bfb1-450d-832b-d85b2fe52896 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.171819 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9b9065c2-5111-4b3e-b2d2-2723eed09672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b96e460476f4bc9b35224e38b33f4c7', 'request_id': 'req-9b9065c2-5111-4b3e-b2d2-2723eed09672'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:57.241935 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1186/2381] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:57 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:57.246018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c1a8e-bfb1-450d-832b-d85b2fe52896 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.277761 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9b9065c2-5111-4b3e-b2d2-2723eed09672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b96e460476f4bc9b35224e38b33f4c7', 'request_id': 'req-9b9065c2-5111-4b3e-b2d2-2723eed09672'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:57.289168 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9b9065c2-5111-4b3e-b2d2-2723eed09672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b96e460476f4bc9b35224e38b33f4c7', 'request_id': 'req-9b9065c2-5111-4b3e-b2d2-2723eed09672'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:57.305938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9b9065c2-5111-4b3e-b2d2-2723eed09672 admin admin] The token cache is being invalidate because project 7b96e460476f4bc9b35224e38b33f4c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:57.306527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9b9065c2-5111-4b3e-b2d2-2723eed09672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:57.307224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-9b9065c2-5111-4b3e-b2d2-2723eed09672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:57.313044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1196/2382] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:56 2022] DELETE /identity/v3/projects/7b96e460476f4bc9b35224e38b33f4c7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:57.314910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2958b3f-a960-4f45-8d1d-4d0873b9fbc0 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.315765 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2958b3f-a960-4f45-8d1d-4d0873b9fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.316239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2958b3f-a960-4f45-8d1d-4d0873b9fbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.320551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:57.324293 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c1a8e-bfb1-450d-832b-d85b2fe52896 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.329048 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fd421-0529-4eac-a233-b0f7316124ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.329818 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fd421-0529-4eac-a233-b0f7316124ce admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.335364 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fd421-0529-4eac-a233-b0f7316124ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.335364 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fd421-0529-4eac-a233-b0f7316124ce admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.335364 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fd421-0529-4eac-a233-b0f7316124ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.335364 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fd421-0529-4eac-a233-b0f7316124ce admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.336744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e2958b3f-a960-4f45-8d1d-4d0873b9fbc0 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:57.337981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e2958b3f-a960-4f45-8d1d-4d0873b9fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:57.346709 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1197/2383] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:57.354409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b66cf2-b022-440f-9e30-17d3f8448bb8 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.354692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b66cf2-b022-440f-9e30-17d3f8448bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.355091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b66cf2-b022-440f-9e30-17d3f8448bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.374421 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-82b66cf2-b022-440f-9e30-17d3f8448bb8 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:57.375601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-82b66cf2-b022-440f-9e30-17d3f8448bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:57.384095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1198/2384] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:57.388097 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b66cf2-b022-440f-9e30-17d3f8448bb8 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.397565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b66cf2-b022-440f-9e30-17d3f8448bb8 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.402116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0dced-68cb-492c-87fb-b585469f0f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.406512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0dced-68cb-492c-87fb-b585469f0f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.406512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0dced-68cb-492c-87fb-b585469f0f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.406512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0dced-68cb-492c-87fb-b585469f0f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.406512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0dced-68cb-492c-87fb-b585469f0f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:57.406512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0dced-68cb-492c-87fb-b585469f0f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.406512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0dced-68cb-492c-87fb-b585469f0f07 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.414307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:57.417527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1199/2385] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:38:57.421651 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0dced-68cb-492c-87fb-b585469f0f07 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.431255 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0dced-68cb-492c-87fb-b585469f0f07 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.432191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1187/2386] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:57 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:57.436351 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd6774-7aca-493a-b5b6-ef4da7f6a455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.436946 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd6774-7aca-493a-b5b6-ef4da7f6a455 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.437224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd6774-7aca-493a-b5b6-ef4da7f6a455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.437530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd6774-7aca-493a-b5b6-ef4da7f6a455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.438186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd6774-7aca-493a-b5b6-ef4da7f6a455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.440073 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd6774-7aca-493a-b5b6-ef4da7f6a455 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.441174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fd421-0529-4eac-a233-b0f7316124ce admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.442940 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6b2fd421-0529-4eac-a233-b0f7316124ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:57.454994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fd421-0529-4eac-a233-b0f7316124ce admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.461086 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07a3e9-b932-441e-90ef-70200865a227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.461753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07a3e9-b932-441e-90ef-70200865a227 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.462069 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07a3e9-b932-441e-90ef-70200865a227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.462350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07a3e9-b932-441e-90ef-70200865a227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.463063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07a3e9-b932-441e-90ef-70200865a227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.464667 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07a3e9-b932-441e-90ef-70200865a227 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.475273 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1188/2387] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:38:57.479021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07a3e9-b932-441e-90ef-70200865a227 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.489404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07a3e9-b932-441e-90ef-70200865a227 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.494461 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f72b49-3746-4cc7-8a35-f10dc597595b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.495115 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f72b49-3746-4cc7-8a35-f10dc597595b admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.495403 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f72b49-3746-4cc7-8a35-f10dc597595b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.495686 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f72b49-3746-4cc7-8a35-f10dc597595b admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.496404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f72b49-3746-4cc7-8a35-f10dc597595b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.498073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f72b49-3746-4cc7-8a35-f10dc597595b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.509411 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1189/2388] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:38:57.513508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f72b49-3746-4cc7-8a35-f10dc597595b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.523667 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f72b49-3746-4cc7-8a35-f10dc597595b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.528396 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5fcde-b6d0-4d78-a4ca-e68a8aaf4a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.529029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5fcde-b6d0-4d78-a4ca-e68a8aaf4a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.529313 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5fcde-b6d0-4d78-a4ca-e68a8aaf4a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.529626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5fcde-b6d0-4d78-a4ca-e68a8aaf4a41 admin admin] PATH_INFO: `/v3/projects/f7ffe89dd42d4fc09790973f9e5370ca/users/12ff407a6e474c439fd18eb2acc4dc0c/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.543876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5fcde-b6d0-4d78-a4ca-e68a8aaf4a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ffe89dd42d4fc09790973f9e5370ca, user_id=12ff407a6e474c439fd18eb2acc4dc0c, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.546617 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5fcde-b6d0-4d78-a4ca-e68a8aaf4a41 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.576833 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1200/2389] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:57 2022] POST /identity/v3/projects => generated 407 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:57.582134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd6774-7aca-493a-b5b6-ef4da7f6a455 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.642943 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd6774-7aca-493a-b5b6-ef4da7f6a455 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.648263 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375d173-3e43-4d54-8e0b-dd1f99c5bb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.648881 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375d173-3e43-4d54-8e0b-dd1f99c5bb93 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.649166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375d173-3e43-4d54-8e0b-dd1f99c5bb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.649447 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375d173-3e43-4d54-8e0b-dd1f99c5bb93 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.650240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375d173-3e43-4d54-8e0b-dd1f99c5bb93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.652800 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375d173-3e43-4d54-8e0b-dd1f99c5bb93 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.669186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1190/2390] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:57 2022] PUT /identity/v3/projects/f7ffe89dd42d4fc09790973f9e5370ca/users/12ff407a6e474c439fd18eb2acc4dc0c/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:57.680374 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5f539-7383-4983-a201-2a1d634f2ccf None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.680662 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5f539-7383-4983-a201-2a1d634f2ccf None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.680943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5f539-7383-4983-a201-2a1d634f2ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.716291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4bd5f539-7383-4983-a201-2a1d634f2ccf None None] MFA Rules not processed for user `12ff407a6e474c439fd18eb2acc4dc0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:57.717540 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4bd5f539-7383-4983-a201-2a1d634f2ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:57.727828 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1201/2391] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:57 2022] POST /identity/v3/users => generated 304 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:57.732189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375d173-3e43-4d54-8e0b-dd1f99c5bb93 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.742765 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375d173-3e43-4d54-8e0b-dd1f99c5bb93 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.785389 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1191/2392] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:57.789802 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5f539-7383-4983-a201-2a1d634f2ccf None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.800829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb610e4-84bf-4c93-b02d-cbefeddbf913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.801457 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb610e4-84bf-4c93-b02d-cbefeddbf913 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.801760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb610e4-84bf-4c93-b02d-cbefeddbf913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.802201 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb610e4-84bf-4c93-b02d-cbefeddbf913 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.803036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb610e4-84bf-4c93-b02d-cbefeddbf913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.804639 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb610e4-84bf-4c93-b02d-cbefeddbf913 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.814689 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1202/2393] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:38:57.819428 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb610e4-84bf-4c93-b02d-cbefeddbf913 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.830603 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb610e4-84bf-4c93-b02d-cbefeddbf913 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.836290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25158780-4b5e-440f-a829-ac02c474a301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.836907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25158780-4b5e-440f-a829-ac02c474a301 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.837190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25158780-4b5e-440f-a829-ac02c474a301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.837487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25158780-4b5e-440f-a829-ac02c474a301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.838191 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25158780-4b5e-440f-a829-ac02c474a301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.839789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25158780-4b5e-440f-a829-ac02c474a301 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.850326 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1203/2394] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:57.854019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5f539-7383-4983-a201-2a1d634f2ccf None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.854799 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25158780-4b5e-440f-a829-ac02c474a301 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.858856 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b09e0-cbb9-406d-a9c3-0e97163100c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.859489 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b09e0-cbb9-406d-a9c3-0e97163100c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.859775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b09e0-cbb9-406d-a9c3-0e97163100c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.860052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b09e0-cbb9-406d-a9c3-0e97163100c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.860754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b09e0-cbb9-406d-a9c3-0e97163100c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.863653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b09e0-cbb9-406d-a9c3-0e97163100c7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.865582 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25158780-4b5e-440f-a829-ac02c474a301 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.870352 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2a86a-7681-468e-ac41-e570f4366c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.871019 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2a86a-7681-468e-ac41-e570f4366c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.871358 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2a86a-7681-468e-ac41-e570f4366c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.871647 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2a86a-7681-468e-ac41-e570f4366c58 admin admin] PATH_INFO: `/v3/projects/4be0c332586444a38d41a2fd446f52db/users/d2cc0410e40344519702122387f22308/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.887374 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2a86a-7681-468e-ac41-e570f4366c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be0c332586444a38d41a2fd446f52db, user_id=d2cc0410e40344519702122387f22308, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.890202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2a86a-7681-468e-ac41-e570f4366c58 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.950411 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1192/2395] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:57 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:57.953997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b09e0-cbb9-406d-a9c3-0e97163100c7 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.971133 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:57.984536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1204/2396] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:57 2022] PUT /identity/v3/projects/4be0c332586444a38d41a2fd446f52db/users/d2cc0410e40344519702122387f22308/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:57.987773 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c31582-37be-4d39-bc7c-17f53626f299 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.988070 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c31582-37be-4d39-bc7c-17f53626f299 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.988364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c31582-37be-4d39-bc7c-17f53626f299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.023686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-d3c31582-37be-4d39-bc7c-17f53626f299 None None] MFA Rules not processed for user `d2cc0410e40344519702122387f22308`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:58.024017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b09e0-cbb9-406d-a9c3-0e97163100c7 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.024267 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d3c31582-37be-4d39-bc7c-17f53626f299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:58.042667 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:58.092206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1205/2397] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:57 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:58.096065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9fd3b-88ac-4dfb-bac6-d5fd55bf6c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.097288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c31582-37be-4d39-bc7c-17f53626f299 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.097453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9fd3b-88ac-4dfb-bac6-d5fd55bf6c77 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.097817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9fd3b-88ac-4dfb-bac6-d5fd55bf6c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.098273 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9fd3b-88ac-4dfb-bac6-d5fd55bf6c77 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.098884 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9fd3b-88ac-4dfb-bac6-d5fd55bf6c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.100813 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9fd3b-88ac-4dfb-bac6-d5fd55bf6c77 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.109783 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c31582-37be-4d39-bc7c-17f53626f299 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.115428 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bff970-bce2-4624-84dc-2f83b2c8aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.116078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bff970-bce2-4624-84dc-2f83b2c8aa64 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.116361 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bff970-bce2-4624-84dc-2f83b2c8aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.116638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bff970-bce2-4624-84dc-2f83b2c8aa64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.117344 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bff970-bce2-4624-84dc-2f83b2c8aa64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.119391 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bff970-bce2-4624-84dc-2f83b2c8aa64 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.229214 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1193/2398] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:57 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:58.230324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9fd3b-88ac-4dfb-bac6-d5fd55bf6c77 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.240520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9fd3b-88ac-4dfb-bac6-d5fd55bf6c77 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.242979 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1206/2399] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:58 2022] POST /identity/v3/projects => generated 409 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:58.245535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c8db-f0c1-483a-85bc-ed2f7fdfe5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.246256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c8db-f0c1-483a-85bc-ed2f7fdfe5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.246542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c8db-f0c1-483a-85bc-ed2f7fdfe5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.246811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bff970-bce2-4624-84dc-2f83b2c8aa64 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.246922 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c8db-f0c1-483a-85bc-ed2f7fdfe5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.247518 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285c8db-f0c1-483a-85bc-ed2f7fdfe5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.249111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285c8db-f0c1-483a-85bc-ed2f7fdfe5c3 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.265794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1194/2400] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:38:58.269843 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c8db-f0c1-483a-85bc-ed2f7fdfe5c3 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.279987 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c8db-f0c1-483a-85bc-ed2f7fdfe5c3 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.311390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bff970-bce2-4624-84dc-2f83b2c8aa64 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.318117 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184760d-3b23-4c4a-b277-00c14f0b63c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.318791 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184760d-3b23-4c4a-b277-00c14f0b63c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.319078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184760d-3b23-4c4a-b277-00c14f0b63c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.319372 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184760d-3b23-4c4a-b277-00c14f0b63c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.320041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184760d-3b23-4c4a-b277-00c14f0b63c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.321992 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184760d-3b23-4c4a-b277-00c14f0b63c1 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.339603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d2a37-fbdf-480c-b57f-3fea54f58a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.340280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d2a37-fbdf-480c-b57f-3fea54f58a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.340569 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d2a37-fbdf-480c-b57f-3fea54f58a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.340849 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d2a37-fbdf-480c-b57f-3fea54f58a3a admin admin] PATH_INFO: `/v3/projects/dc579756fb9d470c926ac598b53481fd/users/81b47ae63ed146b18025ae0afb327e08/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.355432 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d2a37-fbdf-480c-b57f-3fea54f58a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc579756fb9d470c926ac598b53481fd, user_id=81b47ae63ed146b18025ae0afb327e08, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.358107 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d2a37-fbdf-480c-b57f-3fea54f58a3a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.428919 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1207/2402] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:58 2022] POST /identity/v3/users => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:58.437501 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1195/2402] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:58 2022] PUT /identity/v3/projects/dc579756fb9d470c926ac598b53481fd/users/81b47ae63ed146b18025ae0afb327e08/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:58.438644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d2a37-fbdf-480c-b57f-3fea54f58a3a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.439171 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184760d-3b23-4c4a-b277-00c14f0b63c1 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.455533 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184760d-3b23-4c4a-b277-00c14f0b63c1 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.466531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:58.502201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d2a37-fbdf-480c-b57f-3fea54f58a3a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.507290 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40058385-1da8-4f0f-a563-0b1d2c4184e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.507914 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40058385-1da8-4f0f-a563-0b1d2c4184e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.508198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40058385-1da8-4f0f-a563-0b1d2c4184e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.508477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40058385-1da8-4f0f-a563-0b1d2c4184e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.509169 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40058385-1da8-4f0f-a563-0b1d2c4184e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.510867 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40058385-1da8-4f0f-a563-0b1d2c4184e6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.512342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0875a-7e42-4c2a-ad90-572e2a423bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.512973 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0875a-7e42-4c2a-ad90-572e2a423bdf admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.513259 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0875a-7e42-4c2a-ad90-572e2a423bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.513572 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0875a-7e42-4c2a-ad90-572e2a423bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.514281 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0875a-7e42-4c2a-ad90-572e2a423bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.515934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0875a-7e42-4c2a-ad90-572e2a423bdf admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.521698 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1196/2403] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:58.526098 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40058385-1da8-4f0f-a563-0b1d2c4184e6 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.531019 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1208/2404] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:58.537381 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40058385-1da8-4f0f-a563-0b1d2c4184e6 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.538207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0875a-7e42-4c2a-ad90-572e2a423bdf admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.542941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fe931-79ca-41a7-8559-25c883eca9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.543609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fe931-79ca-41a7-8559-25c883eca9d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.543894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fe931-79ca-41a7-8559-25c883eca9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.544179 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fe931-79ca-41a7-8559-25c883eca9d7 admin admin] PATH_INFO: `/v3/projects/d85b81b627cd4f2aa79c0c3b4eedcbfb/users/436dd31a139c47019f4958a5b68e0941/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.548880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0875a-7e42-4c2a-ad90-572e2a423bdf admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.553915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51629ee-a4ac-46f5-b3a3-b4b70ff7c6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.554587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51629ee-a4ac-46f5-b3a3-b4b70ff7c6b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.554868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51629ee-a4ac-46f5-b3a3-b4b70ff7c6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.555147 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51629ee-a4ac-46f5-b3a3-b4b70ff7c6b9 admin admin] PATH_INFO: `/v3/projects/dc579756fb9d470c926ac598b53481fd/users/81b47ae63ed146b18025ae0afb327e08/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.557174 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51629ee-a4ac-46f5-b3a3-b4b70ff7c6b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc579756fb9d470c926ac598b53481fd, user_id=81b47ae63ed146b18025ae0afb327e08, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.559295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fe931-79ca-41a7-8559-25c883eca9d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85b81b627cd4f2aa79c0c3b4eedcbfb, user_id=436dd31a139c47019f4958a5b68e0941, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.559845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51629ee-a4ac-46f5-b3a3-b4b70ff7c6b9 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.562102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fe931-79ca-41a7-8559-25c883eca9d7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.571809 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1209/2405] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:58 2022] PUT /identity/v3/projects/dc579756fb9d470c926ac598b53481fd/users/81b47ae63ed146b18025ae0afb327e08/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:58.583992 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb83ee-2a98-4bdc-a435-1ba8e32b32fa None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.584286 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb83ee-2a98-4bdc-a435-1ba8e32b32fa None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.584565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb83ee-2a98-4bdc-a435-1ba8e32b32fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.604254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:58.613138 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-edfb83ee-2a98-4bdc-a435-1ba8e32b32fa None None] MFA Rules not processed for user `81b47ae63ed146b18025ae0afb327e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:58.614529 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-edfb83ee-2a98-4bdc-a435-1ba8e32b32fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:58.631919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1197/2406] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:58 2022] PUT /identity/v3/projects/d85b81b627cd4f2aa79c0c3b4eedcbfb/users/436dd31a139c47019f4958a5b68e0941/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:58.636094 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fe931-79ca-41a7-8559-25c883eca9d7 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.683703 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1210/2407] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:58.696730 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb83ee-2a98-4bdc-a435-1ba8e32b32fa None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.698092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-edfb83ee-2a98-4bdc-a435-1ba8e32b32fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:58.703022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fe931-79ca-41a7-8559-25c883eca9d7 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.708846 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65c24a-aec7-49a9-ab78-66d3ae181769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.709441 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65c24a-aec7-49a9-ab78-66d3ae181769 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.709765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65c24a-aec7-49a9-ab78-66d3ae181769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.710072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65c24a-aec7-49a9-ab78-66d3ae181769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.710821 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65c24a-aec7-49a9-ab78-66d3ae181769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.712444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65c24a-aec7-49a9-ab78-66d3ae181769 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.723386 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1198/2408] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:58.727616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65c24a-aec7-49a9-ab78-66d3ae181769 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.737585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65c24a-aec7-49a9-ab78-66d3ae181769 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.742812 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657d620-488e-4011-b328-150908f7b955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.743473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657d620-488e-4011-b328-150908f7b955 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.744965 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657d620-488e-4011-b328-150908f7b955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.744965 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657d620-488e-4011-b328-150908f7b955 admin admin] PATH_INFO: `/v3/projects/d85b81b627cd4f2aa79c0c3b4eedcbfb/users/436dd31a139c47019f4958a5b68e0941/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.746032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657d620-488e-4011-b328-150908f7b955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85b81b627cd4f2aa79c0c3b4eedcbfb, user_id=436dd31a139c47019f4958a5b68e0941, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.748742 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657d620-488e-4011-b328-150908f7b955 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.757539 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb83ee-2a98-4bdc-a435-1ba8e32b32fa None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.759480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1199/2409] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:58 2022] PUT /identity/v3/projects/d85b81b627cd4f2aa79c0c3b4eedcbfb/users/436dd31a139c47019f4958a5b68e0941/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:58.771456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff9697-feec-4f00-8db4-e5ffb88d7202 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.771737 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff9697-feec-4f00-8db4-e5ffb88d7202 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.772007 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff9697-feec-4f00-8db4-e5ffb88d7202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.800680 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6dff9697-feec-4f00-8db4-e5ffb88d7202 None None] MFA Rules not processed for user `436dd31a139c47019f4958a5b68e0941`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:58.801981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6dff9697-feec-4f00-8db4-e5ffb88d7202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:58.811642 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028dcfce-44c3-4722-9289-1faf6164fa94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.812294 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028dcfce-44c3-4722-9289-1faf6164fa94 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.812583 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028dcfce-44c3-4722-9289-1faf6164fa94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.812866 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028dcfce-44c3-4722-9289-1faf6164fa94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.874447 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1200/2410] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:38:58 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:58.874866 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028dcfce-44c3-4722-9289-1faf6164fa94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.876352 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028dcfce-44c3-4722-9289-1faf6164fa94 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.882188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:58.886033 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff9697-feec-4f00-8db4-e5ffb88d7202 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.887143 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1211/2411] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:38:58.887532 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6dff9697-feec-4f00-8db4-e5ffb88d7202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:58.896478 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:58.901164 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff9697-feec-4f00-8db4-e5ffb88d7202 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.904304 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fd31d-4179-4b2e-8508-5160f25e89c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.905100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fd31d-4179-4b2e-8508-5160f25e89c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.905386 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fd31d-4179-4b2e-8508-5160f25e89c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.905703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fd31d-4179-4b2e-8508-5160f25e89c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.915470 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fd31d-4179-4b2e-8508-5160f25e89c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.916901 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fd31d-4179-4b2e-8508-5160f25e89c4 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.926576 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1201/2412] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:58 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:38:59.299407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028dcfce-44c3-4722-9289-1faf6164fa94 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:59.310780 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028dcfce-44c3-4722-9289-1faf6164fa94 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:59.316993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cc995-87bf-436c-b25c-d155487ed29b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:59.318164 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cc995-87bf-436c-b25c-d155487ed29b service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:59.323349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cc995-87bf-436c-b25c-d155487ed29b service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:59.323349 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cc995-87bf-436c-b25c-d155487ed29b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:59.377125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cc995-87bf-436c-b25c-d155487ed29b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:59.379336 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cc995-87bf-436c-b25c-d155487ed29b service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:59.388428 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1212/2413] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:59 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:59.570704 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fd31d-4179-4b2e-8508-5160f25e89c4 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:59.572152 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-581fd31d-4179-4b2e-8508-5160f25e89c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:59.631697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fd31d-4179-4b2e-8508-5160f25e89c4 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:59.635616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066b845-2ff7-4974-a719-f193a5b9aa12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:59.636208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066b845-2ff7-4974-a719-f193a5b9aa12 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:59.636485 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066b845-2ff7-4974-a719-f193a5b9aa12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:59.636753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066b845-2ff7-4974-a719-f193a5b9aa12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:59.638520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e066b845-2ff7-4974-a719-f193a5b9aa12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:59.704694 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066b845-2ff7-4974-a719-f193a5b9aa12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:59.706367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066b845-2ff7-4974-a719-f193a5b9aa12 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:59.716700 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1202/2414] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:59.994676 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cc995-87bf-436c-b25c-d155487ed29b service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:00.005812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cc995-87bf-436c-b25c-d155487ed29b service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:00.012084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c787fd-c904-4ef9-8a1c-5ef35f2acc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:00.012735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c787fd-c904-4ef9-8a1c-5ef35f2acc58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:00.013017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c787fd-c904-4ef9-8a1c-5ef35f2acc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:00.013295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c787fd-c904-4ef9-8a1c-5ef35f2acc58 admin admin] PATH_INFO: `/v3/users/12ff407a6e474c439fd18eb2acc4dc0c` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:00.014498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c787fd-c904-4ef9-8a1c-5ef35f2acc58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ff407a6e474c439fd18eb2acc4dc0c)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:00.016517 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c787fd-c904-4ef9-8a1c-5ef35f2acc58 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:00.321712 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-68c787fd-c904-4ef9-8a1c-5ef35f2acc58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ff407a6e474c439fd18eb2acc4dc0c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:00.324008 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-68c787fd-c904-4ef9-8a1c-5ef35f2acc58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ff407a6e474c439fd18eb2acc4dc0c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:00.392193 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-68c787fd-c904-4ef9-8a1c-5ef35f2acc58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ff407a6e474c439fd18eb2acc4dc0c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:00.400894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-68c787fd-c904-4ef9-8a1c-5ef35f2acc58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ff407a6e474c439fd18eb2acc4dc0c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:00.413220 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-68c787fd-c904-4ef9-8a1c-5ef35f2acc58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ff407a6e474c439fd18eb2acc4dc0c'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:00.419446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1213/2415] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:59 2022] DELETE /identity/v3/users/12ff407a6e474c439fd18eb2acc4dc0c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:00.423923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874ca29-4c03-4d8e-a293-e102bc9175a7 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:00.424212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874ca29-4c03-4d8e-a293-e102bc9175a7 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:00.424518 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874ca29-4c03-4d8e-a293-e102bc9175a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:00.444656 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1874ca29-4c03-4d8e-a293-e102bc9175a7 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:00.445962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1874ca29-4c03-4d8e-a293-e102bc9175a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:00.506641 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1203/2416] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:00.516359 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c787fd-c904-4ef9-8a1c-5ef35f2acc58 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:00.517886 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-68c787fd-c904-4ef9-8a1c-5ef35f2acc58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:00.578277 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c787fd-c904-4ef9-8a1c-5ef35f2acc58 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:00.582860 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe069193-f078-4a1c-b634-ed597f0de72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:00.585388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe069193-f078-4a1c-b634-ed597f0de72e service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:00.585388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe069193-f078-4a1c-b634-ed597f0de72e service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:00.585388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe069193-f078-4a1c-b634-ed597f0de72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:00.593169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe069193-f078-4a1c-b634-ed597f0de72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:00.594629 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe069193-f078-4a1c-b634-ed597f0de72e service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:00.604311 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1214/2417] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:01.023157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874ca29-4c03-4d8e-a293-e102bc9175a7 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:01.025320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1874ca29-4c03-4d8e-a293-e102bc9175a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:01.050574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874ca29-4c03-4d8e-a293-e102bc9175a7 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:01.056169 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24e6fd-be5e-47f1-8359-69b626bef839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:01.056843 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24e6fd-be5e-47f1-8359-69b626bef839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:01.057126 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24e6fd-be5e-47f1-8359-69b626bef839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:01.057402 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24e6fd-be5e-47f1-8359-69b626bef839 admin admin] PATH_INFO: `/v3/projects/f7ffe89dd42d4fc09790973f9e5370ca` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:01.058773 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24e6fd-be5e-47f1-8359-69b626bef839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ffe89dd42d4fc09790973f9e5370ca)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:01.060731 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24e6fd-be5e-47f1-8359-69b626bef839 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:01.187552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:01.200395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ae24e6fd-be5e-47f1-8359-69b626bef839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ffe89dd42d4fc09790973f9e5370ca', 'request_id': 'req-ae24e6fd-be5e-47f1-8359-69b626bef839'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.297505 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ae24e6fd-be5e-47f1-8359-69b626bef839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ffe89dd42d4fc09790973f9e5370ca', 'request_id': 'req-ae24e6fd-be5e-47f1-8359-69b626bef839'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.307131 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ae24e6fd-be5e-47f1-8359-69b626bef839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ffe89dd42d4fc09790973f9e5370ca', 'request_id': 'req-ae24e6fd-be5e-47f1-8359-69b626bef839'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.319066 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ae24e6fd-be5e-47f1-8359-69b626bef839 admin admin] The token cache is being invalidate because project f7ffe89dd42d4fc09790973f9e5370ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:01.319545 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ae24e6fd-be5e-47f1-8359-69b626bef839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.320304 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ae24e6fd-be5e-47f1-8359-69b626bef839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.322316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1204/2418] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:01 2022] DELETE /identity/v3/projects/f7ffe89dd42d4fc09790973f9e5370ca => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:01.326251 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe069193-f078-4a1c-b634-ed597f0de72e service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:01.336739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe069193-f078-4a1c-b634-ed597f0de72e service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:01.351316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:01.405938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a66729-804c-462d-b3d7-fb96801cce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:01.406626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a66729-804c-462d-b3d7-fb96801cce50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:01.407138 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a66729-804c-462d-b3d7-fb96801cce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:01.407510 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a66729-804c-462d-b3d7-fb96801cce50 admin admin] PATH_INFO: `/v3/users/81b47ae63ed146b18025ae0afb327e08` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:01.409847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a66729-804c-462d-b3d7-fb96801cce50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81b47ae63ed146b18025ae0afb327e08)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:01.412078 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a66729-804c-462d-b3d7-fb96801cce50 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:01.629224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f6a66729-804c-462d-b3d7-fb96801cce50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81b47ae63ed146b18025ae0afb327e08'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.630051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f6a66729-804c-462d-b3d7-fb96801cce50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81b47ae63ed146b18025ae0afb327e08'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.718678 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f6a66729-804c-462d-b3d7-fb96801cce50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81b47ae63ed146b18025ae0afb327e08'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.734426 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f6a66729-804c-462d-b3d7-fb96801cce50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81b47ae63ed146b18025ae0afb327e08'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.752313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f6a66729-804c-462d-b3d7-fb96801cce50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81b47ae63ed146b18025ae0afb327e08'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.762749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1215/2419] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:01 2022] DELETE /identity/v3/users/81b47ae63ed146b18025ae0afb327e08 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:02.411995 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24e6fd-be5e-47f1-8359-69b626bef839 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:02.414196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ae24e6fd-be5e-47f1-8359-69b626bef839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:02.450325 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24e6fd-be5e-47f1-8359-69b626bef839 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:02.545104 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bfd27-88e9-4ded-9aec-a183559ed2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:02.545882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bfd27-88e9-4ded-9aec-a183559ed2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:02.546266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bfd27-88e9-4ded-9aec-a183559ed2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:02.546614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bfd27-88e9-4ded-9aec-a183559ed2b2 admin admin] PATH_INFO: `/v3/projects/dc579756fb9d470c926ac598b53481fd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:02.547892 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bfd27-88e9-4ded-9aec-a183559ed2b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc579756fb9d470c926ac598b53481fd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:02.550620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bfd27-88e9-4ded-9aec-a183559ed2b2 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:02.686351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f55bfd27-88e9-4ded-9aec-a183559ed2b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc579756fb9d470c926ac598b53481fd', 'request_id': 'req-f55bfd27-88e9-4ded-9aec-a183559ed2b2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:02.787362 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f55bfd27-88e9-4ded-9aec-a183559ed2b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc579756fb9d470c926ac598b53481fd', 'request_id': 'req-f55bfd27-88e9-4ded-9aec-a183559ed2b2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:02.805809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f55bfd27-88e9-4ded-9aec-a183559ed2b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc579756fb9d470c926ac598b53481fd', 'request_id': 'req-f55bfd27-88e9-4ded-9aec-a183559ed2b2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:02.822597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f55bfd27-88e9-4ded-9aec-a183559ed2b2 admin admin] The token cache is being invalidate because project dc579756fb9d470c926ac598b53481fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:02.823014 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f55bfd27-88e9-4ded-9aec-a183559ed2b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:02.826272 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f55bfd27-88e9-4ded-9aec-a183559ed2b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:02.828429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1205/2420] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:02 2022] DELETE /identity/v3/projects/dc579756fb9d470c926ac598b53481fd => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:02.840646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfafbb-0471-43c0-97b8-41373ac745e6 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:02.840646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfafbb-0471-43c0-97b8-41373ac745e6 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:02.840646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfafbb-0471-43c0-97b8-41373ac745e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:02.858628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-09bfafbb-0471-43c0-97b8-41373ac745e6 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:02.860064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-09bfafbb-0471-43c0-97b8-41373ac745e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:02.954786 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1216/2421] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:02.962805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eca347-3763-42e1-b795-d4123f18f8b1 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:02.963509 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eca347-3763-42e1-b795-d4123f18f8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:02.964609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eca347-3763-42e1-b795-d4123f18f8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:02.992754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-24eca347-3763-42e1-b795-d4123f18f8b1 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:02.994466 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-24eca347-3763-42e1-b795-d4123f18f8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:03.008145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1206/2422] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:03.009416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfafbb-0471-43c0-97b8-41373ac745e6 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:03.022757 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfafbb-0471-43c0-97b8-41373ac745e6 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:03.029017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f928be9-06d8-4d53-93c2-846d6bec51d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:03.029961 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f928be9-06d8-4d53-93c2-846d6bec51d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:03.030576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f928be9-06d8-4d53-93c2-846d6bec51d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:03.031030 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f928be9-06d8-4d53-93c2-846d6bec51d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:03.032134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f928be9-06d8-4d53-93c2-846d6bec51d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:03.032630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f928be9-06d8-4d53-93c2-846d6bec51d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:03.035067 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f928be9-06d8-4d53-93c2-846d6bec51d2 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:03.051609 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1217/2423] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:03.056087 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eca347-3763-42e1-b795-d4123f18f8b1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:03.066327 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eca347-3763-42e1-b795-d4123f18f8b1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:03.071101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f940a79-ab5e-403d-a86a-62d2b0358f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:03.071715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f940a79-ab5e-403d-a86a-62d2b0358f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:03.072567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f940a79-ab5e-403d-a86a-62d2b0358f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:03.072567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f940a79-ab5e-403d-a86a-62d2b0358f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:03.072923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f940a79-ab5e-403d-a86a-62d2b0358f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:03.074849 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f940a79-ab5e-403d-a86a-62d2b0358f8f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:03.202473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1207/2424] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:03 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:03.209824 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f928be9-06d8-4d53-93c2-846d6bec51d2 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:03.223810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f928be9-06d8-4d53-93c2-846d6bec51d2 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:03.247058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:03.332183 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2885b-ae3e-483c-88f8-0ee4ec36ca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:03.332918 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2885b-ae3e-483c-88f8-0ee4ec36ca18 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:03.333397 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2885b-ae3e-483c-88f8-0ee4ec36ca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:03.333760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2885b-ae3e-483c-88f8-0ee4ec36ca18 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:03.334498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2885b-ae3e-483c-88f8-0ee4ec36ca18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:03.336500 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2885b-ae3e-483c-88f8-0ee4ec36ca18 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:03.587715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1218/2425] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:03 2022] POST /identity/v3/users => generated 283 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:03.593709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f940a79-ab5e-403d-a86a-62d2b0358f8f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:03.608441 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f940a79-ab5e-403d-a86a-62d2b0358f8f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:03.615751 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9563ec7-a6f0-4b13-a9be-e0b1071cf704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:03.616818 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9563ec7-a6f0-4b13-a9be-e0b1071cf704 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:03.617275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9563ec7-a6f0-4b13-a9be-e0b1071cf704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:03.617779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9563ec7-a6f0-4b13-a9be-e0b1071cf704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:03.619283 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9563ec7-a6f0-4b13-a9be-e0b1071cf704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:03.621123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9563ec7-a6f0-4b13-a9be-e0b1071cf704 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:03.636332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1208/2426] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:03.640175 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2885b-ae3e-483c-88f8-0ee4ec36ca18 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:03.652180 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2885b-ae3e-483c-88f8-0ee4ec36ca18 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:03.660351 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ffbd7-6aef-4f5f-9cf8-b4eb0b30de20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:03.661272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ffbd7-6aef-4f5f-9cf8-b4eb0b30de20 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:03.661782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ffbd7-6aef-4f5f-9cf8-b4eb0b30de20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:03.662556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ffbd7-6aef-4f5f-9cf8-b4eb0b30de20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:03.663506 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ffbd7-6aef-4f5f-9cf8-b4eb0b30de20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:03.665665 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ffbd7-6aef-4f5f-9cf8-b4eb0b30de20 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:03.686556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1219/2427] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:03.688240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9563ec7-a6f0-4b13-a9be-e0b1071cf704 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:03.704535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9563ec7-a6f0-4b13-a9be-e0b1071cf704 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:03.711291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4ed53-4009-457e-ae74-b6fb20e0e21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:03.715808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4ed53-4009-457e-ae74-b6fb20e0e21f admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:03.715808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4ed53-4009-457e-ae74-b6fb20e0e21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:03.715808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4ed53-4009-457e-ae74-b6fb20e0e21f admin admin] PATH_INFO: `/v3/projects/c0d49c6e6dc445128bf28552e19a47cc/users/bab54781bbdd43a18abef30ed9e79419/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:03.735631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:03.740965 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4ed53-4009-457e-ae74-b6fb20e0e21f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d49c6e6dc445128bf28552e19a47cc, user_id=bab54781bbdd43a18abef30ed9e79419, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:03.744165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4ed53-4009-457e-ae74-b6fb20e0e21f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:03.832368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1209/2428] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:03 2022] PUT /identity/v3/projects/c0d49c6e6dc445128bf28552e19a47cc/users/bab54781bbdd43a18abef30ed9e79419/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:03.845231 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0ae42-3e3e-4ca4-ab46-364a6148722a None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:03.846069 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0ae42-3e3e-4ca4-ab46-364a6148722a None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:03.847055 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0ae42-3e3e-4ca4-ab46-364a6148722a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:03.892525 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-4fd0ae42-3e3e-4ca4-ab46-364a6148722a None None] MFA Rules not processed for user `bab54781bbdd43a18abef30ed9e79419`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:03.894911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4fd0ae42-3e3e-4ca4-ab46-364a6148722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:03.972398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1220/2429] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:03.977058 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4ed53-4009-457e-ae74-b6fb20e0e21f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.051361 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4ed53-4009-457e-ae74-b6fb20e0e21f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.056125 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330482a4-74f7-4a77-8130-27fac3df3180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.056756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330482a4-74f7-4a77-8130-27fac3df3180 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.057089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330482a4-74f7-4a77-8130-27fac3df3180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.057353 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330482a4-74f7-4a77-8130-27fac3df3180 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.058683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330482a4-74f7-4a77-8130-27fac3df3180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.060592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330482a4-74f7-4a77-8130-27fac3df3180 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.194901 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1210/2430] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:03 2022] POST /identity/v3/projects => generated 363 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:04.195366 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0ae42-3e3e-4ca4-ab46-364a6148722a None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.207469 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0ae42-3e3e-4ca4-ab46-364a6148722a None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.289088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a16956-6eed-469a-9f02-aa0041a159b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.290620 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a16956-6eed-469a-9f02-aa0041a159b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.291050 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a16956-6eed-469a-9f02-aa0041a159b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.291443 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a16956-6eed-469a-9f02-aa0041a159b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.292515 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a16956-6eed-469a-9f02-aa0041a159b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.294981 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a16956-6eed-469a-9f02-aa0041a159b1 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.392797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1221/2431] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:04 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:04.397400 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330482a4-74f7-4a77-8130-27fac3df3180 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.407942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330482a4-74f7-4a77-8130-27fac3df3180 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.413828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757e8b3-72a4-4336-bd65-b0c4a903ca07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.414481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757e8b3-72a4-4336-bd65-b0c4a903ca07 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.415109 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757e8b3-72a4-4336-bd65-b0c4a903ca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.416080 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757e8b3-72a4-4336-bd65-b0c4a903ca07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.416841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757e8b3-72a4-4336-bd65-b0c4a903ca07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.418697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757e8b3-72a4-4336-bd65-b0c4a903ca07 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.431956 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1211/2432] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:04.436279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a16956-6eed-469a-9f02-aa0041a159b1 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.447010 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a16956-6eed-469a-9f02-aa0041a159b1 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.451680 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480d8e8-4def-4155-bbbc-638acaf793e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.452368 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480d8e8-4def-4155-bbbc-638acaf793e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.452654 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480d8e8-4def-4155-bbbc-638acaf793e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.452932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480d8e8-4def-4155-bbbc-638acaf793e6 admin admin] PATH_INFO: `/v3/projects/46b238e9fb744236a790b0c4ad4e935c/users/8a63c9a04e6f47f080bcbe0f2b56faa5/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.469636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480d8e8-4def-4155-bbbc-638acaf793e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b238e9fb744236a790b0c4ad4e935c, user_id=8a63c9a04e6f47f080bcbe0f2b56faa5, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.473058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480d8e8-4def-4155-bbbc-638acaf793e6 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.475472 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:04.546739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1222/2433] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:04 2022] PUT /identity/v3/projects/46b238e9fb744236a790b0c4ad4e935c/users/8a63c9a04e6f47f080bcbe0f2b56faa5/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:04.551315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757e8b3-72a4-4336-bd65-b0c4a903ca07 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.561588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757e8b3-72a4-4336-bd65-b0c4a903ca07 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.625106 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbbd61-6a49-47dd-add5-23f1c105e380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.625849 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbbd61-6a49-47dd-add5-23f1c105e380 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.626038 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbbd61-6a49-47dd-add5-23f1c105e380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.626514 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbbd61-6a49-47dd-add5-23f1c105e380 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.627255 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbbd61-6a49-47dd-add5-23f1c105e380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.628958 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbbd61-6a49-47dd-add5-23f1c105e380 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.642259 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1212/2434] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:04.646944 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480d8e8-4def-4155-bbbc-638acaf793e6 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.657318 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480d8e8-4def-4155-bbbc-638acaf793e6 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.662955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbbd61-6a49-47dd-add5-23f1c105e380 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.664793 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-94bbbd61-6a49-47dd-add5-23f1c105e380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:04.667990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6f983-034b-42fe-9fdb-76645cc2e18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.669407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6f983-034b-42fe-9fdb-76645cc2e18a admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.669894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6f983-034b-42fe-9fdb-76645cc2e18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.670345 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6f983-034b-42fe-9fdb-76645cc2e18a admin admin] PATH_INFO: `/v3/projects/46b238e9fb744236a790b0c4ad4e935c/users/8a63c9a04e6f47f080bcbe0f2b56faa5/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.672446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6f983-034b-42fe-9fdb-76645cc2e18a admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b238e9fb744236a790b0c4ad4e935c, user_id=8a63c9a04e6f47f080bcbe0f2b56faa5, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.675233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6f983-034b-42fe-9fdb-76645cc2e18a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.680801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbbd61-6a49-47dd-add5-23f1c105e380 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.686690 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1223/2435] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:04 2022] PUT /identity/v3/projects/46b238e9fb744236a790b0c4ad4e935c/users/8a63c9a04e6f47f080bcbe0f2b56faa5/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:04.699692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cea58-52eb-4c52-8067-43ca2d398d8a None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.700061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cea58-52eb-4c52-8067-43ca2d398d8a None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.700409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cea58-52eb-4c52-8067-43ca2d398d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.733956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-356cea58-52eb-4c52-8067-43ca2d398d8a None None] MFA Rules not processed for user `8a63c9a04e6f47f080bcbe0f2b56faa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:04.735282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-356cea58-52eb-4c52-8067-43ca2d398d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:04.752266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75596dc-8aa7-4f5f-824b-2bb49de0e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.752891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75596dc-8aa7-4f5f-824b-2bb49de0e2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.753175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75596dc-8aa7-4f5f-824b-2bb49de0e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.753459 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75596dc-8aa7-4f5f-824b-2bb49de0e2cb admin admin] PATH_INFO: `/v3/users/22fddcc9952a459899e48a93d1d962db` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.754685 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75596dc-8aa7-4f5f-824b-2bb49de0e2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=22fddcc9952a459899e48a93d1d962db)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.757351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75596dc-8aa7-4f5f-824b-2bb49de0e2cb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.759915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:04.821446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1224/2436] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:04 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:04.831796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cea58-52eb-4c52-8067-43ca2d398d8a None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.833724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-356cea58-52eb-4c52-8067-43ca2d398d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:04.908617 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cea58-52eb-4c52-8067-43ca2d398d8a None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.914369 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f01acc-2af6-49b0-a633-617ec4769696 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.915107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f01acc-2af6-49b0-a633-617ec4769696 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.915459 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f01acc-2af6-49b0-a633-617ec4769696 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.915805 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f01acc-2af6-49b0-a633-617ec4769696 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.930951 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f01acc-2af6-49b0-a633-617ec4769696 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.930951 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f01acc-2af6-49b0-a633-617ec4769696 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.940989 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1225/2437] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:04 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:04.976843 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e75596dc-8aa7-4f5f-824b-2bb49de0e2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22fddcc9952a459899e48a93d1d962db'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:04.977644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e75596dc-8aa7-4f5f-824b-2bb49de0e2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22fddcc9952a459899e48a93d1d962db'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:05.102234 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e75596dc-8aa7-4f5f-824b-2bb49de0e2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22fddcc9952a459899e48a93d1d962db'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:05.142139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e75596dc-8aa7-4f5f-824b-2bb49de0e2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22fddcc9952a459899e48a93d1d962db'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:05.147964 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e75596dc-8aa7-4f5f-824b-2bb49de0e2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22fddcc9952a459899e48a93d1d962db'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:05.208358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1213/2438] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:04 2022] DELETE /identity/v3/users/22fddcc9952a459899e48a93d1d962db => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:05.545772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f01acc-2af6-49b0-a633-617ec4769696 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:05.569198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f01acc-2af6-49b0-a633-617ec4769696 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:05.685815 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6376959-4317-4fcf-9778-25e9ac8fcf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:05.690623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6376959-4317-4fcf-9778-25e9ac8fcf62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:05.690623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6376959-4317-4fcf-9778-25e9ac8fcf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:05.690623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6376959-4317-4fcf-9778-25e9ac8fcf62 admin admin] PATH_INFO: `/v3/projects/d6e54a77d2aa469b8c0197d99170d978` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:05.690623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6376959-4317-4fcf-9778-25e9ac8fcf62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e54a77d2aa469b8c0197d99170d978)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:05.691144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6376959-4317-4fcf-9778-25e9ac8fcf62 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:05.702760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:05.812548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f6376959-4317-4fcf-9778-25e9ac8fcf62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e54a77d2aa469b8c0197d99170d978', 'request_id': 'req-f6376959-4317-4fcf-9778-25e9ac8fcf62'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:05.879812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f6376959-4317-4fcf-9778-25e9ac8fcf62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e54a77d2aa469b8c0197d99170d978', 'request_id': 'req-f6376959-4317-4fcf-9778-25e9ac8fcf62'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:05.895932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f6376959-4317-4fcf-9778-25e9ac8fcf62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e54a77d2aa469b8c0197d99170d978', 'request_id': 'req-f6376959-4317-4fcf-9778-25e9ac8fcf62'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:05.914435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f6376959-4317-4fcf-9778-25e9ac8fcf62 admin admin] The token cache is being invalidate because project d6e54a77d2aa469b8c0197d99170d978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:05.915423 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f6376959-4317-4fcf-9778-25e9ac8fcf62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:05.916361 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f6376959-4317-4fcf-9778-25e9ac8fcf62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:05.927438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1226/2439] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:05 2022] DELETE /identity/v3/projects/d6e54a77d2aa469b8c0197d99170d978 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:05.929308 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39a6e5-c420-4c26-949d-ccf19776da34 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:05.931959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39a6e5-c420-4c26-949d-ccf19776da34 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:05.935046 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39a6e5-c420-4c26-949d-ccf19776da34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:05.993867 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-cd39a6e5-c420-4c26-949d-ccf19776da34 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:05.995889 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cd39a6e5-c420-4c26-949d-ccf19776da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:06.132725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1214/2440] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:06.146316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a59b-0dae-49b2-b1e2-7627c0a3928e None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:06.146316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a59b-0dae-49b2-b1e2-7627c0a3928e None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:06.146316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a59b-0dae-49b2-b1e2-7627c0a3928e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:06.172496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-fb18a59b-0dae-49b2-b1e2-7627c0a3928e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:06.173772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-fb18a59b-0dae-49b2-b1e2-7627c0a3928e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:06.195563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1227/2441] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:06.199898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39a6e5-c420-4c26-949d-ccf19776da34 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:06.215879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39a6e5-c420-4c26-949d-ccf19776da34 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:06.228755 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defd984-8406-48f9-974a-ce4e43bd1a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:06.229422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defd984-8406-48f9-974a-ce4e43bd1a62 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:06.229799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defd984-8406-48f9-974a-ce4e43bd1a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:06.230018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defd984-8406-48f9-974a-ce4e43bd1a62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:06.231833 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defd984-8406-48f9-974a-ce4e43bd1a62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:06.232137 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defd984-8406-48f9-974a-ce4e43bd1a62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:06.233935 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defd984-8406-48f9-974a-ce4e43bd1a62 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:06.258117 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18a59b-0dae-49b2-b1e2-7627c0a3928e None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:06.272970 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1215/2442] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:39:06.276140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18a59b-0dae-49b2-b1e2-7627c0a3928e None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:06.302246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaddad5-f53c-4af8-9aca-588a78182f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:06.302246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaddad5-f53c-4af8-9aca-588a78182f56 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:06.302246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaddad5-f53c-4af8-9aca-588a78182f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:06.302246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaddad5-f53c-4af8-9aca-588a78182f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:06.302652 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defd984-8406-48f9-974a-ce4e43bd1a62 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:06.302652 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8defd984-8406-48f9-974a-ce4e43bd1a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:06.303519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaddad5-f53c-4af8-9aca-588a78182f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:06.311891 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaddad5-f53c-4af8-9aca-588a78182f56 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:06.328721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defd984-8406-48f9-974a-ce4e43bd1a62 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:06.340526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5d866-61d2-48bb-9d9a-dedde1d05754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:06.341301 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5d866-61d2-48bb-9d9a-dedde1d05754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:06.341494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5d866-61d2-48bb-9d9a-dedde1d05754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:06.341884 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5d866-61d2-48bb-9d9a-dedde1d05754 admin admin] PATH_INFO: `/v3/users/bab54781bbdd43a18abef30ed9e79419` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:06.343235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5d866-61d2-48bb-9d9a-dedde1d05754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab54781bbdd43a18abef30ed9e79419)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:06.346125 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5d866-61d2-48bb-9d9a-dedde1d05754 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:06.468817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1228/2443] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:06 2022] POST /identity/v3/projects => generated 355 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:06.474700 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaddad5-f53c-4af8-9aca-588a78182f56 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:06.548213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaddad5-f53c-4af8-9aca-588a78182f56 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:06.554763 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae9ed5-ca1a-4d5f-a394-568474fc000a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:06.557698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae9ed5-ca1a-4d5f-a394-568474fc000a admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:06.557698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae9ed5-ca1a-4d5f-a394-568474fc000a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:06.557698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae9ed5-ca1a-4d5f-a394-568474fc000a admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:06.557698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae9ed5-ca1a-4d5f-a394-568474fc000a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:06.559421 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae9ed5-ca1a-4d5f-a394-568474fc000a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:06.579502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8fb5d866-61d2-48bb-9d9a-dedde1d05754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab54781bbdd43a18abef30ed9e79419'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:06.580198 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8fb5d866-61d2-48bb-9d9a-dedde1d05754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab54781bbdd43a18abef30ed9e79419'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:06.662724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8fb5d866-61d2-48bb-9d9a-dedde1d05754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab54781bbdd43a18abef30ed9e79419'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:06.672778 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1229/2444] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:06 2022] POST /identity/v3/users => generated 278 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:06.673213 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:06.673819 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae9ed5-ca1a-4d5f-a394-568474fc000a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:06.676823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-24ae9ed5-ca1a-4d5f-a394-568474fc000a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:06.682126 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8fb5d866-61d2-48bb-9d9a-dedde1d05754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab54781bbdd43a18abef30ed9e79419'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:06.682825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8fb5d866-61d2-48bb-9d9a-dedde1d05754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab54781bbdd43a18abef30ed9e79419'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:06.691068 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae9ed5-ca1a-4d5f-a394-568474fc000a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:06.696044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c69ab-a1a4-481f-85ec-5e2b78f43a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:06.700890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1216/2445] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:06 2022] DELETE /identity/v3/users/bab54781bbdd43a18abef30ed9e79419 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:06.701017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c69ab-a1a4-481f-85ec-5e2b78f43a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:06.701017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c69ab-a1a4-481f-85ec-5e2b78f43a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:06.701017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c69ab-a1a4-481f-85ec-5e2b78f43a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:06.701017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c69ab-a1a4-481f-85ec-5e2b78f43a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:06.701017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c69ab-a1a4-481f-85ec-5e2b78f43a00 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:06.704175 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271235-8812-4fbf-9499-b5dac595d6cc None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:06.704333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271235-8812-4fbf-9499-b5dac595d6cc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:06.704615 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271235-8812-4fbf-9499-b5dac595d6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:06.717786 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1230/2446] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:06.722490 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c69ab-a1a4-481f-85ec-5e2b78f43a00 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:06.732932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c69ab-a1a4-481f-85ec-5e2b78f43a00 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:06.738150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3e271235-8812-4fbf-9499-b5dac595d6cc None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:06.739426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3e271235-8812-4fbf-9499-b5dac595d6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:06.790993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:06.805460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95724614-16c4-4ae4-a28d-047bcfe2d460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:06.806131 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95724614-16c4-4ae4-a28d-047bcfe2d460 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:06.806416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95724614-16c4-4ae4-a28d-047bcfe2d460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:06.806694 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95724614-16c4-4ae4-a28d-047bcfe2d460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:06.807389 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95724614-16c4-4ae4-a28d-047bcfe2d460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:06.809025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95724614-16c4-4ae4-a28d-047bcfe2d460 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:06.814718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1217/2447] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:06.820002 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1231/2448] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:06.824288 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e271235-8812-4fbf-9499-b5dac595d6cc None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:06.825391 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95724614-16c4-4ae4-a28d-047bcfe2d460 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:06.827253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-95724614-16c4-4ae4-a28d-047bcfe2d460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:06.835879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e271235-8812-4fbf-9499-b5dac595d6cc None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:06.840475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483162c-8c22-4e17-8e36-65e9320c8f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:06.841142 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483162c-8c22-4e17-8e36-65e9320c8f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:06.841462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483162c-8c22-4e17-8e36-65e9320c8f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:06.841873 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483162c-8c22-4e17-8e36-65e9320c8f55 admin admin] PATH_INFO: `/v3/projects/095f6b9f1a3841eea4de0c1dd06879f5/users/44282c98deae417fbfc7a62c8ad6ad1c/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:06.857707 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483162c-8c22-4e17-8e36-65e9320c8f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=095f6b9f1a3841eea4de0c1dd06879f5, user_id=44282c98deae417fbfc7a62c8ad6ad1c, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:06.860479 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483162c-8c22-4e17-8e36-65e9320c8f55 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:06.889484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95724614-16c4-4ae4-a28d-047bcfe2d460 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:06.893991 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0e422-ccdc-458e-85aa-09cafec19131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:06.894917 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0e422-ccdc-458e-85aa-09cafec19131 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:06.895181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0e422-ccdc-458e-85aa-09cafec19131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:06.895459 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0e422-ccdc-458e-85aa-09cafec19131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:06.904615 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0e422-ccdc-458e-85aa-09cafec19131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:06.906070 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0e422-ccdc-458e-85aa-09cafec19131 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:06.916160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1232/2449] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:07.001695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1218/2450] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:06 2022] PUT /identity/v3/projects/095f6b9f1a3841eea4de0c1dd06879f5/users/44282c98deae417fbfc7a62c8ad6ad1c/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:07.014520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b071e-0c3c-4dab-a5ae-e42805c88721 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:07.015019 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b071e-0c3c-4dab-a5ae-e42805c88721 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:07.016240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b071e-0c3c-4dab-a5ae-e42805c88721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:07.053488 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-853b071e-0c3c-4dab-a5ae-e42805c88721 None None] MFA Rules not processed for user `44282c98deae417fbfc7a62c8ad6ad1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:07.053488 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-853b071e-0c3c-4dab-a5ae-e42805c88721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:07.124331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1233/2451] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:07 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:07.129540 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483162c-8c22-4e17-8e36-65e9320c8f55 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:07.219364 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483162c-8c22-4e17-8e36-65e9320c8f55 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:07.224878 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cee34-c267-45a8-8c3b-0971440e94e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:07.225537 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cee34-c267-45a8-8c3b-0971440e94e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:07.225818 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cee34-c267-45a8-8c3b-0971440e94e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:07.226094 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cee34-c267-45a8-8c3b-0971440e94e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:07.226768 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cee34-c267-45a8-8c3b-0971440e94e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:07.228666 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cee34-c267-45a8-8c3b-0971440e94e6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:07.327359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1219/2452] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:07 2022] POST /identity/v3/projects => generated 355 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:07.332224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b071e-0c3c-4dab-a5ae-e42805c88721 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:07.343209 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b071e-0c3c-4dab-a5ae-e42805c88721 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:07.403087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254938b-9d13-445b-a62f-76a578367bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:07.403087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254938b-9d13-445b-a62f-76a578367bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:07.403087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254938b-9d13-445b-a62f-76a578367bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:07.403087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254938b-9d13-445b-a62f-76a578367bb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:07.403641 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254938b-9d13-445b-a62f-76a578367bb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:07.403975 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cee34-c267-45a8-8c3b-0971440e94e6 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:07.404708 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254938b-9d13-445b-a62f-76a578367bb8 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:07.406067 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-719cee34-c267-45a8-8c3b-0971440e94e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:07.421772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cee34-c267-45a8-8c3b-0971440e94e6 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:07.430505 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b96415-7b9b-40bf-b614-ace346b61fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:07.430505 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b96415-7b9b-40bf-b614-ace346b61fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:07.430505 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b96415-7b9b-40bf-b614-ace346b61fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:07.430505 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b96415-7b9b-40bf-b614-ace346b61fe5 admin admin] PATH_INFO: `/v3/projects/c0d49c6e6dc445128bf28552e19a47cc` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:07.431404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b96415-7b9b-40bf-b614-ace346b61fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d49c6e6dc445128bf28552e19a47cc)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:07.432734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b96415-7b9b-40bf-b614-ace346b61fe5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:07.511925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1234/2453] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:07 2022] POST /identity/v3/users => generated 284 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:07.515785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254938b-9d13-445b-a62f-76a578367bb8 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:07.526069 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254938b-9d13-445b-a62f-76a578367bb8 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:07.530699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6a195-50d4-4d9c-bcef-99326f1d3a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:07.531285 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6a195-50d4-4d9c-bcef-99326f1d3a3a admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:07.531571 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6a195-50d4-4d9c-bcef-99326f1d3a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:07.531850 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6a195-50d4-4d9c-bcef-99326f1d3a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:07.532540 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6a195-50d4-4d9c-bcef-99326f1d3a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:07.534383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6a195-50d4-4d9c-bcef-99326f1d3a3a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:07.545162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1235/2454] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:07.550000 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6a195-50d4-4d9c-bcef-99326f1d3a3a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:07.557295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-50b96415-7b9b-40bf-b614-ace346b61fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d49c6e6dc445128bf28552e19a47cc', 'request_id': 'req-50b96415-7b9b-40bf-b614-ace346b61fe5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.560289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6a195-50d4-4d9c-bcef-99326f1d3a3a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:07.617334 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada71e1-f50e-4b20-b6cd-78beabf872cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:07.618105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada71e1-f50e-4b20-b6cd-78beabf872cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:07.618395 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada71e1-f50e-4b20-b6cd-78beabf872cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:07.618704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada71e1-f50e-4b20-b6cd-78beabf872cf admin admin] PATH_INFO: `/v3/projects/7948518b29224f92a75c938be1488a64/users/3d0c4329d45840d3b349682aad052f01/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:07.620635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-50b96415-7b9b-40bf-b614-ace346b61fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d49c6e6dc445128bf28552e19a47cc', 'request_id': 'req-50b96415-7b9b-40bf-b614-ace346b61fe5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.629702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-50b96415-7b9b-40bf-b614-ace346b61fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d49c6e6dc445128bf28552e19a47cc', 'request_id': 'req-50b96415-7b9b-40bf-b614-ace346b61fe5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.633630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada71e1-f50e-4b20-b6cd-78beabf872cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7948518b29224f92a75c938be1488a64, user_id=3d0c4329d45840d3b349682aad052f01, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:07.636357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada71e1-f50e-4b20-b6cd-78beabf872cf admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:07.640434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-50b96415-7b9b-40bf-b614-ace346b61fe5 admin admin] The token cache is being invalidate because project c0d49c6e6dc445128bf28552e19a47cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:07.640800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-50b96415-7b9b-40bf-b614-ace346b61fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.641743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-50b96415-7b9b-40bf-b614-ace346b61fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.643295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1220/2455] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:07 2022] DELETE /identity/v3/projects/c0d49c6e6dc445128bf28552e19a47cc => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:07.652892 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b96415-7b9b-40bf-b614-ace346b61fe5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:07.654253 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-50b96415-7b9b-40bf-b614-ace346b61fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:07.669451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b96415-7b9b-40bf-b614-ace346b61fe5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:07.674973 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f203f3b-0491-43f9-9abc-2ebef1915b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:07.675720 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f203f3b-0491-43f9-9abc-2ebef1915b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:07.676143 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f203f3b-0491-43f9-9abc-2ebef1915b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:07.676500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f203f3b-0491-43f9-9abc-2ebef1915b3d admin admin] PATH_INFO: `/v3/users/8a63c9a04e6f47f080bcbe0f2b56faa5` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:07.678352 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f203f3b-0491-43f9-9abc-2ebef1915b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a63c9a04e6f47f080bcbe0f2b56faa5)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:07.682910 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f203f3b-0491-43f9-9abc-2ebef1915b3d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:07.735034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1236/2456] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:07 2022] PUT /identity/v3/projects/7948518b29224f92a75c938be1488a64/users/3d0c4329d45840d3b349682aad052f01/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:07.739623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada71e1-f50e-4b20-b6cd-78beabf872cf admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:07.741271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-0ada71e1-f50e-4b20-b6cd-78beabf872cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:07.792486 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:07.819348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada71e1-f50e-4b20-b6cd-78beabf872cf admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:07.824602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ebe7c-d4b3-4ca9-bd9c-742e463578c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:07.825230 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ebe7c-d4b3-4ca9-bd9c-742e463578c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:07.825764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ebe7c-d4b3-4ca9-bd9c-742e463578c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:07.826264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ebe7c-d4b3-4ca9-bd9c-742e463578c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:07.828513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ebe7c-d4b3-4ca9-bd9c-742e463578c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:07.830140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ebe7c-d4b3-4ca9-bd9c-742e463578c5 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:07.840216 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1237/2457] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:07.844188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ebe7c-d4b3-4ca9-bd9c-742e463578c5 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:07.854597 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ebe7c-d4b3-4ca9-bd9c-742e463578c5 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:07.859516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985a8b4-a6bc-4cf8-969b-c7c044f64015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:07.860221 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985a8b4-a6bc-4cf8-969b-c7c044f64015 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:07.860505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985a8b4-a6bc-4cf8-969b-c7c044f64015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:07.862587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985a8b4-a6bc-4cf8-969b-c7c044f64015 admin admin] PATH_INFO: `/v3/projects/7948518b29224f92a75c938be1488a64/users/3d0c4329d45840d3b349682aad052f01/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:07.863556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985a8b4-a6bc-4cf8-969b-c7c044f64015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7948518b29224f92a75c938be1488a64, user_id=3d0c4329d45840d3b349682aad052f01, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:07.866317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985a8b4-a6bc-4cf8-969b-c7c044f64015 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:07.867395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4f203f3b-0491-43f9-9abc-2ebef1915b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a63c9a04e6f47f080bcbe0f2b56faa5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.868162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4f203f3b-0491-43f9-9abc-2ebef1915b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a63c9a04e6f47f080bcbe0f2b56faa5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.876456 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1238/2458] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:07 2022] PUT /identity/v3/projects/7948518b29224f92a75c938be1488a64/users/3d0c4329d45840d3b349682aad052f01/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:07.888591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7481b3-2604-4e11-9c49-6eabc709e0d6 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:07.888908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7481b3-2604-4e11-9c49-6eabc709e0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:07.889196 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7481b3-2604-4e11-9c49-6eabc709e0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:07.918935 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-6b7481b3-2604-4e11-9c49-6eabc709e0d6 None None] MFA Rules not processed for user `3d0c4329d45840d3b349682aad052f01`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:07.920230 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6b7481b3-2604-4e11-9c49-6eabc709e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:07.989360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1239/2459] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:07 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:08.000123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4f203f3b-0491-43f9-9abc-2ebef1915b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a63c9a04e6f47f080bcbe0f2b56faa5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:08.000852 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:08.002028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7481b3-2604-4e11-9c49-6eabc709e0d6 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:08.004704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6b7481b3-2604-4e11-9c49-6eabc709e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:08.013709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4f203f3b-0491-43f9-9abc-2ebef1915b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a63c9a04e6f47f080bcbe0f2b56faa5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:08.014395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4f203f3b-0491-43f9-9abc-2ebef1915b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a63c9a04e6f47f080bcbe0f2b56faa5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:08.027334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1221/2460] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:07 2022] DELETE /identity/v3/users/8a63c9a04e6f47f080bcbe0f2b56faa5 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:08.079716 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7481b3-2604-4e11-9c49-6eabc709e0d6 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:08.147526 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40e78c-b1ee-41f7-83dd-369c91cc18b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:08.148155 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40e78c-b1ee-41f7-83dd-369c91cc18b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:08.148440 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40e78c-b1ee-41f7-83dd-369c91cc18b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:08.148749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40e78c-b1ee-41f7-83dd-369c91cc18b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:08.210574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40e78c-b1ee-41f7-83dd-369c91cc18b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:08.212029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40e78c-b1ee-41f7-83dd-369c91cc18b1 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:08.225593 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1240/2461] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:07 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:08.473181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f203f3b-0491-43f9-9abc-2ebef1915b3d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:08.474614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4f203f3b-0491-43f9-9abc-2ebef1915b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:08.485605 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40e78c-b1ee-41f7-83dd-369c91cc18b1 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:08.505222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40e78c-b1ee-41f7-83dd-369c91cc18b1 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:08.515999 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3c9fe-be6b-4400-9dea-c51c4a79d18e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:08.516649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3c9fe-be6b-4400-9dea-c51c4a79d18e service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:08.517044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3c9fe-be6b-4400-9dea-c51c4a79d18e service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:08.517314 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3c9fe-be6b-4400-9dea-c51c4a79d18e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:08.520112 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6ac3c9fe-be6b-4400-9dea-c51c4a79d18e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:08.571139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f203f3b-0491-43f9-9abc-2ebef1915b3d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:08.575844 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9f760-398f-4b85-8f91-743cf9099cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:08.576686 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9f760-398f-4b85-8f91-743cf9099cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:08.578967 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9f760-398f-4b85-8f91-743cf9099cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:08.578967 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9f760-398f-4b85-8f91-743cf9099cdf admin admin] PATH_INFO: `/v3/projects/46b238e9fb744236a790b0c4ad4e935c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:08.578967 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9f760-398f-4b85-8f91-743cf9099cdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=46b238e9fb744236a790b0c4ad4e935c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:08.580341 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9f760-398f-4b85-8f91-743cf9099cdf admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:08.609086 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3c9fe-be6b-4400-9dea-c51c4a79d18e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:08.610904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3c9fe-be6b-4400-9dea-c51c4a79d18e service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:08.620338 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1241/2462] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:08 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:08.706515 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-86a9f760-398f-4b85-8f91-743cf9099cdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46b238e9fb744236a790b0c4ad4e935c', 'request_id': 'req-86a9f760-398f-4b85-8f91-743cf9099cdf'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:08.791620 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-86a9f760-398f-4b85-8f91-743cf9099cdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46b238e9fb744236a790b0c4ad4e935c', 'request_id': 'req-86a9f760-398f-4b85-8f91-743cf9099cdf'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:08.792088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:08.798670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-86a9f760-398f-4b85-8f91-743cf9099cdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46b238e9fb744236a790b0c4ad4e935c', 'request_id': 'req-86a9f760-398f-4b85-8f91-743cf9099cdf'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:08.809064 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-86a9f760-398f-4b85-8f91-743cf9099cdf admin admin] The token cache is being invalidate because project 46b238e9fb744236a790b0c4ad4e935c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:08.809356 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-86a9f760-398f-4b85-8f91-743cf9099cdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:08.810026 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-86a9f760-398f-4b85-8f91-743cf9099cdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:08.811640 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1222/2463] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:08 2022] DELETE /identity/v3/projects/46b238e9fb744236a790b0c4ad4e935c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:08.817354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114d3ee-4347-4ae7-a018-e69254272965 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:08.817810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114d3ee-4347-4ae7-a018-e69254272965 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:08.818115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114d3ee-4347-4ae7-a018-e69254272965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:08.837906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-7114d3ee-4347-4ae7-a018-e69254272965 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:08.839113 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7114d3ee-4347-4ae7-a018-e69254272965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:08.898284 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1242/2464] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:08.906189 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93006280-d722-4645-90e6-1b93556a9449 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:08.906576 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93006280-d722-4645-90e6-1b93556a9449 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:08.906924 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93006280-d722-4645-90e6-1b93556a9449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:08.927725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-93006280-d722-4645-90e6-1b93556a9449 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:08.929026 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-93006280-d722-4645-90e6-1b93556a9449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:08.938594 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1223/2465] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:08.943716 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114d3ee-4347-4ae7-a018-e69254272965 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:08.958659 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114d3ee-4347-4ae7-a018-e69254272965 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:08.965662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4f7ae-f9f0-4c5e-bb1d-d6f03749b89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:08.966630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4f7ae-f9f0-4c5e-bb1d-d6f03749b89f admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:08.967106 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4f7ae-f9f0-4c5e-bb1d-d6f03749b89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:08.967560 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4f7ae-f9f0-4c5e-bb1d-d6f03749b89f admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:08.968727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4f7ae-f9f0-4c5e-bb1d-d6f03749b89f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:08.969237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4f7ae-f9f0-4c5e-bb1d-d6f03749b89f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:08.969532 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:08.972240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4f7ae-f9f0-4c5e-bb1d-d6f03749b89f admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:08.992483 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1243/2466] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:08.996939 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93006280-d722-4645-90e6-1b93556a9449 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:09.006763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93006280-d722-4645-90e6-1b93556a9449 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:09.011418 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911610f-82b6-4533-9ea0-f9b919716748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:09.012003 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911610f-82b6-4533-9ea0-f9b919716748 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.012282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911610f-82b6-4533-9ea0-f9b919716748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.012556 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911610f-82b6-4533-9ea0-f9b919716748 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.013230 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911610f-82b6-4533-9ea0-f9b919716748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:09.015150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911610f-82b6-4533-9ea0-f9b919716748 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:09.125723 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1224/2467] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:08 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:09.130870 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4f7ae-f9f0-4c5e-bb1d-d6f03749b89f admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:09.144163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4f7ae-f9f0-4c5e-bb1d-d6f03749b89f admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:09.212213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c49d92-4423-4243-8699-6fa39c067d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:09.212844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c49d92-4423-4243-8699-6fa39c067d7c admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.213127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c49d92-4423-4243-8699-6fa39c067d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.213400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c49d92-4423-4243-8699-6fa39c067d7c admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.214100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c49d92-4423-4243-8699-6fa39c067d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:09.216318 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c49d92-4423-4243-8699-6fa39c067d7c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:09.347990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:09.354185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1244/2468] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:09 2022] POST /identity/v3/users => generated 284 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:09.358500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911610f-82b6-4533-9ea0-f9b919716748 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:09.369085 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911610f-82b6-4533-9ea0-f9b919716748 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:09.373792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016c3c3-4768-40f4-8041-ae18cffa08ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:09.374414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c3c3-4768-40f4-8041-ae18cffa08ec admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.374696 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c3c3-4768-40f4-8041-ae18cffa08ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.374975 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c3c3-4768-40f4-8041-ae18cffa08ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.375731 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016c3c3-4768-40f4-8041-ae18cffa08ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:09.377873 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016c3c3-4768-40f4-8041-ae18cffa08ec admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:09.388006 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1225/2469] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:09.392206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c49d92-4423-4243-8699-6fa39c067d7c admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:09.403221 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c49d92-4423-4243-8699-6fa39c067d7c admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:09.407846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17ab7e-4fcc-4092-a9af-01e1db40fd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:09.408455 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17ab7e-4fcc-4092-a9af-01e1db40fd14 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.408845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17ab7e-4fcc-4092-a9af-01e1db40fd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.409246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17ab7e-4fcc-4092-a9af-01e1db40fd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.409982 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17ab7e-4fcc-4092-a9af-01e1db40fd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:09.411567 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17ab7e-4fcc-4092-a9af-01e1db40fd14 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:09.421389 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1245/2470] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:09.425425 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016c3c3-4768-40f4-8041-ae18cffa08ec admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:09.435575 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016c3c3-4768-40f4-8041-ae18cffa08ec admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:09.440695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf329f42-665e-4071-9a95-8042e31b25a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:09.446560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf329f42-665e-4071-9a95-8042e31b25a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.446560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf329f42-665e-4071-9a95-8042e31b25a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.446560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf329f42-665e-4071-9a95-8042e31b25a7 admin admin] PATH_INFO: `/v3/projects/7d2df9afed5846f693fe578d8ba2b9aa/users/50581fa56a5244078111eaa895a7fc69/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.457134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf329f42-665e-4071-9a95-8042e31b25a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2df9afed5846f693fe578d8ba2b9aa, user_id=50581fa56a5244078111eaa895a7fc69, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:09.459879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf329f42-665e-4071-9a95-8042e31b25a7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:09.542770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1226/2471] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:09 2022] PUT /identity/v3/projects/7d2df9afed5846f693fe578d8ba2b9aa/users/50581fa56a5244078111eaa895a7fc69/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:09.554554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a5348-8a7a-4e3f-9f83-3a64868a2698 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.554845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a5348-8a7a-4e3f-9f83-3a64868a2698 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.555147 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a5348-8a7a-4e3f-9f83-3a64868a2698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.590122 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-ad3a5348-8a7a-4e3f-9f83-3a64868a2698 None None] MFA Rules not processed for user `50581fa56a5244078111eaa895a7fc69`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:09.591466 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ad3a5348-8a7a-4e3f-9f83-3a64868a2698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:09.651726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:09.672682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1246/2472] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:09.677895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf329f42-665e-4071-9a95-8042e31b25a7 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:09.747227 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf329f42-665e-4071-9a95-8042e31b25a7 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:09.752190 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4218c7-77de-48fd-abab-e4c70d811bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:09.753840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4218c7-77de-48fd-abab-e4c70d811bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.754127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4218c7-77de-48fd-abab-e4c70d811bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.754408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4218c7-77de-48fd-abab-e4c70d811bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.755096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4218c7-77de-48fd-abab-e4c70d811bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:09.756999 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4218c7-77de-48fd-abab-e4c70d811bc2 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:09.846752 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1227/2473] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:09 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:09.850863 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a5348-8a7a-4e3f-9f83-3a64868a2698 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:09.863087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a5348-8a7a-4e3f-9f83-3a64868a2698 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:09.919612 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56996d8-e863-4910-bbd9-99e49b457460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:09.920232 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56996d8-e863-4910-bbd9-99e49b457460 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.920516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56996d8-e863-4910-bbd9-99e49b457460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.920793 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56996d8-e863-4910-bbd9-99e49b457460 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.921518 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56996d8-e863-4910-bbd9-99e49b457460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:09.923432 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56996d8-e863-4910-bbd9-99e49b457460 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:10.020230 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1247/2474] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:09 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:10.024193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4218c7-77de-48fd-abab-e4c70d811bc2 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:10.034955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4218c7-77de-48fd-abab-e4c70d811bc2 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:10.040377 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dd3b1-8541-49cf-a0d4-0109d93a4c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:10.041072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dd3b1-8541-49cf-a0d4-0109d93a4c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:10.041489 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dd3b1-8541-49cf-a0d4-0109d93a4c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:10.041894 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dd3b1-8541-49cf-a0d4-0109d93a4c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:10.042652 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295dd3b1-8541-49cf-a0d4-0109d93a4c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:10.044258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295dd3b1-8541-49cf-a0d4-0109d93a4c75 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:10.056038 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1228/2475] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:10.060348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56996d8-e863-4910-bbd9-99e49b457460 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:10.071515 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56996d8-e863-4910-bbd9-99e49b457460 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:10.076245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b5d98-b0f9-4262-a3ca-c8695f8d3247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:10.076940 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5d98-b0f9-4262-a3ca-c8695f8d3247 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:10.077225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5d98-b0f9-4262-a3ca-c8695f8d3247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:10.077528 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5d98-b0f9-4262-a3ca-c8695f8d3247 admin admin] PATH_INFO: `/v3/projects/5ce8b2d2dae24f2b96831ad8875aca50/users/43a10983330e452cbc553b2c06674089/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:10.092360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b5d98-b0f9-4262-a3ca-c8695f8d3247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ce8b2d2dae24f2b96831ad8875aca50, user_id=43a10983330e452cbc553b2c06674089, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:10.095103 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b5d98-b0f9-4262-a3ca-c8695f8d3247 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:10.180979 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1248/2476] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:10 2022] PUT /identity/v3/projects/5ce8b2d2dae24f2b96831ad8875aca50/users/43a10983330e452cbc553b2c06674089/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:10.181796 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dd3b1-8541-49cf-a0d4-0109d93a4c75 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:10.192629 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dd3b1-8541-49cf-a0d4-0109d93a4c75 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:10.227404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:10.251679 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2a296-3594-4cef-a517-f81641b00775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:10.253156 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2a296-3594-4cef-a517-f81641b00775 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:10.253500 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2a296-3594-4cef-a517-f81641b00775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:10.254779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2a296-3594-4cef-a517-f81641b00775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:10.255182 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2a296-3594-4cef-a517-f81641b00775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:10.256982 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2a296-3594-4cef-a517-f81641b00775 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:10.269630 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1229/2477] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:10.274355 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b5d98-b0f9-4262-a3ca-c8695f8d3247 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:10.286165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b5d98-b0f9-4262-a3ca-c8695f8d3247 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:10.289701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2a296-3594-4cef-a517-f81641b00775 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:10.291320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad889bf8-f8a3-45b0-8c26-993886d437ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:10.292004 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad889bf8-f8a3-45b0-8c26-993886d437ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:10.292286 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad889bf8-f8a3-45b0-8c26-993886d437ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:10.292615 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad889bf8-f8a3-45b0-8c26-993886d437ed admin admin] PATH_INFO: `/v3/projects/5ce8b2d2dae24f2b96831ad8875aca50/users/43a10983330e452cbc553b2c06674089/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:10.292839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a6b2a296-3594-4cef-a517-f81641b00775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:10.294915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad889bf8-f8a3-45b0-8c26-993886d437ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ce8b2d2dae24f2b96831ad8875aca50, user_id=43a10983330e452cbc553b2c06674089, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:10.297888 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad889bf8-f8a3-45b0-8c26-993886d437ed admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:10.308808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2a296-3594-4cef-a517-f81641b00775 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:10.311328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1249/2478] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:10 2022] PUT /identity/v3/projects/5ce8b2d2dae24f2b96831ad8875aca50/users/43a10983330e452cbc553b2c06674089/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:10.314768 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad889bf8-f8a3-45b0-8c26-993886d437ed admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:10.317187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ad889bf8-f8a3-45b0-8c26-993886d437ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:10.370777 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9244f3-29cf-43a4-991f-a7ce65ee0999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:10.371434 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9244f3-29cf-43a4-991f-a7ce65ee0999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:10.371718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9244f3-29cf-43a4-991f-a7ce65ee0999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:10.371995 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9244f3-29cf-43a4-991f-a7ce65ee0999 admin admin] PATH_INFO: `/v3/users/d2cc0410e40344519702122387f22308` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:10.373179 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9244f3-29cf-43a4-991f-a7ce65ee0999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2cc0410e40344519702122387f22308)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:10.375137 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9244f3-29cf-43a4-991f-a7ce65ee0999 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:10.383723 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad889bf8-f8a3-45b0-8c26-993886d437ed admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:10.388494 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077e11a-104d-4cd0-a75c-363bb45a9c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:10.389137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077e11a-104d-4cd0-a75c-363bb45a9c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:10.389416 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077e11a-104d-4cd0-a75c-363bb45a9c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:10.389721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077e11a-104d-4cd0-a75c-363bb45a9c4f admin admin] PATH_INFO: `/v3/users/50e87db3ff6c477890ef1bf61225f8af` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:10.390893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077e11a-104d-4cd0-a75c-363bb45a9c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=50e87db3ff6c477890ef1bf61225f8af)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:10.392785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077e11a-104d-4cd0-a75c-363bb45a9c4f admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:10.621801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-bb9244f3-29cf-43a4-991f-a7ce65ee0999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2cc0410e40344519702122387f22308'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:10.622455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-bb9244f3-29cf-43a4-991f-a7ce65ee0999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2cc0410e40344519702122387f22308'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:10.652242 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:10.657137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5077e11a-104d-4cd0-a75c-363bb45a9c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50e87db3ff6c477890ef1bf61225f8af'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:10.657857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5077e11a-104d-4cd0-a75c-363bb45a9c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50e87db3ff6c477890ef1bf61225f8af'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:10.742498 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-bb9244f3-29cf-43a4-991f-a7ce65ee0999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2cc0410e40344519702122387f22308'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:10.755067 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-bb9244f3-29cf-43a4-991f-a7ce65ee0999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2cc0410e40344519702122387f22308'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:10.756821 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-bb9244f3-29cf-43a4-991f-a7ce65ee0999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2cc0410e40344519702122387f22308'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:10.769030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1230/2479] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:10 2022] DELETE /identity/v3/users/d2cc0410e40344519702122387f22308 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:10.770442 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4599cc-f050-4b54-b471-2c7eb315a33d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:10.770794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4599cc-f050-4b54-b471-2c7eb315a33d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:10.771130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4599cc-f050-4b54-b471-2c7eb315a33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:10.801801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8b4599cc-f050-4b54-b471-2c7eb315a33d None None] MFA Rules not processed for user `43a10983330e452cbc553b2c06674089`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:10.802997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8b4599cc-f050-4b54-b471-2c7eb315a33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:10.834148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5077e11a-104d-4cd0-a75c-363bb45a9c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50e87db3ff6c477890ef1bf61225f8af'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:10.843445 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5077e11a-104d-4cd0-a75c-363bb45a9c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50e87db3ff6c477890ef1bf61225f8af'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:10.853035 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:10.858505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5077e11a-104d-4cd0-a75c-363bb45a9c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50e87db3ff6c477890ef1bf61225f8af'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:10.865560 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1250/2480] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:10 2022] DELETE /identity/v3/users/50e87db3ff6c477890ef1bf61225f8af => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:10.870033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646f69a-e992-4f5a-b953-10973074010a None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:10.870313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646f69a-e992-4f5a-b953-10973074010a None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:10.871720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646f69a-e992-4f5a-b953-10973074010a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:10.884480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1231/2481] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:10 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:10.887524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36439e74-9425-4658-96e3-c3b561c62039 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:10.888102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36439e74-9425-4658-96e3-c3b561c62039 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:10.888552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36439e74-9425-4658-96e3-c3b561c62039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:10.898906 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-f646f69a-e992-4f5a-b953-10973074010a None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:10.900484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f646f69a-e992-4f5a-b953-10973074010a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:10.909874 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-36439e74-9425-4658-96e3-c3b561c62039 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:10.911094 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-36439e74-9425-4658-96e3-c3b561c62039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:10.972606 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1251/2482] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:10.974503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646f69a-e992-4f5a-b953-10973074010a None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:10.976255 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1232/2483] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:10.978140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f646f69a-e992-4f5a-b953-10973074010a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:10.982791 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36439e74-9425-4658-96e3-c3b561c62039 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:10.984128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-36439e74-9425-4658-96e3-c3b561c62039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:11.035877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646f69a-e992-4f5a-b953-10973074010a None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:11.040014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdedfbb-ebfa-4f25-8da3-ae4c0be9ac42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:11.040646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdedfbb-ebfa-4f25-8da3-ae4c0be9ac42 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:11.040930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdedfbb-ebfa-4f25-8da3-ae4c0be9ac42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:11.041206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdedfbb-ebfa-4f25-8da3-ae4c0be9ac42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:11.042329 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36439e74-9425-4658-96e3-c3b561c62039 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:11.046431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae372c5-cdee-4cdf-aaa2-a8d9c6c48f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:11.047157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae372c5-cdee-4cdf-aaa2-a8d9c6c48f67 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:11.047477 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae372c5-cdee-4cdf-aaa2-a8d9c6c48f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:11.053801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae372c5-cdee-4cdf-aaa2-a8d9c6c48f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:11.059166 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae372c5-cdee-4cdf-aaa2-a8d9c6c48f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:11.060750 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae372c5-cdee-4cdf-aaa2-a8d9c6c48f67 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:11.074116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1233/2484] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:11.075236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae372c5-cdee-4cdf-aaa2-a8d9c6c48f67 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:11.076675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6ae372c5-cdee-4cdf-aaa2-a8d9c6c48f67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:11.089122 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae372c5-cdee-4cdf-aaa2-a8d9c6c48f67 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:11.093353 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86492ac8-b73d-4202-82e9-d1640fd3148b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:11.094012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86492ac8-b73d-4202-82e9-d1640fd3148b service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:11.094298 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86492ac8-b73d-4202-82e9-d1640fd3148b service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:11.095174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86492ac8-b73d-4202-82e9-d1640fd3148b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:11.107004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86492ac8-b73d-4202-82e9-d1640fd3148b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:11.107594 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdedfbb-ebfa-4f25-8da3-ae4c0be9ac42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:11.111047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86492ac8-b73d-4202-82e9-d1640fd3148b service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:11.111166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdedfbb-ebfa-4f25-8da3-ae4c0be9ac42 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:11.120012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1252/2485] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:11.121288 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1234/2486] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:11.667095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdedfbb-ebfa-4f25-8da3-ae4c0be9ac42 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:11.668621 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2cdedfbb-ebfa-4f25-8da3-ae4c0be9ac42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:11.672992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86492ac8-b73d-4202-82e9-d1640fd3148b service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:11.676672 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-86492ac8-b73d-4202-82e9-d1640fd3148b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:11.707359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86492ac8-b73d-4202-82e9-d1640fd3148b service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:11.710794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdedfbb-ebfa-4f25-8da3-ae4c0be9ac42 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:11.719614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b864b-7623-4ec0-ab56-54de1d94f381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:11.721697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b864b-7623-4ec0-ab56-54de1d94f381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:11.725165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b864b-7623-4ec0-ab56-54de1d94f381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:11.725165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b864b-7623-4ec0-ab56-54de1d94f381 admin admin] PATH_INFO: `/v3/projects/226b04e0e5374eb296132aadb784ed64` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:11.725404 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacac149-84ae-49de-87f7-cd7ed20887c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:11.726153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b864b-7623-4ec0-ab56-54de1d94f381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=226b04e0e5374eb296132aadb784ed64)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:11.726888 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacac149-84ae-49de-87f7-cd7ed20887c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:11.729347 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b864b-7623-4ec0-ab56-54de1d94f381 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:11.729967 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacac149-84ae-49de-87f7-cd7ed20887c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:11.730091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacac149-84ae-49de-87f7-cd7ed20887c2 admin admin] PATH_INFO: `/v3/projects/4be0c332586444a38d41a2fd446f52db` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:11.732616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacac149-84ae-49de-87f7-cd7ed20887c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be0c332586444a38d41a2fd446f52db)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:11.734894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacac149-84ae-49de-87f7-cd7ed20887c2 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:11.744890 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:11.928195 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-eacac149-84ae-49de-87f7-cd7ed20887c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be0c332586444a38d41a2fd446f52db', 'request_id': 'req-eacac149-84ae-49de-87f7-cd7ed20887c2'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:11.932879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4c7b864b-7623-4ec0-ab56-54de1d94f381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226b04e0e5374eb296132aadb784ed64', 'request_id': 'req-4c7b864b-7623-4ec0-ab56-54de1d94f381'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.005606 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-eacac149-84ae-49de-87f7-cd7ed20887c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be0c332586444a38d41a2fd446f52db', 'request_id': 'req-eacac149-84ae-49de-87f7-cd7ed20887c2'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.015876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-eacac149-84ae-49de-87f7-cd7ed20887c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be0c332586444a38d41a2fd446f52db', 'request_id': 'req-eacac149-84ae-49de-87f7-cd7ed20887c2'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.028425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-eacac149-84ae-49de-87f7-cd7ed20887c2 admin admin] The token cache is being invalidate because project 4be0c332586444a38d41a2fd446f52db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:12.028720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-eacac149-84ae-49de-87f7-cd7ed20887c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.029379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-eacac149-84ae-49de-87f7-cd7ed20887c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.030922 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1253/2487] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:11 2022] DELETE /identity/v3/projects/4be0c332586444a38d41a2fd446f52db => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:12.035700 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacac149-84ae-49de-87f7-cd7ed20887c2 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:12.037926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-eacac149-84ae-49de-87f7-cd7ed20887c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:12.097718 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4c7b864b-7623-4ec0-ab56-54de1d94f381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226b04e0e5374eb296132aadb784ed64', 'request_id': 'req-4c7b864b-7623-4ec0-ab56-54de1d94f381'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.105001 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4c7b864b-7623-4ec0-ab56-54de1d94f381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226b04e0e5374eb296132aadb784ed64', 'request_id': 'req-4c7b864b-7623-4ec0-ab56-54de1d94f381'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.107167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:12.110233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacac149-84ae-49de-87f7-cd7ed20887c2 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:12.117965 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4c7b864b-7623-4ec0-ab56-54de1d94f381 admin admin] The token cache is being invalidate because project 226b04e0e5374eb296132aadb784ed64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:12.118676 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4c7b864b-7623-4ec0-ab56-54de1d94f381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.120847 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4c7b864b-7623-4ec0-ab56-54de1d94f381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.123363 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1235/2488] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:11 2022] DELETE /identity/v3/projects/226b04e0e5374eb296132aadb784ed64 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:12.130325 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931cf15-bae8-4aca-b063-2e03df6319ab None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:12.134309 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931cf15-bae8-4aca-b063-2e03df6319ab None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:12.134309 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931cf15-bae8-4aca-b063-2e03df6319ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:12.156746 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e931cf15-bae8-4aca-b063-2e03df6319ab None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:12.158097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e931cf15-bae8-4aca-b063-2e03df6319ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:12.178268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95d95d-2d8d-4071-a33a-fea2b05cb991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:12.179125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95d95d-2d8d-4071-a33a-fea2b05cb991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:12.179250 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95d95d-2d8d-4071-a33a-fea2b05cb991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:12.179483 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95d95d-2d8d-4071-a33a-fea2b05cb991 admin admin] PATH_INFO: `/v3/users/436dd31a139c47019f4958a5b68e0941` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:12.180662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95d95d-2d8d-4071-a33a-fea2b05cb991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=436dd31a139c47019f4958a5b68e0941)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:12.186714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95d95d-2d8d-4071-a33a-fea2b05cb991 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:12.240853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1236/2489] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:12.248588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0680a1-b498-4b35-b365-37b8235fb322 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:12.248876 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0680a1-b498-4b35-b365-37b8235fb322 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:12.249232 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0680a1-b498-4b35-b365-37b8235fb322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:12.272679 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-0c0680a1-b498-4b35-b365-37b8235fb322 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:12.274054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0c0680a1-b498-4b35-b365-37b8235fb322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:12.285061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1237/2490] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:12.289201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0680a1-b498-4b35-b365-37b8235fb322 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:12.306126 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0680a1-b498-4b35-b365-37b8235fb322 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:12.314192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c897eda-ba94-45b9-9bb7-aa691697629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:12.315577 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c897eda-ba94-45b9-9bb7-aa691697629c admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:12.317047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c897eda-ba94-45b9-9bb7-aa691697629c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:12.317333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c897eda-ba94-45b9-9bb7-aa691697629c admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:12.320018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c897eda-ba94-45b9-9bb7-aa691697629c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:12.320018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c897eda-ba94-45b9-9bb7-aa691697629c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:12.320222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c897eda-ba94-45b9-9bb7-aa691697629c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:12.334193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1238/2491] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:12.339903 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c897eda-ba94-45b9-9bb7-aa691697629c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:12.351553 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c897eda-ba94-45b9-9bb7-aa691697629c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:12.356677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9099aa5-3269-4288-b237-c1e11469dab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:12.357311 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9099aa5-3269-4288-b237-c1e11469dab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:12.357661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9099aa5-3269-4288-b237-c1e11469dab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:12.357943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9099aa5-3269-4288-b237-c1e11469dab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:12.358623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9099aa5-3269-4288-b237-c1e11469dab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:12.360562 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9099aa5-3269-4288-b237-c1e11469dab5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:12.430644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-0d95d95d-2d8d-4071-a33a-fea2b05cb991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436dd31a139c47019f4958a5b68e0941'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.431962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-0d95d95d-2d8d-4071-a33a-fea2b05cb991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436dd31a139c47019f4958a5b68e0941'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.481091 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1239/2492] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:12 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:12.489376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9099aa5-3269-4288-b237-c1e11469dab5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:12.491170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e9099aa5-3269-4288-b237-c1e11469dab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:12.506604 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-0d95d95d-2d8d-4071-a33a-fea2b05cb991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436dd31a139c47019f4958a5b68e0941'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.514098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-0d95d95d-2d8d-4071-a33a-fea2b05cb991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436dd31a139c47019f4958a5b68e0941'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.527821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-0d95d95d-2d8d-4071-a33a-fea2b05cb991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436dd31a139c47019f4958a5b68e0941'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.546435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1254/2493] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:12 2022] DELETE /identity/v3/users/436dd31a139c47019f4958a5b68e0941 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:12.557550 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9099aa5-3269-4288-b237-c1e11469dab5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:12.628140 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b0a95-0ccb-4249-9913-f209262a99d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:12.628957 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b0a95-0ccb-4249-9913-f209262a99d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:12.629310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b0a95-0ccb-4249-9913-f209262a99d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:12.631580 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b0a95-0ccb-4249-9913-f209262a99d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:12.632414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b0a95-0ccb-4249-9913-f209262a99d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:12.635970 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b0a95-0ccb-4249-9913-f209262a99d9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:12.757631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1240/2494] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:12 2022] POST /identity/v3/users => generated 287 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:12.758995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95d95d-2d8d-4071-a33a-fea2b05cb991 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:12.770503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95d95d-2d8d-4071-a33a-fea2b05cb991 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:12.775157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3280a1-4dd3-47f2-9a89-37ad5d7fbe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:12.775773 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3280a1-4dd3-47f2-9a89-37ad5d7fbe15 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:12.776055 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3280a1-4dd3-47f2-9a89-37ad5d7fbe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:12.776332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3280a1-4dd3-47f2-9a89-37ad5d7fbe15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:12.777024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3280a1-4dd3-47f2-9a89-37ad5d7fbe15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:12.778718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3280a1-4dd3-47f2-9a89-37ad5d7fbe15 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:12.794775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1255/2495] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:12.803088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b0a95-0ccb-4249-9913-f209262a99d9 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:12.818860 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b0a95-0ccb-4249-9913-f209262a99d9 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:12.824633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a65cfc-f9b4-48e5-b626-dda851530870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:12.832019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65cfc-f9b4-48e5-b626-dda851530870 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:12.832019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65cfc-f9b4-48e5-b626-dda851530870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:12.832019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65cfc-f9b4-48e5-b626-dda851530870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:12.832019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a65cfc-f9b4-48e5-b626-dda851530870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:12.832019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a65cfc-f9b4-48e5-b626-dda851530870 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:12.839184 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1241/2496] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:12.843632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3280a1-4dd3-47f2-9a89-37ad5d7fbe15 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:12.856044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3280a1-4dd3-47f2-9a89-37ad5d7fbe15 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:12.861260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c251462-f61b-4a0f-8b47-b0f9f430aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:12.862681 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c251462-f61b-4a0f-8b47-b0f9f430aad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:12.862967 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c251462-f61b-4a0f-8b47-b0f9f430aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:12.863275 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c251462-f61b-4a0f-8b47-b0f9f430aad6 admin admin] PATH_INFO: `/v3/projects/3a7b04666e2d49e5be742673ed21dde8/users/cf3353e334df4fd394746a283b408c3e/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:12.879953 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c251462-f61b-4a0f-8b47-b0f9f430aad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7b04666e2d49e5be742673ed21dde8, user_id=cf3353e334df4fd394746a283b408c3e, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:12.883056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c251462-f61b-4a0f-8b47-b0f9f430aad6 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:12.981977 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1256/2497] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:12 2022] PUT /identity/v3/projects/3a7b04666e2d49e5be742673ed21dde8/users/cf3353e334df4fd394746a283b408c3e/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:12.993229 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd03004-a013-4aae-a188-86b772d573bb None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:12.993542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd03004-a013-4aae-a188-86b772d573bb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:12.993825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd03004-a013-4aae-a188-86b772d573bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:13.025443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-acd03004-a013-4aae-a188-86b772d573bb None None] MFA Rules not processed for user `cf3353e334df4fd394746a283b408c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:13.026775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-acd03004-a013-4aae-a188-86b772d573bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:13.056185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c251462-f61b-4a0f-8b47-b0f9f430aad6 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:13.058799 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-0c251462-f61b-4a0f-8b47-b0f9f430aad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:13.110530 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1242/2498] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:13.115758 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd03004-a013-4aae-a188-86b772d573bb None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:13.117156 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-acd03004-a013-4aae-a188-86b772d573bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:13.152130 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c251462-f61b-4a0f-8b47-b0f9f430aad6 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:13.157364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93290f8a-236f-4733-a278-b9817043bb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:13.158050 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93290f8a-236f-4733-a278-b9817043bb52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:13.158328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93290f8a-236f-4733-a278-b9817043bb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:13.158968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93290f8a-236f-4733-a278-b9817043bb52 admin admin] PATH_INFO: `/v3/projects/d85b81b627cd4f2aa79c0c3b4eedcbfb` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:13.160508 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93290f8a-236f-4733-a278-b9817043bb52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85b81b627cd4f2aa79c0c3b4eedcbfb)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:13.162439 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93290f8a-236f-4733-a278-b9817043bb52 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:13.185349 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd03004-a013-4aae-a188-86b772d573bb None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:13.189448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b689f-21fd-49eb-9895-3f093dcd2a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:13.190987 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b689f-21fd-49eb-9895-3f093dcd2a51 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:13.191256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b689f-21fd-49eb-9895-3f093dcd2a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:13.191527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b689f-21fd-49eb-9895-3f093dcd2a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:13.200186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b689f-21fd-49eb-9895-3f093dcd2a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:13.201728 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b689f-21fd-49eb-9895-3f093dcd2a51 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:13.219270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1243/2499] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:13.239154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcd24e-c2a1-436b-a7dc-f83cdd6b24c1 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:13.239448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcd24e-c2a1-436b-a7dc-f83cdd6b24c1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:13.239733 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcd24e-c2a1-436b-a7dc-f83cdd6b24c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:13.259819 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9afcd24e-c2a1-436b-a7dc-f83cdd6b24c1 None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:13.261110 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9afcd24e-c2a1-436b-a7dc-f83cdd6b24c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:13.313564 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:13.322296 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1244/2500] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jul 28 05:39:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:13.347839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-93290f8a-236f-4733-a278-b9817043bb52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85b81b627cd4f2aa79c0c3b4eedcbfb', 'request_id': 'req-93290f8a-236f-4733-a278-b9817043bb52'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:13.445303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-93290f8a-236f-4733-a278-b9817043bb52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85b81b627cd4f2aa79c0c3b4eedcbfb', 'request_id': 'req-93290f8a-236f-4733-a278-b9817043bb52'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:13.454705 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-93290f8a-236f-4733-a278-b9817043bb52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85b81b627cd4f2aa79c0c3b4eedcbfb', 'request_id': 'req-93290f8a-236f-4733-a278-b9817043bb52'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:13.456025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcd24e-c2a1-436b-a7dc-f83cdd6b24c1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:13.457662 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9afcd24e-c2a1-436b-a7dc-f83cdd6b24c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:13.466519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-93290f8a-236f-4733-a278-b9817043bb52 admin admin] The token cache is being invalidate because project d85b81b627cd4f2aa79c0c3b4eedcbfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:13.466810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-93290f8a-236f-4733-a278-b9817043bb52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:13.467553 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-93290f8a-236f-4733-a278-b9817043bb52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:13.469005 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1257/2501] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:13 2022] DELETE /identity/v3/projects/d85b81b627cd4f2aa79c0c3b4eedcbfb => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:13.473907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e241c7-f41e-404e-a5eb-f49168cf0fda None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:13.474378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e241c7-f41e-404e-a5eb-f49168cf0fda None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:13.474711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e241c7-f41e-404e-a5eb-f49168cf0fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:13.494679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-94e241c7-f41e-404e-a5eb-f49168cf0fda None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:13.496031 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-94e241c7-f41e-404e-a5eb-f49168cf0fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:13.529157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcd24e-c2a1-436b-a7dc-f83cdd6b24c1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:13.562861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1258/2502] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:13.572646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7bd76-c665-4acc-b795-d2d195398502 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:13.575769 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7bd76-c665-4acc-b795-d2d195398502 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:13.575769 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7bd76-c665-4acc-b795-d2d195398502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:13.594186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-53f7bd76-c665-4acc-b795-d2d195398502 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:13.595413 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-53f7bd76-c665-4acc-b795-d2d195398502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:13.603826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa144bc3-6291-410f-8607-ef12fb7322db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:13.603826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa144bc3-6291-410f-8607-ef12fb7322db service swift] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:13.603826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa144bc3-6291-410f-8607-ef12fb7322db service swift] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:13.603826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa144bc3-6291-410f-8607-ef12fb7322db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:13.604425 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1259/2503] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:13.605374 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fa144bc3-6291-410f-8607-ef12fb7322db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:13.608979 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7bd76-c665-4acc-b795-d2d195398502 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:13.619173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7bd76-c665-4acc-b795-d2d195398502 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:13.633110 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f13edc-e012-4aec-9047-635d4d11fa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:13.633882 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f13edc-e012-4aec-9047-635d4d11fa87 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:13.634231 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f13edc-e012-4aec-9047-635d4d11fa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:13.634577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f13edc-e012-4aec-9047-635d4d11fa87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:13.635570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f13edc-e012-4aec-9047-635d4d11fa87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:13.636295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f13edc-e012-4aec-9047-635d4d11fa87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:13.637964 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f13edc-e012-4aec-9047-635d4d11fa87 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:13.647629 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:13.654550 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1260/2504] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:13.659403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f13edc-e012-4aec-9047-635d4d11fa87 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:13.670209 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f13edc-e012-4aec-9047-635d4d11fa87 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:13.683788 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa144bc3-6291-410f-8607-ef12fb7322db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:13.685708 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa144bc3-6291-410f-8607-ef12fb7322db service swift] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:13.690867 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87da767-a8b6-4936-b315-2c9e88d9dbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:13.691020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87da767-a8b6-4936-b315-2c9e88d9dbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:13.691265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87da767-a8b6-4936-b315-2c9e88d9dbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:13.691541 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87da767-a8b6-4936-b315-2c9e88d9dbc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:13.693093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87da767-a8b6-4936-b315-2c9e88d9dbc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:13.694143 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87da767-a8b6-4936-b315-2c9e88d9dbc5 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:13.696637 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1245/2505] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:39:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:39:13.827951 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1261/2506] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:13 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:13.832829 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa144bc3-6291-410f-8607-ef12fb7322db service swift] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:13.845002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa144bc3-6291-410f-8607-ef12fb7322db service swift] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:13.917373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c7d86-5bcc-43e2-99e5-b58d7fdc1492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:13.918069 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c7d86-5bcc-43e2-99e5-b58d7fdc1492 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:13.918355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c7d86-5bcc-43e2-99e5-b58d7fdc1492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:13.918634 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c7d86-5bcc-43e2-99e5-b58d7fdc1492 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:13.919315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c7d86-5bcc-43e2-99e5-b58d7fdc1492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:13.921438 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c7d86-5bcc-43e2-99e5-b58d7fdc1492 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:14.030384 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1246/2507] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:13 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:14.035333 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87da767-a8b6-4936-b315-2c9e88d9dbc5 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:14.048877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87da767-a8b6-4936-b315-2c9e88d9dbc5 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:14.055132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26057bd-4138-48b7-838f-52ef0119c465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:14.056041 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26057bd-4138-48b7-838f-52ef0119c465 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:14.056329 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26057bd-4138-48b7-838f-52ef0119c465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:14.056867 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26057bd-4138-48b7-838f-52ef0119c465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:14.057315 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26057bd-4138-48b7-838f-52ef0119c465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:14.060150 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26057bd-4138-48b7-838f-52ef0119c465 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:14.078634 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c7d86-5bcc-43e2-99e5-b58d7fdc1492 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:14.079327 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1262/2508] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:14.094109 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c7d86-5bcc-43e2-99e5-b58d7fdc1492 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:14.098488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d063ff6-49c5-4cfe-99b9-3dff034f24bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:14.099146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d063ff6-49c5-4cfe-99b9-3dff034f24bc admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:14.099424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d063ff6-49c5-4cfe-99b9-3dff034f24bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:14.099699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d063ff6-49c5-4cfe-99b9-3dff034f24bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:14.100582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d063ff6-49c5-4cfe-99b9-3dff034f24bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:14.102394 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d063ff6-49c5-4cfe-99b9-3dff034f24bc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:14.116398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1247/2509] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:14.128124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26057bd-4138-48b7-838f-52ef0119c465 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:14.139127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26057bd-4138-48b7-838f-52ef0119c465 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:14.147734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b8ff7-f914-4ccf-9e85-96186f115d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:14.147734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b8ff7-f914-4ccf-9e85-96186f115d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:14.147734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b8ff7-f914-4ccf-9e85-96186f115d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:14.147734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b8ff7-f914-4ccf-9e85-96186f115d5c admin admin] PATH_INFO: `/v3/projects/f3ed6b9e03624381930c138a9e350e37/users/7123e6463027485da771714743609e5b/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:14.165910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b8ff7-f914-4ccf-9e85-96186f115d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ed6b9e03624381930c138a9e350e37, user_id=7123e6463027485da771714743609e5b, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:14.169207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b8ff7-f914-4ccf-9e85-96186f115d5c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:14.277622 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1263/2510] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:14 2022] PUT /identity/v3/projects/f3ed6b9e03624381930c138a9e350e37/users/7123e6463027485da771714743609e5b/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:14.288762 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf21e3-bdba-4e3a-b80f-c2aac30ebb4a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:14.289055 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf21e3-bdba-4e3a-b80f-c2aac30ebb4a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:14.289344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf21e3-bdba-4e3a-b80f-c2aac30ebb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:14.318798 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d4cf21e3-bdba-4e3a-b80f-c2aac30ebb4a None None] MFA Rules not processed for user `7123e6463027485da771714743609e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:14.320040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d4cf21e3-bdba-4e3a-b80f-c2aac30ebb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:14.391269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1248/2511] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:14.396899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b8ff7-f914-4ccf-9e85-96186f115d5c admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:14.467657 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b8ff7-f914-4ccf-9e85-96186f115d5c admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:14.473213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39295a85-0611-42fd-b546-f492c49ee77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:14.473868 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39295a85-0611-42fd-b546-f492c49ee77c admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:14.474157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39295a85-0611-42fd-b546-f492c49ee77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:14.474439 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39295a85-0611-42fd-b546-f492c49ee77c admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:14.475108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39295a85-0611-42fd-b546-f492c49ee77c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:14.477110 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39295a85-0611-42fd-b546-f492c49ee77c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:14.596879 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1264/2512] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:14 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:14.602576 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf21e3-bdba-4e3a-b80f-c2aac30ebb4a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:14.613272 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf21e3-bdba-4e3a-b80f-c2aac30ebb4a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:14.673957 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2460f2-3c6e-4c9b-a217-db2e8718f83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:14.675223 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2460f2-3c6e-4c9b-a217-db2e8718f83d admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:14.675508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2460f2-3c6e-4c9b-a217-db2e8718f83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:14.676197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2460f2-3c6e-4c9b-a217-db2e8718f83d admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:14.676953 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2460f2-3c6e-4c9b-a217-db2e8718f83d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:14.679219 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2460f2-3c6e-4c9b-a217-db2e8718f83d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:14.714448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:14.806603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1249/2513] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:14 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:14.807576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39295a85-0611-42fd-b546-f492c49ee77c admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:14.824369 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2460f2-3c6e-4c9b-a217-db2e8718f83d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:14.824573 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39295a85-0611-42fd-b546-f492c49ee77c admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:14.827064 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-dd2460f2-3c6e-4c9b-a217-db2e8718f83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:14.831631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a66eb-33f8-4627-bce9-50964a7a7e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:14.832521 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a66eb-33f8-4627-bce9-50964a7a7e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:14.832879 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a66eb-33f8-4627-bce9-50964a7a7e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:14.833305 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a66eb-33f8-4627-bce9-50964a7a7e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:14.833993 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a66eb-33f8-4627-bce9-50964a7a7e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:14.835889 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a66eb-33f8-4627-bce9-50964a7a7e93 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:14.844403 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2460f2-3c6e-4c9b-a217-db2e8718f83d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:14.849202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1265/2514] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:14.853916 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a66eb-33f8-4627-bce9-50964a7a7e93 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:14.854100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f8c41-f466-4a9e-90bb-770b6b5671f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:14.854250 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f8c41-f466-4a9e-90bb-770b6b5671f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:14.854489 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f8c41-f466-4a9e-90bb-770b6b5671f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:14.854770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f8c41-f466-4a9e-90bb-770b6b5671f6 admin admin] PATH_INFO: `/v3/users/50581fa56a5244078111eaa895a7fc69` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:14.855977 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f8c41-f466-4a9e-90bb-770b6b5671f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50581fa56a5244078111eaa895a7fc69)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:14.858009 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f8c41-f466-4a9e-90bb-770b6b5671f6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:14.864334 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a66eb-33f8-4627-bce9-50964a7a7e93 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:14.869168 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b091b-bec7-4b59-b36f-df9956c05185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:14.869952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b091b-bec7-4b59-b36f-df9956c05185 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:14.870303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b091b-bec7-4b59-b36f-df9956c05185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:14.870651 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b091b-bec7-4b59-b36f-df9956c05185 admin admin] PATH_INFO: `/v3/projects/798d380ad823474cbb5e1d1de05bce0e/users/3f238b1f3e284d8286114df54c26b93e/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:14.887237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b091b-bec7-4b59-b36f-df9956c05185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=798d380ad823474cbb5e1d1de05bce0e, user_id=3f238b1f3e284d8286114df54c26b93e, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:14.889998 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b091b-bec7-4b59-b36f-df9956c05185 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:15.009460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1266/2515] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:14 2022] PUT /identity/v3/projects/798d380ad823474cbb5e1d1de05bce0e/users/3f238b1f3e284d8286114df54c26b93e/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:15.013491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b091b-bec7-4b59-b36f-df9956c05185 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:15.076544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b091b-bec7-4b59-b36f-df9956c05185 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:15.081910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db70964-1147-43a3-b126-d5f52e0d39ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:15.082534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db70964-1147-43a3-b126-d5f52e0d39ff admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:15.082818 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db70964-1147-43a3-b126-d5f52e0d39ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:15.083098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db70964-1147-43a3-b126-d5f52e0d39ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:15.083795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db70964-1147-43a3-b126-d5f52e0d39ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:15.085943 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db70964-1147-43a3-b126-d5f52e0d39ff admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:15.104515 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1267/2516] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:15.105689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-a79f8c41-f466-4a9e-90bb-770b6b5671f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50581fa56a5244078111eaa895a7fc69'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:15.105837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db70964-1147-43a3-b126-d5f52e0d39ff admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:15.106739 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-a79f8c41-f466-4a9e-90bb-770b6b5671f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50581fa56a5244078111eaa895a7fc69'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:15.117332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db70964-1147-43a3-b126-d5f52e0d39ff admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:15.122771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5845261-0f59-4c2b-93b6-949767105787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:15.123509 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5845261-0f59-4c2b-93b6-949767105787 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:15.123790 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5845261-0f59-4c2b-93b6-949767105787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:15.124207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5845261-0f59-4c2b-93b6-949767105787 admin admin] PATH_INFO: `/v3/projects/798d380ad823474cbb5e1d1de05bce0e/users/3f238b1f3e284d8286114df54c26b93e/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:15.128368 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5845261-0f59-4c2b-93b6-949767105787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=798d380ad823474cbb5e1d1de05bce0e, user_id=3f238b1f3e284d8286114df54c26b93e, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:15.130060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5845261-0f59-4c2b-93b6-949767105787 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:15.140713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1268/2517] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:15 2022] PUT /identity/v3/projects/798d380ad823474cbb5e1d1de05bce0e/users/3f238b1f3e284d8286114df54c26b93e/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:15.160803 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333905b-7958-4034-86a9-ee3d3f9b76e3 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:15.161097 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333905b-7958-4034-86a9-ee3d3f9b76e3 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:15.161378 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333905b-7958-4034-86a9-ee3d3f9b76e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:15.180211 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-a79f8c41-f466-4a9e-90bb-770b6b5671f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50581fa56a5244078111eaa895a7fc69'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:15.196883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-a79f8c41-f466-4a9e-90bb-770b6b5671f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50581fa56a5244078111eaa895a7fc69'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:15.198295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-a79f8c41-f466-4a9e-90bb-770b6b5671f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50581fa56a5244078111eaa895a7fc69'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:15.204821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e333905b-7958-4034-86a9-ee3d3f9b76e3 None None] MFA Rules not processed for user `3f238b1f3e284d8286114df54c26b93e`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:15.208274 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e333905b-7958-4034-86a9-ee3d3f9b76e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:15.218065 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1250/2518] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:14 2022] DELETE /identity/v3/users/50581fa56a5244078111eaa895a7fc69 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:15.224647 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdd90a-d62d-4145-81db-c3c88929c35f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:15.225219 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdd90a-d62d-4145-81db-c3c88929c35f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:15.225904 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdd90a-d62d-4145-81db-c3c88929c35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:15.254424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9bcdd90a-d62d-4145-81db-c3c88929c35f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:15.256335 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9bcdd90a-d62d-4145-81db-c3c88929c35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:15.274968 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:15.316214 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1269/2519] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:15.324887 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333905b-7958-4034-86a9-ee3d3f9b76e3 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:15.326810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e333905b-7958-4034-86a9-ee3d3f9b76e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:15.348404 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1251/2520] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:15.360004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdd90a-d62d-4145-81db-c3c88929c35f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:15.363776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9bcdd90a-d62d-4145-81db-c3c88929c35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:15.403582 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333905b-7958-4034-86a9-ee3d3f9b76e3 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:15.438790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdd90a-d62d-4145-81db-c3c88929c35f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:15.443249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ce449-6f1a-4327-8a39-a94140725ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:15.443882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ce449-6f1a-4327-8a39-a94140725ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:15.444173 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ce449-6f1a-4327-8a39-a94140725ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:15.444444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ce449-6f1a-4327-8a39-a94140725ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:15.456449 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ce449-6f1a-4327-8a39-a94140725ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:15.457631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ce449-6f1a-4327-8a39-a94140725ff5 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:15.466723 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523988a-65bf-4804-8b57-e47d8d50c1d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:15.467640 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523988a-65bf-4804-8b57-e47d8d50c1d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:15.468140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523988a-65bf-4804-8b57-e47d8d50c1d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:15.468706 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523988a-65bf-4804-8b57-e47d8d50c1d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:15.473734 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1252/2521] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:15.548141 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523988a-65bf-4804-8b57-e47d8d50c1d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:15.550670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523988a-65bf-4804-8b57-e47d8d50c1d0 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:15.562280 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1270/2522] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:16.106992 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ce449-6f1a-4327-8a39-a94140725ff5 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:16.108422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b70ce449-6f1a-4327-8a39-a94140725ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:16.128869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ce449-6f1a-4327-8a39-a94140725ff5 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:16.142488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:16.144132 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:16.144685 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:16.145267 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777 admin admin] PATH_INFO: `/v3/projects/7d2df9afed5846f693fe578d8ba2b9aa` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:16.147541 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2df9afed5846f693fe578d8ba2b9aa)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:16.149776 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:16.299722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523988a-65bf-4804-8b57-e47d8d50c1d0 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:16.301905 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2523988a-65bf-4804-8b57-e47d8d50c1d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:16.305601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2df9afed5846f693fe578d8ba2b9aa', 'request_id': 'req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.317328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523988a-65bf-4804-8b57-e47d8d50c1d0 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:16.378946 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454831ff-8378-431b-8a8b-8d20371a9adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:16.379550 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454831ff-8378-431b-8a8b-8d20371a9adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:16.379838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454831ff-8378-431b-8a8b-8d20371a9adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:16.380115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454831ff-8378-431b-8a8b-8d20371a9adc admin admin] PATH_INFO: `/v3/users/7123e6463027485da771714743609e5b` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:16.380531 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2df9afed5846f693fe578d8ba2b9aa', 'request_id': 'req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.381359 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454831ff-8378-431b-8a8b-8d20371a9adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7123e6463027485da771714743609e5b)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:16.383475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454831ff-8378-431b-8a8b-8d20371a9adc admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:16.388333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2df9afed5846f693fe578d8ba2b9aa', 'request_id': 'req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.407757 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777 admin admin] The token cache is being invalidate because project 7d2df9afed5846f693fe578d8ba2b9aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:16.410534 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:16.412266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.412266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.416347 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1253/2523] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:16 2022] DELETE /identity/v3/projects/7d2df9afed5846f693fe578d8ba2b9aa => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:16.420677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:16.422127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:16.435623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3ae5e-6677-4e5c-b39c-68bb9a14c777 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:16.441220 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6878fc-9c94-4297-9b33-00eec38855e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:16.443597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6878fc-9c94-4297-9b33-00eec38855e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:16.443597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6878fc-9c94-4297-9b33-00eec38855e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:16.443597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6878fc-9c94-4297-9b33-00eec38855e6 admin admin] PATH_INFO: `/v3/users/43a10983330e452cbc553b2c06674089` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:16.443597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6878fc-9c94-4297-9b33-00eec38855e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a10983330e452cbc553b2c06674089)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:16.445492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6878fc-9c94-4297-9b33-00eec38855e6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:16.463741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:16.603352 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-454831ff-8378-431b-8a8b-8d20371a9adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7123e6463027485da771714743609e5b'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.604032 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-454831ff-8378-431b-8a8b-8d20371a9adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7123e6463027485da771714743609e5b'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.681186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-fa6878fc-9c94-4297-9b33-00eec38855e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a10983330e452cbc553b2c06674089'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.682388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-fa6878fc-9c94-4297-9b33-00eec38855e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a10983330e452cbc553b2c06674089'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.694991 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-454831ff-8378-431b-8a8b-8d20371a9adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7123e6463027485da771714743609e5b'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.704693 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-454831ff-8378-431b-8a8b-8d20371a9adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7123e6463027485da771714743609e5b'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.723341 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-454831ff-8378-431b-8a8b-8d20371a9adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7123e6463027485da771714743609e5b'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.733904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1271/2524] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:16 2022] DELETE /identity/v3/users/7123e6463027485da771714743609e5b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:16.738263 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254668ba-21d1-4cd3-b004-c3cf41150c97 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:16.738827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254668ba-21d1-4cd3-b004-c3cf41150c97 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:16.739316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254668ba-21d1-4cd3-b004-c3cf41150c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:16.761206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-254668ba-21d1-4cd3-b004-c3cf41150c97 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:16.764934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-254668ba-21d1-4cd3-b004-c3cf41150c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:16.794088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-fa6878fc-9c94-4297-9b33-00eec38855e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a10983330e452cbc553b2c06674089'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.809751 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-fa6878fc-9c94-4297-9b33-00eec38855e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a10983330e452cbc553b2c06674089'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.811596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-fa6878fc-9c94-4297-9b33-00eec38855e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a10983330e452cbc553b2c06674089'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.828334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1254/2525] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:16 2022] DELETE /identity/v3/users/43a10983330e452cbc553b2c06674089 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:16.861163 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1272/2526] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:16.874020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6878fc-9c94-4297-9b33-00eec38855e6 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:16.875712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:16.878202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fa6878fc-9c94-4297-9b33-00eec38855e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:16.952063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6878fc-9c94-4297-9b33-00eec38855e6 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:16.956493 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c8ff6-efcb-43da-9879-34eb04835ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:16.957103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c8ff6-efcb-43da-9879-34eb04835ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:16.957421 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c8ff6-efcb-43da-9879-34eb04835ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:16.957688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c8ff6-efcb-43da-9879-34eb04835ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:17.044447 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c8ff6-efcb-43da-9879-34eb04835ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:17.045945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c8ff6-efcb-43da-9879-34eb04835ce7 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:17.067949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1255/2527] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:17.291671 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:17.385935 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254668ba-21d1-4cd3-b004-c3cf41150c97 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:17.387501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-254668ba-21d1-4cd3-b004-c3cf41150c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:17.410978 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254668ba-21d1-4cd3-b004-c3cf41150c97 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:17.423956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7d790-4d79-44e4-8072-6611a2dfdca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:17.425288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d790-4d79-44e4-8072-6611a2dfdca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:17.425701 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d790-4d79-44e4-8072-6611a2dfdca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:17.425996 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d790-4d79-44e4-8072-6611a2dfdca1 admin admin] PATH_INFO: `/v3/projects/5ce8b2d2dae24f2b96831ad8875aca50` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:17.427616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7d790-4d79-44e4-8072-6611a2dfdca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ce8b2d2dae24f2b96831ad8875aca50)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:17.429501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7d790-4d79-44e4-8072-6611a2dfdca1 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:17.560236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-fef7d790-4d79-44e4-8072-6611a2dfdca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ce8b2d2dae24f2b96831ad8875aca50', 'request_id': 'req-fef7d790-4d79-44e4-8072-6611a2dfdca1'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:17.637891 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-fef7d790-4d79-44e4-8072-6611a2dfdca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ce8b2d2dae24f2b96831ad8875aca50', 'request_id': 'req-fef7d790-4d79-44e4-8072-6611a2dfdca1'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:17.644963 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-fef7d790-4d79-44e4-8072-6611a2dfdca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ce8b2d2dae24f2b96831ad8875aca50', 'request_id': 'req-fef7d790-4d79-44e4-8072-6611a2dfdca1'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:17.657624 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-fef7d790-4d79-44e4-8072-6611a2dfdca1 admin admin] The token cache is being invalidate because project 5ce8b2d2dae24f2b96831ad8875aca50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:17.657920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-fef7d790-4d79-44e4-8072-6611a2dfdca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:17.658844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-fef7d790-4d79-44e4-8072-6611a2dfdca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:17.660616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1273/2528] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:17 2022] DELETE /identity/v3/projects/5ce8b2d2dae24f2b96831ad8875aca50 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:17.665723 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6e1d-230f-4974-84fe-e171d0d3f851 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:17.666235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6e1d-230f-4974-84fe-e171d0d3f851 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:17.666335 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6e1d-230f-4974-84fe-e171d0d3f851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:17.730347 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-f78c6e1d-230f-4974-84fe-e171d0d3f851 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:17.736548 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f78c6e1d-230f-4974-84fe-e171d0d3f851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:17.846818 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1256/2529] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:17.854758 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dce2f-d262-41be-9148-196b3dbe6e0d None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:17.855117 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dce2f-d262-41be-9148-196b3dbe6e0d None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:17.855462 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dce2f-d262-41be-9148-196b3dbe6e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:17.876811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-182dce2f-d262-41be-9148-196b3dbe6e0d None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:17.878837 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-182dce2f-d262-41be-9148-196b3dbe6e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:17.886862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1274/2530] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:17.891338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6e1d-230f-4974-84fe-e171d0d3f851 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:17.902775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6e1d-230f-4974-84fe-e171d0d3f851 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:17.907423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575416b1-a9c9-4dc0-9fe4-d8ca6a99e2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:17.908039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575416b1-a9c9-4dc0-9fe4-d8ca6a99e2de admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:17.908345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575416b1-a9c9-4dc0-9fe4-d8ca6a99e2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:17.915160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575416b1-a9c9-4dc0-9fe4-d8ca6a99e2de admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:17.915160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575416b1-a9c9-4dc0-9fe4-d8ca6a99e2de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:17.915160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575416b1-a9c9-4dc0-9fe4-d8ca6a99e2de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:17.915160 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575416b1-a9c9-4dc0-9fe4-d8ca6a99e2de admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:17.927033 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1257/2531] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:17.928368 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dce2f-d262-41be-9148-196b3dbe6e0d None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:17.937901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dce2f-d262-41be-9148-196b3dbe6e0d None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:17.949307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f087449-c1d8-48cf-a514-c132a1bedbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:17.950154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f087449-c1d8-48cf-a514-c132a1bedbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:17.950445 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f087449-c1d8-48cf-a514-c132a1bedbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:17.950720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f087449-c1d8-48cf-a514-c132a1bedbd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:17.955169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f087449-c1d8-48cf-a514-c132a1bedbd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:17.959732 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f087449-c1d8-48cf-a514-c132a1bedbd8 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:17.960024 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575416b1-a9c9-4dc0-9fe4-d8ca6a99e2de admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:17.962410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-575416b1-a9c9-4dc0-9fe4-d8ca6a99e2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:17.992024 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575416b1-a9c9-4dc0-9fe4-d8ca6a99e2de admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:18.008208 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952086cd-b459-4bf5-89c1-4016f7157fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:18.009121 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952086cd-b459-4bf5-89c1-4016f7157fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:18.009759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952086cd-b459-4bf5-89c1-4016f7157fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:18.009865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952086cd-b459-4bf5-89c1-4016f7157fd1 admin admin] PATH_INFO: `/v3/projects/f3ed6b9e03624381930c138a9e350e37` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:18.011191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952086cd-b459-4bf5-89c1-4016f7157fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ed6b9e03624381930c138a9e350e37)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:18.013832 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952086cd-b459-4bf5-89c1-4016f7157fd1 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:18.120674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1275/2532] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:17 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:18.121859 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f087449-c1d8-48cf-a514-c132a1bedbd8 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:18.157138 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-952086cd-b459-4bf5-89c1-4016f7157fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ed6b9e03624381930c138a9e350e37', 'request_id': 'req-952086cd-b459-4bf5-89c1-4016f7157fd1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.221030 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f087449-c1d8-48cf-a514-c132a1bedbd8 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:18.239588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-952086cd-b459-4bf5-89c1-4016f7157fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ed6b9e03624381930c138a9e350e37', 'request_id': 'req-952086cd-b459-4bf5-89c1-4016f7157fd1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.249427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-952086cd-b459-4bf5-89c1-4016f7157fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ed6b9e03624381930c138a9e350e37', 'request_id': 'req-952086cd-b459-4bf5-89c1-4016f7157fd1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.286327 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-952086cd-b459-4bf5-89c1-4016f7157fd1 admin admin] The token cache is being invalidate because project f3ed6b9e03624381930c138a9e350e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:18.286999 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-952086cd-b459-4bf5-89c1-4016f7157fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.288209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-952086cd-b459-4bf5-89c1-4016f7157fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.290524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1258/2533] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:17 2022] DELETE /identity/v3/projects/f3ed6b9e03624381930c138a9e350e37 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:18.294409 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952086cd-b459-4bf5-89c1-4016f7157fd1 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:18.296805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-952086cd-b459-4bf5-89c1-4016f7157fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:18.306583 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622151f9-0ab1-4cd8-a3a9-83f767d87483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:18.307379 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622151f9-0ab1-4cd8-a3a9-83f767d87483 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:18.307855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622151f9-0ab1-4cd8-a3a9-83f767d87483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:18.308234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622151f9-0ab1-4cd8-a3a9-83f767d87483 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:18.309178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622151f9-0ab1-4cd8-a3a9-83f767d87483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:18.311472 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622151f9-0ab1-4cd8-a3a9-83f767d87483 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:18.320526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952086cd-b459-4bf5-89c1-4016f7157fd1 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:18.323227 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:18.330979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd164d3-a622-44e7-86a6-74bbb986b66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:18.332640 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd164d3-a622-44e7-86a6-74bbb986b66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:18.332823 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd164d3-a622-44e7-86a6-74bbb986b66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:18.333276 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd164d3-a622-44e7-86a6-74bbb986b66b admin admin] PATH_INFO: `/v3/users/3f238b1f3e284d8286114df54c26b93e` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:18.334699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd164d3-a622-44e7-86a6-74bbb986b66b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f238b1f3e284d8286114df54c26b93e)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:18.336789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd164d3-a622-44e7-86a6-74bbb986b66b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:18.444745 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1276/2534] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:18 2022] POST /identity/v3/users => generated 289 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:18.448750 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622151f9-0ab1-4cd8-a3a9-83f767d87483 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:18.450796 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-622151f9-0ab1-4cd8-a3a9-83f767d87483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:18.468176 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622151f9-0ab1-4cd8-a3a9-83f767d87483 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:18.475291 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c88cad-c321-4b84-81d6-ebac59f2b853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:18.476211 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c88cad-c321-4b84-81d6-ebac59f2b853 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:18.476743 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c88cad-c321-4b84-81d6-ebac59f2b853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:18.477117 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c88cad-c321-4b84-81d6-ebac59f2b853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:18.477976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c88cad-c321-4b84-81d6-ebac59f2b853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:18.479832 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c88cad-c321-4b84-81d6-ebac59f2b853 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:18.491412 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1277/2535] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:18.495497 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c88cad-c321-4b84-81d6-ebac59f2b853 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:18.506190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c88cad-c321-4b84-81d6-ebac59f2b853 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:18.511451 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fd7f8-8808-4f9d-bf6c-8c5b40b8753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:18.512284 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fd7f8-8808-4f9d-bf6c-8c5b40b8753d admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:18.512887 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fd7f8-8808-4f9d-bf6c-8c5b40b8753d admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:18.513338 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fd7f8-8808-4f9d-bf6c-8c5b40b8753d admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:18.514272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fd7f8-8808-4f9d-bf6c-8c5b40b8753d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:18.515925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fd7f8-8808-4f9d-bf6c-8c5b40b8753d admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:18.527604 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1278/2536] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:18.531920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fd7f8-8808-4f9d-bf6c-8c5b40b8753d admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:18.543269 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:18.547285 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fd7f8-8808-4f9d-bf6c-8c5b40b8753d admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:18.555721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a946334-feb8-4862-9886-b11f52d2b24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:18.556957 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a946334-feb8-4862-9886-b11f52d2b24b admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:18.558190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a946334-feb8-4862-9886-b11f52d2b24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:18.558712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8dd164d3-a622-44e7-86a6-74bbb986b66b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f238b1f3e284d8286114df54c26b93e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.559256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8dd164d3-a622-44e7-86a6-74bbb986b66b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f238b1f3e284d8286114df54c26b93e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.559382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a946334-feb8-4862-9886-b11f52d2b24b admin admin] PATH_INFO: `/v3/projects/c25c369e47c2443b9a2136d60ea6962e/users/266d0eb38b744e05bc3c510ed0d31749/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:18.581017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a946334-feb8-4862-9886-b11f52d2b24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c25c369e47c2443b9a2136d60ea6962e, user_id=266d0eb38b744e05bc3c510ed0d31749, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:18.583514 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a946334-feb8-4862-9886-b11f52d2b24b admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:18.623349 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8dd164d3-a622-44e7-86a6-74bbb986b66b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f238b1f3e284d8286114df54c26b93e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.643846 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8dd164d3-a622-44e7-86a6-74bbb986b66b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f238b1f3e284d8286114df54c26b93e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.644450 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8dd164d3-a622-44e7-86a6-74bbb986b66b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f238b1f3e284d8286114df54c26b93e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.657522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1259/2537] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:18 2022] DELETE /identity/v3/users/3f238b1f3e284d8286114df54c26b93e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:18.684149 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1279/2538] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:18 2022] PUT /identity/v3/projects/c25c369e47c2443b9a2136d60ea6962e/users/266d0eb38b744e05bc3c510ed0d31749/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:18.697614 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386c266-a2c1-4e41-a117-c31e74d64cb0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:18.698455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386c266-a2c1-4e41-a117-c31e74d64cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:18.699147 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386c266-a2c1-4e41-a117-c31e74d64cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:18.732745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9386c266-a2c1-4e41-a117-c31e74d64cb0 None None] MFA Rules not processed for user `266d0eb38b744e05bc3c510ed0d31749`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:18.734465 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9386c266-a2c1-4e41-a117-c31e74d64cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:18.820153 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1260/2539] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:18.832186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a946334-feb8-4862-9886-b11f52d2b24b admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:18.835299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9a946334-feb8-4862-9886-b11f52d2b24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:18.934948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a946334-feb8-4862-9886-b11f52d2b24b admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:18.939101 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0de3e-193f-4532-aa48-e503bbd7fad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:18.939864 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0de3e-193f-4532-aa48-e503bbd7fad6 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:18.940223 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0de3e-193f-4532-aa48-e503bbd7fad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:18.940566 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0de3e-193f-4532-aa48-e503bbd7fad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:18.963813 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0de3e-193f-4532-aa48-e503bbd7fad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:18.965432 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0de3e-193f-4532-aa48-e503bbd7fad6 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:18.982172 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1280/2540] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:19.239869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386c266-a2c1-4e41-a117-c31e74d64cb0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:19.241548 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9386c266-a2c1-4e41-a117-c31e74d64cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:19.370932 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386c266-a2c1-4e41-a117-c31e74d64cb0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:19.375885 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee9fdb-8986-4490-bb18-42941eb403e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:19.376730 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee9fdb-8986-4490-bb18-42941eb403e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.377846 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee9fdb-8986-4490-bb18-42941eb403e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.378174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee9fdb-8986-4490-bb18-42941eb403e6 admin admin] PATH_INFO: `/v3/projects/798d380ad823474cbb5e1d1de05bce0e` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.379433 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee9fdb-8986-4490-bb18-42941eb403e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=798d380ad823474cbb5e1d1de05bce0e)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:19.381334 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee9fdb-8986-4490-bb18-42941eb403e6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:19.536473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b8ee9fdb-8986-4490-bb18-42941eb403e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '798d380ad823474cbb5e1d1de05bce0e', 'request_id': 'req-b8ee9fdb-8986-4490-bb18-42941eb403e6'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:19.645682 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b8ee9fdb-8986-4490-bb18-42941eb403e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '798d380ad823474cbb5e1d1de05bce0e', 'request_id': 'req-b8ee9fdb-8986-4490-bb18-42941eb403e6'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:19.656257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b8ee9fdb-8986-4490-bb18-42941eb403e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '798d380ad823474cbb5e1d1de05bce0e', 'request_id': 'req-b8ee9fdb-8986-4490-bb18-42941eb403e6'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:19.672150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b8ee9fdb-8986-4490-bb18-42941eb403e6 admin admin] The token cache is being invalidate because project 798d380ad823474cbb5e1d1de05bce0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:19.672296 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b8ee9fdb-8986-4490-bb18-42941eb403e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:19.673087 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b8ee9fdb-8986-4490-bb18-42941eb403e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:19.677763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1261/2541] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:19 2022] DELETE /identity/v3/projects/798d380ad823474cbb5e1d1de05bce0e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:19.680013 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfe815-a441-40f4-81ed-34217dc24c14 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.680474 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfe815-a441-40f4-81ed-34217dc24c14 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.680582 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfe815-a441-40f4-81ed-34217dc24c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.701321 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-4bdfe815-a441-40f4-81ed-34217dc24c14 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:19.702619 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4bdfe815-a441-40f4-81ed-34217dc24c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:19.791890 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1281/2542] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:19.800066 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fb310-6808-4364-879b-8a62dda4619b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.800994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fb310-6808-4364-879b-8a62dda4619b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.801274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fb310-6808-4364-879b-8a62dda4619b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.827768 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-655fb310-6808-4364-879b-8a62dda4619b None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:19.828315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-655fb310-6808-4364-879b-8a62dda4619b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:19.838307 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1262/2543] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:19.842360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfe815-a441-40f4-81ed-34217dc24c14 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:19.853207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfe815-a441-40f4-81ed-34217dc24c14 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:19.857972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998f03e-069c-4128-8ce6-96be7875c6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:19.858625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998f03e-069c-4128-8ce6-96be7875c6bc admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.858908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998f03e-069c-4128-8ce6-96be7875c6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.859186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998f03e-069c-4128-8ce6-96be7875c6bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.859883 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998f03e-069c-4128-8ce6-96be7875c6bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:19.860189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998f03e-069c-4128-8ce6-96be7875c6bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:19.862527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998f03e-069c-4128-8ce6-96be7875c6bc admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:19.875426 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1282/2544] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:19.891787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fb310-6808-4364-879b-8a62dda4619b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:19.902291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fb310-6808-4364-879b-8a62dda4619b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:19.918419 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfcf71-af00-4c27-88db-0ce192eaba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:19.919529 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfcf71-af00-4c27-88db-0ce192eaba46 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.919968 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfcf71-af00-4c27-88db-0ce192eaba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.920304 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfcf71-af00-4c27-88db-0ce192eaba46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.921001 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfcf71-af00-4c27-88db-0ce192eaba46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:19.923375 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfcf71-af00-4c27-88db-0ce192eaba46 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:20.044389 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1263/2545] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:19 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:20.048513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998f03e-069c-4128-8ce6-96be7875c6bc admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:20.058744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998f03e-069c-4128-8ce6-96be7875c6bc admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:20.123721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8a820-9f83-496e-8add-d91312cdc0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:20.124436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8a820-9f83-496e-8add-d91312cdc0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:20.125006 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8a820-9f83-496e-8add-d91312cdc0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:20.125290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8a820-9f83-496e-8add-d91312cdc0b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:20.136390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8a820-9f83-496e-8add-d91312cdc0b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:20.136390 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8a820-9f83-496e-8add-d91312cdc0b9 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:20.230615 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:20.341651 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1283/2546] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:20 2022] POST /identity/v3/users => generated 291 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:20.345100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfcf71-af00-4c27-88db-0ce192eaba46 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:20.361029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfcf71-af00-4c27-88db-0ce192eaba46 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:20.378845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077c372-7b4f-4166-adfc-e9e196c162ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:20.380278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c372-7b4f-4166-adfc-e9e196c162ea admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:20.380278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c372-7b4f-4166-adfc-e9e196c162ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:20.380560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c372-7b4f-4166-adfc-e9e196c162ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:20.382117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077c372-7b4f-4166-adfc-e9e196c162ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:20.384235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077c372-7b4f-4166-adfc-e9e196c162ea admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:20.400483 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1264/2547] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:20.402101 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8a820-9f83-496e-8add-d91312cdc0b9 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:20.418111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8a820-9f83-496e-8add-d91312cdc0b9 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:20.429233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd901b-ed6c-477e-b84e-30312b84343c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:20.429929 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd901b-ed6c-477e-b84e-30312b84343c admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:20.430216 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd901b-ed6c-477e-b84e-30312b84343c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:20.430493 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd901b-ed6c-477e-b84e-30312b84343c admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:20.431499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd901b-ed6c-477e-b84e-30312b84343c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:20.433370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd901b-ed6c-477e-b84e-30312b84343c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:20.463142 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:20.466370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1284/2548] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:20.466611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077c372-7b4f-4166-adfc-e9e196c162ea admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:20.480384 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077c372-7b4f-4166-adfc-e9e196c162ea admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:20.486860 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb569b-51d7-4d14-a13c-87a6407b73d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:20.487936 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb569b-51d7-4d14-a13c-87a6407b73d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:20.488293 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb569b-51d7-4d14-a13c-87a6407b73d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:20.488649 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb569b-51d7-4d14-a13c-87a6407b73d7 admin admin] PATH_INFO: `/v3/projects/ea85276667fe412793d7806d4cedfb36/users/e3a052d33fb241d984c0f45e886c2bcb/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:20.511613 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb569b-51d7-4d14-a13c-87a6407b73d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea85276667fe412793d7806d4cedfb36, user_id=e3a052d33fb241d984c0f45e886c2bcb, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:20.515780 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb569b-51d7-4d14-a13c-87a6407b73d7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:20.618610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1265/2549] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:20 2022] PUT /identity/v3/projects/ea85276667fe412793d7806d4cedfb36/users/e3a052d33fb241d984c0f45e886c2bcb/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:20.629801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddca91-f872-4c6f-89a3-52788fb38630 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:20.630031 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddca91-f872-4c6f-89a3-52788fb38630 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:20.630487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddca91-f872-4c6f-89a3-52788fb38630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:20.661729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-b4ddca91-f872-4c6f-89a3-52788fb38630 None None] MFA Rules not processed for user `e3a052d33fb241d984c0f45e886c2bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:20.662947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-b4ddca91-f872-4c6f-89a3-52788fb38630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:20.741239 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1285/2550] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:20.753899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb569b-51d7-4d14-a13c-87a6407b73d7 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:20.756400 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-37fb569b-51d7-4d14-a13c-87a6407b73d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:20.823618 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb569b-51d7-4d14-a13c-87a6407b73d7 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:20.828115 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f59a2b-8f2e-43d5-b0db-aad16e2226ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:20.828759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f59a2b-8f2e-43d5-b0db-aad16e2226ca service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:20.829102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f59a2b-8f2e-43d5-b0db-aad16e2226ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:20.829458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f59a2b-8f2e-43d5-b0db-aad16e2226ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:20.858025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f59a2b-8f2e-43d5-b0db-aad16e2226ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:20.860094 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f59a2b-8f2e-43d5-b0db-aad16e2226ca service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:20.872059 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1266/2551] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:20.899022 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddca91-f872-4c6f-89a3-52788fb38630 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:20.988635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddca91-f872-4c6f-89a3-52788fb38630 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:20.994691 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9a1dd-b704-4ce6-9ae5-b86f909b7a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:20.995406 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9a1dd-b704-4ce6-9ae5-b86f909b7a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:20.998821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9a1dd-b704-4ce6-9ae5-b86f909b7a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:20.998821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9a1dd-b704-4ce6-9ae5-b86f909b7a26 admin admin] PATH_INFO: `/v3/users/e3a052d33fb241d984c0f45e886c2bcb` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:20.998821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9a1dd-b704-4ce6-9ae5-b86f909b7a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a052d33fb241d984c0f45e886c2bcb)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:20.999583 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9a1dd-b704-4ce6-9ae5-b86f909b7a26 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:21.249096 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-90a9a1dd-b704-4ce6-9ae5-b86f909b7a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a052d33fb241d984c0f45e886c2bcb'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:21.250720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-90a9a1dd-b704-4ce6-9ae5-b86f909b7a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a052d33fb241d984c0f45e886c2bcb'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:21.353116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-90a9a1dd-b704-4ce6-9ae5-b86f909b7a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a052d33fb241d984c0f45e886c2bcb'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:21.367074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-90a9a1dd-b704-4ce6-9ae5-b86f909b7a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a052d33fb241d984c0f45e886c2bcb'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:21.387862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-90a9a1dd-b704-4ce6-9ae5-b86f909b7a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a052d33fb241d984c0f45e886c2bcb'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:21.409200 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1286/2552] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:20 2022] DELETE /identity/v3/users/e3a052d33fb241d984c0f45e886c2bcb => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:21.414040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d8251-c53d-4fb8-b235-56ab176f27c6 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:21.414596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d8251-c53d-4fb8-b235-56ab176f27c6 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:21.415951 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d8251-c53d-4fb8-b235-56ab176f27c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:21.443157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-cf2d8251-c53d-4fb8-b235-56ab176f27c6 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:21.444919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cf2d8251-c53d-4fb8-b235-56ab176f27c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:21.561733 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1267/2553] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:21.570591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9a1dd-b704-4ce6-9ae5-b86f909b7a26 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:21.572111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-90a9a1dd-b704-4ce6-9ae5-b86f909b7a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:21.652885 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:21.690679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9a1dd-b704-4ce6-9ae5-b86f909b7a26 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:21.695962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009c023-8689-45ea-b4b1-0b121d2f0ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:21.696805 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009c023-8689-45ea-b4b1-0b121d2f0ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:21.697423 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009c023-8689-45ea-b4b1-0b121d2f0ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:21.698027 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009c023-8689-45ea-b4b1-0b121d2f0ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:21.712051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009c023-8689-45ea-b4b1-0b121d2f0ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:21.714887 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009c023-8689-45ea-b4b1-0b121d2f0ae9 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:21.732220 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1287/2554] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:21.852518 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:22.456134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d8251-c53d-4fb8-b235-56ab176f27c6 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:22.457593 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cf2d8251-c53d-4fb8-b235-56ab176f27c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:22.469388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d8251-c53d-4fb8-b235-56ab176f27c6 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:22.476112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2963a-edcd-492a-8146-0e72191a9880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:22.476773 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2963a-edcd-492a-8146-0e72191a9880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:22.477053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2963a-edcd-492a-8146-0e72191a9880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:22.477327 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2963a-edcd-492a-8146-0e72191a9880 admin admin] PATH_INFO: `/v3/projects/ea85276667fe412793d7806d4cedfb36` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:22.478530 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2963a-edcd-492a-8146-0e72191a9880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea85276667fe412793d7806d4cedfb36)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:22.485604 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2963a-edcd-492a-8146-0e72191a9880 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:22.607377 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-deb2963a-edcd-492a-8146-0e72191a9880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea85276667fe412793d7806d4cedfb36', 'request_id': 'req-deb2963a-edcd-492a-8146-0e72191a9880'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:22.665765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-deb2963a-edcd-492a-8146-0e72191a9880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea85276667fe412793d7806d4cedfb36', 'request_id': 'req-deb2963a-edcd-492a-8146-0e72191a9880'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:22.672774 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-deb2963a-edcd-492a-8146-0e72191a9880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea85276667fe412793d7806d4cedfb36', 'request_id': 'req-deb2963a-edcd-492a-8146-0e72191a9880'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:22.684425 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-deb2963a-edcd-492a-8146-0e72191a9880 admin admin] The token cache is being invalidate because project ea85276667fe412793d7806d4cedfb36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:22.684719 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-deb2963a-edcd-492a-8146-0e72191a9880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:22.685497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-deb2963a-edcd-492a-8146-0e72191a9880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:22.687036 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1268/2555] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:22 2022] DELETE /identity/v3/projects/ea85276667fe412793d7806d4cedfb36 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:22.692036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808adf9-95d9-4321-b1c4-cc684ca00a7a None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:22.692333 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808adf9-95d9-4321-b1c4-cc684ca00a7a None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:22.692623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808adf9-95d9-4321-b1c4-cc684ca00a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:22.712309 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-2808adf9-95d9-4321-b1c4-cc684ca00a7a None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:22.713596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2808adf9-95d9-4321-b1c4-cc684ca00a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:22.780124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1288/2556] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:22.790137 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f0b08-1767-4493-bb98-19076bdbb13c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:22.794641 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f0b08-1767-4493-bb98-19076bdbb13c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:22.794641 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f0b08-1767-4493-bb98-19076bdbb13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:22.813991 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c90f0b08-1767-4493-bb98-19076bdbb13c None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:22.816154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c90f0b08-1767-4493-bb98-19076bdbb13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:22.825544 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1269/2557] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:22.832382 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808adf9-95d9-4321-b1c4-cc684ca00a7a None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:22.847088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808adf9-95d9-4321-b1c4-cc684ca00a7a None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:22.853665 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ccab2-e28f-44ec-86f0-db575927033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:22.855107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ccab2-e28f-44ec-86f0-db575927033c admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:22.855635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ccab2-e28f-44ec-86f0-db575927033c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:22.856103 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ccab2-e28f-44ec-86f0-db575927033c admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:22.857028 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ccab2-e28f-44ec-86f0-db575927033c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:22.857561 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ccab2-e28f-44ec-86f0-db575927033c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:22.859946 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ccab2-e28f-44ec-86f0-db575927033c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:22.874058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1289/2558] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:22.879530 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f0b08-1767-4493-bb98-19076bdbb13c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:22.889078 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f0b08-1767-4493-bb98-19076bdbb13c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:22.896275 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e860f-91f1-465f-a73e-46486f863b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:22.896927 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e860f-91f1-465f-a73e-46486f863b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:22.897213 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e860f-91f1-465f-a73e-46486f863b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:22.897549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e860f-91f1-465f-a73e-46486f863b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:22.898264 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e860f-91f1-465f-a73e-46486f863b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:22.903706 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e860f-91f1-465f-a73e-46486f863b32 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:22.923351 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:22.996794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1270/2559] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:22 2022] POST /identity/v3/projects => generated 359 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:22.997149 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ccab2-e28f-44ec-86f0-db575927033c admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:23.009333 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ccab2-e28f-44ec-86f0-db575927033c admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:23.089491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964830e-ae15-4057-94c5-3927eb06d3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:23.090340 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964830e-ae15-4057-94c5-3927eb06d3ab admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:23.090637 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964830e-ae15-4057-94c5-3927eb06d3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:23.090988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964830e-ae15-4057-94c5-3927eb06d3ab admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:23.091670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964830e-ae15-4057-94c5-3927eb06d3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:23.093662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964830e-ae15-4057-94c5-3927eb06d3ab admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:23.183096 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1290/2560] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:22 2022] POST /identity/v3/users => generated 280 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:23.187356 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e860f-91f1-465f-a73e-46486f863b32 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:23.197796 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e860f-91f1-465f-a73e-46486f863b32 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:23.202409 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27826d8-1d00-48fb-8d09-7941fe8a98db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:23.203025 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27826d8-1d00-48fb-8d09-7941fe8a98db admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:23.203305 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27826d8-1d00-48fb-8d09-7941fe8a98db admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:23.203585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27826d8-1d00-48fb-8d09-7941fe8a98db admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:23.204513 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27826d8-1d00-48fb-8d09-7941fe8a98db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:23.206541 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27826d8-1d00-48fb-8d09-7941fe8a98db admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:23.209748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:23.220608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1271/2561] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:23.227593 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964830e-ae15-4057-94c5-3927eb06d3ab admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:23.241149 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964830e-ae15-4057-94c5-3927eb06d3ab admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:23.246439 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363da29b-b9ee-4cc1-9bfa-aee3a46e8a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:23.247537 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363da29b-b9ee-4cc1-9bfa-aee3a46e8a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:23.247537 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363da29b-b9ee-4cc1-9bfa-aee3a46e8a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:23.247705 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363da29b-b9ee-4cc1-9bfa-aee3a46e8a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:23.248283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363da29b-b9ee-4cc1-9bfa-aee3a46e8a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:23.250209 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363da29b-b9ee-4cc1-9bfa-aee3a46e8a02 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:23.265851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1291/2562] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:23.267337 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27826d8-1d00-48fb-8d09-7941fe8a98db admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:23.281987 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27826d8-1d00-48fb-8d09-7941fe8a98db admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:23.296479 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd11ab-f500-4878-b847-8846a9ab73da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:23.297260 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd11ab-f500-4878-b847-8846a9ab73da admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:23.297670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd11ab-f500-4878-b847-8846a9ab73da admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:23.298083 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd11ab-f500-4878-b847-8846a9ab73da admin admin] PATH_INFO: `/v3/projects/3b5d3822254e41988609f6bbb6563ddb/users/368173eb71c14ce492bd59c439d48b2a/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:23.314669 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd11ab-f500-4878-b847-8846a9ab73da admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b5d3822254e41988609f6bbb6563ddb, user_id=368173eb71c14ce492bd59c439d48b2a, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:23.317501 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd11ab-f500-4878-b847-8846a9ab73da admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:23.424939 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1272/2563] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:23 2022] PUT /identity/v3/projects/3b5d3822254e41988609f6bbb6563ddb/users/368173eb71c14ce492bd59c439d48b2a/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:23.437515 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160dd8b5-cad6-4b40-945c-3190495b86f4 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:23.437876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160dd8b5-cad6-4b40-945c-3190495b86f4 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:23.438219 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160dd8b5-cad6-4b40-945c-3190495b86f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:23.467099 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-160dd8b5-cad6-4b40-945c-3190495b86f4 None None] MFA Rules not processed for user `368173eb71c14ce492bd59c439d48b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:23.468397 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-160dd8b5-cad6-4b40-945c-3190495b86f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:23.537182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1292/2564] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:23 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:23.574467 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd11ab-f500-4878-b847-8846a9ab73da admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:23.578990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5ccd11ab-f500-4878-b847-8846a9ab73da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:23.580926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160dd8b5-cad6-4b40-945c-3190495b86f4 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:23.585662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-160dd8b5-cad6-4b40-945c-3190495b86f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:23.594811 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:23.645562 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd11ab-f500-4878-b847-8846a9ab73da admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:23.650402 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ed112-b311-4f60-94d5-f7aff36e429c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:23.651171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ed112-b311-4f60-94d5-f7aff36e429c service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:23.651451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ed112-b311-4f60-94d5-f7aff36e429c service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:23.651721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ed112-b311-4f60-94d5-f7aff36e429c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:23.659833 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160dd8b5-cad6-4b40-945c-3190495b86f4 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:23.660648 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ed112-b311-4f60-94d5-f7aff36e429c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:23.662209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ed112-b311-4f60-94d5-f7aff36e429c service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:23.665881 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390cce4-4507-44b3-b588-c15ed31aff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:23.666575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390cce4-4507-44b3-b588-c15ed31aff8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:23.666988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390cce4-4507-44b3-b588-c15ed31aff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:23.667445 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390cce4-4507-44b3-b588-c15ed31aff8f admin admin] PATH_INFO: `/v3/users/7d859e797d874c948325f2ce0978edb6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:23.668761 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390cce4-4507-44b3-b588-c15ed31aff8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d859e797d874c948325f2ce0978edb6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:23.671161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390cce4-4507-44b3-b588-c15ed31aff8f admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:23.671898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1273/2565] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:23 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:23.688453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ed112-b311-4f60-94d5-f7aff36e429c service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:23.699989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ed112-b311-4f60-94d5-f7aff36e429c service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:23.704807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a06ea-bc9c-4ba2-9d2d-b26e6af45cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:23.710150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a06ea-bc9c-4ba2-9d2d-b26e6af45cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:23.710150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a06ea-bc9c-4ba2-9d2d-b26e6af45cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:23.710150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a06ea-bc9c-4ba2-9d2d-b26e6af45cd1 admin admin] PATH_INFO: `/v3/users/368173eb71c14ce492bd59c439d48b2a` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:23.710150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a06ea-bc9c-4ba2-9d2d-b26e6af45cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=368173eb71c14ce492bd59c439d48b2a)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:23.710542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a06ea-bc9c-4ba2-9d2d-b26e6af45cd1 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:23.854806 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7390cce4-4507-44b3-b588-c15ed31aff8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d859e797d874c948325f2ce0978edb6'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:23.855374 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7390cce4-4507-44b3-b588-c15ed31aff8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d859e797d874c948325f2ce0978edb6'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:23.884955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c10a06ea-bc9c-4ba2-9d2d-b26e6af45cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368173eb71c14ce492bd59c439d48b2a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:23.885651 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c10a06ea-bc9c-4ba2-9d2d-b26e6af45cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368173eb71c14ce492bd59c439d48b2a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:23.962892 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7390cce4-4507-44b3-b588-c15ed31aff8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d859e797d874c948325f2ce0978edb6'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:23.972267 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7390cce4-4507-44b3-b588-c15ed31aff8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d859e797d874c948325f2ce0978edb6'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:23.983844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7390cce4-4507-44b3-b588-c15ed31aff8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d859e797d874c948325f2ce0978edb6'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:23.990843 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1293/2566] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:23 2022] DELETE /identity/v3/users/7d859e797d874c948325f2ce0978edb6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:24.026032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c10a06ea-bc9c-4ba2-9d2d-b26e6af45cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368173eb71c14ce492bd59c439d48b2a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.038472 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c10a06ea-bc9c-4ba2-9d2d-b26e6af45cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368173eb71c14ce492bd59c439d48b2a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.039231 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c10a06ea-bc9c-4ba2-9d2d-b26e6af45cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368173eb71c14ce492bd59c439d48b2a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.051555 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:24.054623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1274/2567] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:23 2022] DELETE /identity/v3/users/368173eb71c14ce492bd59c439d48b2a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:24.062719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed4cd4-32d6-4de9-8685-8be24057e4ec None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:24.063009 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed4cd4-32d6-4de9-8685-8be24057e4ec None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:24.063295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed4cd4-32d6-4de9-8685-8be24057e4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:24.084153 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-67ed4cd4-32d6-4de9-8685-8be24057e4ec None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:24.093932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-67ed4cd4-32d6-4de9-8685-8be24057e4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:24.148045 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1294/2568] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:24.159307 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a06ea-bc9c-4ba2-9d2d-b26e6af45cd1 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:24.163220 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c10a06ea-bc9c-4ba2-9d2d-b26e6af45cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:24.218534 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a06ea-bc9c-4ba2-9d2d-b26e6af45cd1 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:24.222936 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899718a-a6e1-48f6-b109-8256926df423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:24.223568 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899718a-a6e1-48f6-b109-8256926df423 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:24.223851 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899718a-a6e1-48f6-b109-8256926df423 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:24.224127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899718a-a6e1-48f6-b109-8256926df423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:24.233449 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899718a-a6e1-48f6-b109-8256926df423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:24.234903 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899718a-a6e1-48f6-b109-8256926df423 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:24.242505 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed4cd4-32d6-4de9-8685-8be24057e4ec None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:24.244471 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-67ed4cd4-32d6-4de9-8685-8be24057e4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:24.245540 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1275/2569] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:24.264175 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed4cd4-32d6-4de9-8685-8be24057e4ec None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:24.271962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a62f8-affc-4500-85c5-cbe923367b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:24.272828 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a62f8-affc-4500-85c5-cbe923367b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:24.273184 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a62f8-affc-4500-85c5-cbe923367b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:24.273570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a62f8-affc-4500-85c5-cbe923367b49 admin admin] PATH_INFO: `/v3/projects/5989fabc615545eeb4ef987dea566175` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:24.274873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a62f8-affc-4500-85c5-cbe923367b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5989fabc615545eeb4ef987dea566175)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:24.277645 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a62f8-affc-4500-85c5-cbe923367b49 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:24.307325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:24.406754 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-337a62f8-affc-4500-85c5-cbe923367b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5989fabc615545eeb4ef987dea566175', 'request_id': 'req-337a62f8-affc-4500-85c5-cbe923367b49'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.503429 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-337a62f8-affc-4500-85c5-cbe923367b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5989fabc615545eeb4ef987dea566175', 'request_id': 'req-337a62f8-affc-4500-85c5-cbe923367b49'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.510082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-337a62f8-affc-4500-85c5-cbe923367b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5989fabc615545eeb4ef987dea566175', 'request_id': 'req-337a62f8-affc-4500-85c5-cbe923367b49'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.522938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-337a62f8-affc-4500-85c5-cbe923367b49 admin admin] The token cache is being invalidate because project 5989fabc615545eeb4ef987dea566175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:24.523206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-337a62f8-affc-4500-85c5-cbe923367b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.526010 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-337a62f8-affc-4500-85c5-cbe923367b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.526010 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1295/2570] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:24 2022] DELETE /identity/v3/projects/5989fabc615545eeb4ef987dea566175 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:24.529372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899718a-a6e1-48f6-b109-8256926df423 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:24.539585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899718a-a6e1-48f6-b109-8256926df423 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:24.598427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0a1d5-63e9-4691-a61f-5ba8190e7c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:24.599179 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a1d5-63e9-4691-a61f-5ba8190e7c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:24.599461 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a1d5-63e9-4691-a61f-5ba8190e7c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:24.599736 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a1d5-63e9-4691-a61f-5ba8190e7c43 admin admin] PATH_INFO: `/v3/users/0e2cc85ef6c24532b47bc9884c92d903` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:24.600897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0a1d5-63e9-4691-a61f-5ba8190e7c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e2cc85ef6c24532b47bc9884c92d903)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:24.602834 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0a1d5-63e9-4691-a61f-5ba8190e7c43 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:24.690955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a62f8-affc-4500-85c5-cbe923367b49 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:24.692852 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-337a62f8-affc-4500-85c5-cbe923367b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:24.708975 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a62f8-affc-4500-85c5-cbe923367b49 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:24.715045 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2558c4-16d1-43e8-959f-e8985c88e80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:24.716106 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2558c4-16d1-43e8-959f-e8985c88e80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:24.716582 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2558c4-16d1-43e8-959f-e8985c88e80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:24.720225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2558c4-16d1-43e8-959f-e8985c88e80e admin admin] PATH_INFO: `/v3/projects/3b5d3822254e41988609f6bbb6563ddb` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:24.720225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2558c4-16d1-43e8-959f-e8985c88e80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b5d3822254e41988609f6bbb6563ddb)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:24.720225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2558c4-16d1-43e8-959f-e8985c88e80e admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:24.828457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c9c0a1d5-63e9-4691-a61f-5ba8190e7c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e2cc85ef6c24532b47bc9884c92d903'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.829112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c9c0a1d5-63e9-4691-a61f-5ba8190e7c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e2cc85ef6c24532b47bc9884c92d903'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.859767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5e2558c4-16d1-43e8-959f-e8985c88e80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b5d3822254e41988609f6bbb6563ddb', 'request_id': 'req-5e2558c4-16d1-43e8-959f-e8985c88e80e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.868315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:24.911205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c9c0a1d5-63e9-4691-a61f-5ba8190e7c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e2cc85ef6c24532b47bc9884c92d903'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.925087 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c9c0a1d5-63e9-4691-a61f-5ba8190e7c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e2cc85ef6c24532b47bc9884c92d903'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.925995 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c9c0a1d5-63e9-4691-a61f-5ba8190e7c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e2cc85ef6c24532b47bc9884c92d903'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.934580 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:24.938986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1276/2571] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:24 2022] DELETE /identity/v3/users/0e2cc85ef6c24532b47bc9884c92d903 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:25.011630 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5e2558c4-16d1-43e8-959f-e8985c88e80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b5d3822254e41988609f6bbb6563ddb', 'request_id': 'req-5e2558c4-16d1-43e8-959f-e8985c88e80e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.030114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5e2558c4-16d1-43e8-959f-e8985c88e80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b5d3822254e41988609f6bbb6563ddb', 'request_id': 'req-5e2558c4-16d1-43e8-959f-e8985c88e80e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.047168 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5e2558c4-16d1-43e8-959f-e8985c88e80e admin admin] The token cache is being invalidate because project 3b5d3822254e41988609f6bbb6563ddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:25.047465 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5e2558c4-16d1-43e8-959f-e8985c88e80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.048155 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5e2558c4-16d1-43e8-959f-e8985c88e80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.051059 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1296/2572] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:24 2022] DELETE /identity/v3/projects/3b5d3822254e41988609f6bbb6563ddb => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:25.056295 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ff6b0-89a8-44be-a84d-14d1c4e24ae8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.057318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ff6b0-89a8-44be-a84d-14d1c4e24ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.057318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ff6b0-89a8-44be-a84d-14d1c4e24ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.077646 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b77ff6b0-89a8-44be-a84d-14d1c4e24ae8 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:25.078855 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b77ff6b0-89a8-44be-a84d-14d1c4e24ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:25.141556 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1277/2573] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:25.150497 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc5911-9c57-447b-85ec-9dbf18e660e9 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.150782 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc5911-9c57-447b-85ec-9dbf18e660e9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.151060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc5911-9c57-447b-85ec-9dbf18e660e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.172795 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-c6bc5911-9c57-447b-85ec-9dbf18e660e9 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:25.172965 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ff6b0-89a8-44be-a84d-14d1c4e24ae8 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.174715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c6bc5911-9c57-447b-85ec-9dbf18e660e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:25.175045 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b77ff6b0-89a8-44be-a84d-14d1c4e24ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:25.187888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ff6b0-89a8-44be-a84d-14d1c4e24ae8 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.189323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1297/2574] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:25.193033 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed92b8-9143-4309-9625-21bd70e556c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.193864 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed92b8-9143-4309-9625-21bd70e556c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.194146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed92b8-9143-4309-9625-21bd70e556c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.194420 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed92b8-9143-4309-9625-21bd70e556c7 admin admin] PATH_INFO: `/v3/projects/3d7fec4638dd49119e677467284e61fb` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.195603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed92b8-9143-4309-9625-21bd70e556c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7fec4638dd49119e677467284e61fb)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.197540 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed92b8-9143-4309-9625-21bd70e556c7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.200930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc5911-9c57-447b-85ec-9dbf18e660e9 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.210670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc5911-9c57-447b-85ec-9dbf18e660e9 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.215393 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8abed3-20b1-4875-bac8-f70888271e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.216017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8abed3-20b1-4875-bac8-f70888271e2b admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.216302 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8abed3-20b1-4875-bac8-f70888271e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.216581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8abed3-20b1-4875-bac8-f70888271e2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.217366 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8abed3-20b1-4875-bac8-f70888271e2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:25.217719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8abed3-20b1-4875-bac8-f70888271e2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.219312 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8abed3-20b1-4875-bac8-f70888271e2b admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.232138 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1298/2575] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:25.237143 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8abed3-20b1-4875-bac8-f70888271e2b admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.246802 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8abed3-20b1-4875-bac8-f70888271e2b admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.251351 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307df11-3a1f-410d-bae7-626b026d3db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.251999 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307df11-3a1f-410d-bae7-626b026d3db8 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.252450 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307df11-3a1f-410d-bae7-626b026d3db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.252728 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307df11-3a1f-410d-bae7-626b026d3db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.253377 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307df11-3a1f-410d-bae7-626b026d3db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.255275 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307df11-3a1f-410d-bae7-626b026d3db8 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.298139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-72ed92b8-9143-4309-9625-21bd70e556c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7fec4638dd49119e677467284e61fb', 'request_id': 'req-72ed92b8-9143-4309-9625-21bd70e556c7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.375596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1299/2576] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:25 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:25.379948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307df11-3a1f-410d-bae7-626b026d3db8 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.380096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-72ed92b8-9143-4309-9625-21bd70e556c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7fec4638dd49119e677467284e61fb', 'request_id': 'req-72ed92b8-9143-4309-9625-21bd70e556c7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.386920 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-72ed92b8-9143-4309-9625-21bd70e556c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7fec4638dd49119e677467284e61fb', 'request_id': 'req-72ed92b8-9143-4309-9625-21bd70e556c7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.397879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-72ed92b8-9143-4309-9625-21bd70e556c7 admin admin] The token cache is being invalidate because project 3d7fec4638dd49119e677467284e61fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:25.398103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-72ed92b8-9143-4309-9625-21bd70e556c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.398926 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-72ed92b8-9143-4309-9625-21bd70e556c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.400949 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1278/2577] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:25 2022] DELETE /identity/v3/projects/3d7fec4638dd49119e677467284e61fb => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:25.405623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab0891-c71f-48c8-a16a-c146e97211e5 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.405998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab0891-c71f-48c8-a16a-c146e97211e5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.406355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab0891-c71f-48c8-a16a-c146e97211e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.435006 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-5cab0891-c71f-48c8-a16a-c146e97211e5 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:25.436328 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5cab0891-c71f-48c8-a16a-c146e97211e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:25.450042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1279/2578] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:25.450255 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307df11-3a1f-410d-bae7-626b026d3db8 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.453178 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e98dd-1c60-42f5-8892-371aa0f876ff None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.453645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e98dd-1c60-42f5-8892-371aa0f876ff None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.454081 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e98dd-1c60-42f5-8892-371aa0f876ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.455579 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aec54-20f6-4c28-90dd-dc1c8bac11a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.456227 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aec54-20f6-4c28-90dd-dc1c8bac11a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.456565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aec54-20f6-4c28-90dd-dc1c8bac11a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.456844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aec54-20f6-4c28-90dd-dc1c8bac11a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.457581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80aec54-20f6-4c28-90dd-dc1c8bac11a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.459945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80aec54-20f6-4c28-90dd-dc1c8bac11a1 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.478661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-5d4e98dd-1c60-42f5-8892-371aa0f876ff None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:25.479963 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5d4e98dd-1c60-42f5-8892-371aa0f876ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:25.488746 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1280/2579] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:25.493016 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e98dd-1c60-42f5-8892-371aa0f876ff None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.503390 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e98dd-1c60-42f5-8892-371aa0f876ff None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.508356 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ecb6d-e544-48dc-8999-f449dec4c9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.508944 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ecb6d-e544-48dc-8999-f449dec4c9fc admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.509069 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ecb6d-e544-48dc-8999-f449dec4c9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.509348 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ecb6d-e544-48dc-8999-f449dec4c9fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.510410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ecb6d-e544-48dc-8999-f449dec4c9fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:25.510716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ecb6d-e544-48dc-8999-f449dec4c9fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.513809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ecb6d-e544-48dc-8999-f449dec4c9fc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.531658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1281/2580] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:39:25.532591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ecb6d-e544-48dc-8999-f449dec4c9fc admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.545886 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ecb6d-e544-48dc-8999-f449dec4c9fc admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.551402 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733830cc-66b1-4002-9ee6-879207ce9e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.552039 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733830cc-66b1-4002-9ee6-879207ce9e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.552325 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733830cc-66b1-4002-9ee6-879207ce9e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.552603 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733830cc-66b1-4002-9ee6-879207ce9e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.553278 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733830cc-66b1-4002-9ee6-879207ce9e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.555756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733830cc-66b1-4002-9ee6-879207ce9e49 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.570734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1300/2581] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:25 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:25.577347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aec54-20f6-4c28-90dd-dc1c8bac11a1 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.579557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-d80aec54-20f6-4c28-90dd-dc1c8bac11a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:25.592279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aec54-20f6-4c28-90dd-dc1c8bac11a1 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.599773 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6585d-12f5-4596-9863-ead553f20981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.600401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6585d-12f5-4596-9863-ead553f20981 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.600689 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6585d-12f5-4596-9863-ead553f20981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.604074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6585d-12f5-4596-9863-ead553f20981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.604074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6585d-12f5-4596-9863-ead553f20981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.604074 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6585d-12f5-4596-9863-ead553f20981 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.615884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1301/2582] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:25.619493 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6585d-12f5-4596-9863-ead553f20981 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.630369 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6585d-12f5-4596-9863-ead553f20981 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.640768 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7b6bb-ac15-4e09-9390-7f8dd4079ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.641395 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7b6bb-ac15-4e09-9390-7f8dd4079ace admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.641707 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7b6bb-ac15-4e09-9390-7f8dd4079ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.641988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7b6bb-ac15-4e09-9390-7f8dd4079ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.642826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7b6bb-ac15-4e09-9390-7f8dd4079ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.644912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7b6bb-ac15-4e09-9390-7f8dd4079ace admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.656480 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1302/2583] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:25.660188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7b6bb-ac15-4e09-9390-7f8dd4079ace admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.665608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1282/2584] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:25 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:25.666861 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733830cc-66b1-4002-9ee6-879207ce9e49 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.670095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7b6bb-ac15-4e09-9390-7f8dd4079ace admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.726880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3330a-044a-4f8b-ae56-7455e62975c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.727536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3330a-044a-4f8b-ae56-7455e62975c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.727819 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3330a-044a-4f8b-ae56-7455e62975c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.728100 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3330a-044a-4f8b-ae56-7455e62975c1 admin admin] PATH_INFO: `/v3/projects/20f32e5f946b44df825285f017cd0a2a/users/343d2ee4da88483f91a4ffb85983eefb/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.729505 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733830cc-66b1-4002-9ee6-879207ce9e49 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.734650 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e58af-96bc-4aeb-8abf-03467725b744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.735281 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e58af-96bc-4aeb-8abf-03467725b744 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.735563 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e58af-96bc-4aeb-8abf-03467725b744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.735838 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e58af-96bc-4aeb-8abf-03467725b744 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.737286 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e58af-96bc-4aeb-8abf-03467725b744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.739363 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e58af-96bc-4aeb-8abf-03467725b744 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.745190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3330a-044a-4f8b-ae56-7455e62975c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f32e5f946b44df825285f017cd0a2a, user_id=343d2ee4da88483f91a4ffb85983eefb, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.747885 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3330a-044a-4f8b-ae56-7455e62975c1 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.849255 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1283/2585] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:25 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:25.854195 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e58af-96bc-4aeb-8abf-03467725b744 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.864812 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e58af-96bc-4aeb-8abf-03467725b744 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.869755 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d7def-9e94-4423-85da-01f5e40b20f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.870716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d7def-9e94-4423-85da-01f5e40b20f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.871199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d7def-9e94-4423-85da-01f5e40b20f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.871649 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d7def-9e94-4423-85da-01f5e40b20f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.874653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:25.874653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d7def-9e94-4423-85da-01f5e40b20f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.875467 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d7def-9e94-4423-85da-01f5e40b20f7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.877299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1303/2586] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:25 2022] PUT /identity/v3/projects/20f32e5f946b44df825285f017cd0a2a/users/343d2ee4da88483f91a4ffb85983eefb/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:25.886028 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1284/2587] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:25.889186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134d0cf-c188-457a-8182-84492cd1f96c None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.889511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134d0cf-c188-457a-8182-84492cd1f96c None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.889798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134d0cf-c188-457a-8182-84492cd1f96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.889926 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d7def-9e94-4423-85da-01f5e40b20f7 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.900041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d7def-9e94-4423-85da-01f5e40b20f7 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.917743 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-1134d0cf-c188-457a-8182-84492cd1f96c None None] MFA Rules not processed for user `343d2ee4da88483f91a4ffb85983eefb`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:25.918880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-1134d0cf-c188-457a-8182-84492cd1f96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:25.958488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237d607-649f-4107-9e76-b11046410773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.959100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237d607-649f-4107-9e76-b11046410773 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.959384 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237d607-649f-4107-9e76-b11046410773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.959662 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237d607-649f-4107-9e76-b11046410773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.960357 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237d607-649f-4107-9e76-b11046410773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.961983 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237d607-649f-4107-9e76-b11046410773 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.972281 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1285/2588] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:25.976345 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237d607-649f-4107-9e76-b11046410773 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.985026 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1304/2589] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:25.985815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237d607-649f-4107-9e76-b11046410773 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.991456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3079591-8eda-4e1e-b386-741f3fea2343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.992116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3079591-8eda-4e1e-b386-741f3fea2343 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.992405 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3079591-8eda-4e1e-b386-741f3fea2343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.992686 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3079591-8eda-4e1e-b386-741f3fea2343 admin admin] PATH_INFO: `/v3/projects/049ba77de43b4702832529d687f5f7a3/users/09217832f8e74db38d990d25faee4305/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.993709 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134d0cf-c188-457a-8182-84492cd1f96c None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:26.004230 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134d0cf-c188-457a-8182-84492cd1f96c None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:26.006351 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:26.007741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3079591-8eda-4e1e-b386-741f3fea2343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=049ba77de43b4702832529d687f5f7a3, user_id=09217832f8e74db38d990d25faee4305, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:26.010535 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3079591-8eda-4e1e-b386-741f3fea2343 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:26.010968 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c66dab-9779-434f-8815-bb51403474f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:26.013653 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c66dab-9779-434f-8815-bb51403474f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.013653 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c66dab-9779-434f-8815-bb51403474f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.013653 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c66dab-9779-434f-8815-bb51403474f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.013653 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c66dab-9779-434f-8815-bb51403474f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:26.014673 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c66dab-9779-434f-8815-bb51403474f5 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:26.103480 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1286/2590] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:25 2022] PUT /identity/v3/projects/049ba77de43b4702832529d687f5f7a3/users/09217832f8e74db38d990d25faee4305/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:26.108246 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55351b9-0010-4aed-a978-35d7536fe7a7 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.108532 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55351b9-0010-4aed-a978-35d7536fe7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.108805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55351b9-0010-4aed-a978-35d7536fe7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.122025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1305/2591] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:25 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:26.125927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c66dab-9779-434f-8815-bb51403474f5 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:26.128673 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d55351b9-0010-4aed-a978-35d7536fe7a7 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:26.129919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d55351b9-0010-4aed-a978-35d7536fe7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:26.188499 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c66dab-9779-434f-8815-bb51403474f5 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:26.190069 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1287/2592] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:26.194232 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafd61b-a5d4-44e0-a502-ab93a820e3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:26.194477 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafd61b-a5d4-44e0-a502-ab93a820e3be admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.194761 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafd61b-a5d4-44e0-a502-ab93a820e3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.195039 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafd61b-a5d4-44e0-a502-ab93a820e3be admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.195780 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafd61b-a5d4-44e0-a502-ab93a820e3be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:26.197729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafd61b-a5d4-44e0-a502-ab93a820e3be admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:26.200006 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55351b9-0010-4aed-a978-35d7536fe7a7 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:26.201432 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d55351b9-0010-4aed-a978-35d7536fe7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:26.259310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55351b9-0010-4aed-a978-35d7536fe7a7 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:26.263886 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f54e7-8f75-4622-aceb-54a18ede2520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:26.264520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f54e7-8f75-4622-aceb-54a18ede2520 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.264803 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f54e7-8f75-4622-aceb-54a18ede2520 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.265103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f54e7-8f75-4622-aceb-54a18ede2520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.276024 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f54e7-8f75-4622-aceb-54a18ede2520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:26.277495 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f54e7-8f75-4622-aceb-54a18ede2520 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:26.288338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1288/2593] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:26.314636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1306/2594] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:26 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:26.315847 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f54e7-8f75-4622-aceb-54a18ede2520 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:26.325412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f54e7-8f75-4622-aceb-54a18ede2520 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:26.330736 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3a611-9a7e-4d52-bdf1-4bd9efef0c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:26.331520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3a611-9a7e-4d52-bdf1-4bd9efef0c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.331805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3a611-9a7e-4d52-bdf1-4bd9efef0c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.332084 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3a611-9a7e-4d52-bdf1-4bd9efef0c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.332854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3a611-9a7e-4d52-bdf1-4bd9efef0c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:26.334482 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3a611-9a7e-4d52-bdf1-4bd9efef0c8c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:26.344365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1289/2595] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:26.348980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafd61b-a5d4-44e0-a502-ab93a820e3be admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:26.359220 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafd61b-a5d4-44e0-a502-ab93a820e3be admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:26.364045 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07f209-1cc2-450c-8a1e-195ea2f35f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:26.366596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f209-1cc2-450c-8a1e-195ea2f35f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.366596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f209-1cc2-450c-8a1e-195ea2f35f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.366596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f209-1cc2-450c-8a1e-195ea2f35f14 admin admin] PATH_INFO: `/v3/projects/411bcc8c13534a4a8878e04b732bb92b/users/db1d2cdb3e7f41f3ab43df79a2aa580d/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.379863 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07f209-1cc2-450c-8a1e-195ea2f35f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411bcc8c13534a4a8878e04b732bb92b, user_id=db1d2cdb3e7f41f3ab43df79a2aa580d, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:26.382542 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07f209-1cc2-450c-8a1e-195ea2f35f14 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:26.449303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1307/2596] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:26 2022] PUT /identity/v3/projects/411bcc8c13534a4a8878e04b732bb92b/users/db1d2cdb3e7f41f3ab43df79a2aa580d/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:26.453328 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3a611-9a7e-4d52-bdf1-4bd9efef0c8c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:26.456241 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:26.466174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3a611-9a7e-4d52-bdf1-4bd9efef0c8c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:26.523597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dfb8d-17ca-4aab-9418-525f2aa43a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:26.524223 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dfb8d-17ca-4aab-9418-525f2aa43a72 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.525132 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dfb8d-17ca-4aab-9418-525f2aa43a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.525425 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dfb8d-17ca-4aab-9418-525f2aa43a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.526147 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557dfb8d-17ca-4aab-9418-525f2aa43a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:26.527740 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557dfb8d-17ca-4aab-9418-525f2aa43a72 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:26.535099 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:26.538124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1290/2597] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:26.542365 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07f209-1cc2-450c-8a1e-195ea2f35f14 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:26.552924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07f209-1cc2-450c-8a1e-195ea2f35f14 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:26.557625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e2783-589a-4d68-8b62-bb43c08ae5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:26.558302 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e2783-589a-4d68-8b62-bb43c08ae5c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.558586 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e2783-589a-4d68-8b62-bb43c08ae5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.558867 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e2783-589a-4d68-8b62-bb43c08ae5c8 admin admin] PATH_INFO: `/v3/projects/411bcc8c13534a4a8878e04b732bb92b/users/db1d2cdb3e7f41f3ab43df79a2aa580d/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.561456 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e2783-589a-4d68-8b62-bb43c08ae5c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411bcc8c13534a4a8878e04b732bb92b, user_id=db1d2cdb3e7f41f3ab43df79a2aa580d, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:26.564231 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e2783-589a-4d68-8b62-bb43c08ae5c8 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:26.575823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1308/2598] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:26 2022] PUT /identity/v3/projects/411bcc8c13534a4a8878e04b732bb92b/users/db1d2cdb3e7f41f3ab43df79a2aa580d/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:26.586668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a74c30-1144-47f9-b531-281413536a45 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.586962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a74c30-1144-47f9-b531-281413536a45 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.587241 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a74c30-1144-47f9-b531-281413536a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.618565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-05a74c30-1144-47f9-b531-281413536a45 None None] MFA Rules not processed for user `db1d2cdb3e7f41f3ab43df79a2aa580d`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:26.619871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-05a74c30-1144-47f9-b531-281413536a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:26.691388 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1291/2599] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:26.702746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e2783-589a-4d68-8b62-bb43c08ae5c8 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:26.704400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-1e6e2783-589a-4d68-8b62-bb43c08ae5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:26.763278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e2783-589a-4d68-8b62-bb43c08ae5c8 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:26.767357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2cad2-2657-476c-a055-28eca0b2341b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:26.769187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2cad2-2657-476c-a055-28eca0b2341b service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.769527 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2cad2-2657-476c-a055-28eca0b2341b service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.769785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2cad2-2657-476c-a055-28eca0b2341b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.827250 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2cad2-2657-476c-a055-28eca0b2341b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:26.829137 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2cad2-2657-476c-a055-28eca0b2341b service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:26.853682 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1309/2600] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:27.192745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:29.988573 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a74c30-1144-47f9-b531-281413536a45 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:30.113193 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:30.135790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a74c30-1144-47f9-b531-281413536a45 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:30.142446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb70a0-d5af-40e6-b221-2f18c76132d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:30.144748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb70a0-d5af-40e6-b221-2f18c76132d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:30.144748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb70a0-d5af-40e6-b221-2f18c76132d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:30.145130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb70a0-d5af-40e6-b221-2f18c76132d1 admin admin] PATH_INFO: `/v3/users/343d2ee4da88483f91a4ffb85983eefb` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:30.146548 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb70a0-d5af-40e6-b221-2f18c76132d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=343d2ee4da88483f91a4ffb85983eefb)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:30.149106 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb70a0-d5af-40e6-b221-2f18c76132d1 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:30.297613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2cad2-2657-476c-a055-28eca0b2341b service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:30.301127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-28e2cad2-2657-476c-a055-28eca0b2341b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:30.327882 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2cad2-2657-476c-a055-28eca0b2341b service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:30.347391 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a8fc-1cb7-4de6-87e7-839431c3f182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:30.348445 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a8fc-1cb7-4de6-87e7-839431c3f182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:30.348991 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a8fc-1cb7-4de6-87e7-839431c3f182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:30.350122 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a8fc-1cb7-4de6-87e7-839431c3f182 admin admin] PATH_INFO: `/v3/users/cf3353e334df4fd394746a283b408c3e` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:30.359307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5a8fc-1cb7-4de6-87e7-839431c3f182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3353e334df4fd394746a283b408c3e)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:30.359307 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5a8fc-1cb7-4de6-87e7-839431c3f182 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:30.453074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-87eb70a0-d5af-40e6-b221-2f18c76132d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343d2ee4da88483f91a4ffb85983eefb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:30.453867 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-87eb70a0-d5af-40e6-b221-2f18c76132d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343d2ee4da88483f91a4ffb85983eefb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:30.543141 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-87eb70a0-d5af-40e6-b221-2f18c76132d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343d2ee4da88483f91a4ffb85983eefb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:30.573398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-87eb70a0-d5af-40e6-b221-2f18c76132d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343d2ee4da88483f91a4ffb85983eefb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:30.575463 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-87eb70a0-d5af-40e6-b221-2f18c76132d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343d2ee4da88483f91a4ffb85983eefb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:30.594750 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1292/2601] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:29 2022] DELETE /identity/v3/users/343d2ee4da88483f91a4ffb85983eefb => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:30.611919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e264c-ca5a-4a03-9757-296291029a3b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:30.612616 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e264c-ca5a-4a03-9757-296291029a3b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:30.612903 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e264c-ca5a-4a03-9757-296291029a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:30.637901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:30.642116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7db5a8fc-1cb7-4de6-87e7-839431c3f182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3353e334df4fd394746a283b408c3e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:30.645911 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7db5a8fc-1cb7-4de6-87e7-839431c3f182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3353e334df4fd394746a283b408c3e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:30.717972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7db5a8fc-1cb7-4de6-87e7-839431c3f182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3353e334df4fd394746a283b408c3e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:30.730337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7db5a8fc-1cb7-4de6-87e7-839431c3f182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3353e334df4fd394746a283b408c3e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:30.780613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-7db5a8fc-1cb7-4de6-87e7-839431c3f182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3353e334df4fd394746a283b408c3e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:30.799282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d75e264c-ca5a-4a03-9757-296291029a3b None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:30.800617 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d75e264c-ca5a-4a03-9757-296291029a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:30.802827 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1310/2602] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:30 2022] DELETE /identity/v3/users/cf3353e334df4fd394746a283b408c3e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:30.808055 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc218318-7595-4e5a-94a5-e966ef9926c6 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:30.808735 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc218318-7595-4e5a-94a5-e966ef9926c6 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:30.809214 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc218318-7595-4e5a-94a5-e966ef9926c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:30.852673 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-cc218318-7595-4e5a-94a5-e966ef9926c6 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:30.854176 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-cc218318-7595-4e5a-94a5-e966ef9926c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:30.894607 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1293/2603] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:30.901815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e264c-ca5a-4a03-9757-296291029a3b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:30.904798 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d75e264c-ca5a-4a03-9757-296291029a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:30.956828 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1311/2604] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:30.964238 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc218318-7595-4e5a-94a5-e966ef9926c6 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:30.968185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-cc218318-7595-4e5a-94a5-e966ef9926c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:30.978196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e264c-ca5a-4a03-9757-296291029a3b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:30.978719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc218318-7595-4e5a-94a5-e966ef9926c6 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:30.982938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332c686-fc84-425b-b4bb-e3212f672174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:30.983662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332c686-fc84-425b-b4bb-e3212f672174 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:30.983810 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332c686-fc84-425b-b4bb-e3212f672174 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:30.984092 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332c686-fc84-425b-b4bb-e3212f672174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:30.986839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300c894-2a5c-4446-ac54-ae26b0486922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:30.988713 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300c894-2a5c-4446-ac54-ae26b0486922 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:30.988713 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300c894-2a5c-4446-ac54-ae26b0486922 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:30.988713 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300c894-2a5c-4446-ac54-ae26b0486922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:30.995647 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332c686-fc84-425b-b4bb-e3212f672174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:30.997042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332c686-fc84-425b-b4bb-e3212f672174 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:31.000323 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300c894-2a5c-4446-ac54-ae26b0486922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:31.002070 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300c894-2a5c-4446-ac54-ae26b0486922 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:31.014605 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1312/2605] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:31.035923 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1294/2606] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:31.743732 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300c894-2a5c-4446-ac54-ae26b0486922 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:31.743876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332c686-fc84-425b-b4bb-e3212f672174 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:31.745532 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8300c894-2a5c-4446-ac54-ae26b0486922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:31.746487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2332c686-fc84-425b-b4bb-e3212f672174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:31.763430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300c894-2a5c-4446-ac54-ae26b0486922 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:31.770037 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9ceae-e84b-493d-a046-ac3a0638115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:31.770850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9ceae-e84b-493d-a046-ac3a0638115a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:31.771315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9ceae-e84b-493d-a046-ac3a0638115a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:31.771689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9ceae-e84b-493d-a046-ac3a0638115a admin admin] PATH_INFO: `/v3/projects/3a7b04666e2d49e5be742673ed21dde8` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:31.776854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9ceae-e84b-493d-a046-ac3a0638115a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a7b04666e2d49e5be742673ed21dde8)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:31.777767 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332c686-fc84-425b-b4bb-e3212f672174 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:31.779365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9ceae-e84b-493d-a046-ac3a0638115a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:31.785552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f4d2b-1e45-48f1-b8b7-b26ba6a964b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:31.786296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f4d2b-1e45-48f1-b8b7-b26ba6a964b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:31.786583 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f4d2b-1e45-48f1-b8b7-b26ba6a964b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:31.787013 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f4d2b-1e45-48f1-b8b7-b26ba6a964b1 admin admin] PATH_INFO: `/v3/projects/20f32e5f946b44df825285f017cd0a2a` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:31.788217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f4d2b-1e45-48f1-b8b7-b26ba6a964b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f32e5f946b44df825285f017cd0a2a)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:31.791542 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f4d2b-1e45-48f1-b8b7-b26ba6a964b1 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:31.803443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:31.997653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f2b9ceae-e84b-493d-a046-ac3a0638115a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7b04666e2d49e5be742673ed21dde8', 'request_id': 'req-f2b9ceae-e84b-493d-a046-ac3a0638115a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:32.011974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-290f4d2b-1e45-48f1-b8b7-b26ba6a964b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f32e5f946b44df825285f017cd0a2a', 'request_id': 'req-290f4d2b-1e45-48f1-b8b7-b26ba6a964b1'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:32.113001 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f2b9ceae-e84b-493d-a046-ac3a0638115a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7b04666e2d49e5be742673ed21dde8', 'request_id': 'req-f2b9ceae-e84b-493d-a046-ac3a0638115a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:32.123564 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f2b9ceae-e84b-493d-a046-ac3a0638115a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7b04666e2d49e5be742673ed21dde8', 'request_id': 'req-f2b9ceae-e84b-493d-a046-ac3a0638115a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:32.142117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f2b9ceae-e84b-493d-a046-ac3a0638115a admin admin] The token cache is being invalidate because project 3a7b04666e2d49e5be742673ed21dde8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:32.143073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f2b9ceae-e84b-493d-a046-ac3a0638115a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:32.144119 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f2b9ceae-e84b-493d-a046-ac3a0638115a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:32.146383 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1295/2607] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:31 2022] DELETE /identity/v3/projects/3a7b04666e2d49e5be742673ed21dde8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:32.263966 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-290f4d2b-1e45-48f1-b8b7-b26ba6a964b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f32e5f946b44df825285f017cd0a2a', 'request_id': 'req-290f4d2b-1e45-48f1-b8b7-b26ba6a964b1'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:32.274521 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-290f4d2b-1e45-48f1-b8b7-b26ba6a964b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f32e5f946b44df825285f017cd0a2a', 'request_id': 'req-290f4d2b-1e45-48f1-b8b7-b26ba6a964b1'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:32.325031 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-290f4d2b-1e45-48f1-b8b7-b26ba6a964b1 admin admin] The token cache is being invalidate because project 20f32e5f946b44df825285f017cd0a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:32.325455 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-290f4d2b-1e45-48f1-b8b7-b26ba6a964b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:32.326899 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-290f4d2b-1e45-48f1-b8b7-b26ba6a964b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:32.332108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1313/2608] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:31 2022] DELETE /identity/v3/projects/20f32e5f946b44df825285f017cd0a2a => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:32.333165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9ceae-e84b-493d-a046-ac3a0638115a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:32.337792 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f2b9ceae-e84b-493d-a046-ac3a0638115a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:32.516922 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9ceae-e84b-493d-a046-ac3a0638115a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:32.608859 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cc216-a218-4448-aed0-b72feaf446c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:32.614385 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cc216-a218-4448-aed0-b72feaf446c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:32.615596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cc216-a218-4448-aed0-b72feaf446c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:32.615987 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cc216-a218-4448-aed0-b72feaf446c6 admin admin] PATH_INFO: `/v3/users/db1d2cdb3e7f41f3ab43df79a2aa580d` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:32.618387 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cc216-a218-4448-aed0-b72feaf446c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db1d2cdb3e7f41f3ab43df79a2aa580d)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:32.620962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cc216-a218-4448-aed0-b72feaf446c6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:32.820574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552b241-f195-48ac-91d9-f847ce2745aa None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:32.821099 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552b241-f195-48ac-91d9-f847ce2745aa None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:32.821099 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552b241-f195-48ac-91d9-f847ce2745aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:32.860181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-9552b241-f195-48ac-91d9-f847ce2745aa None None] MFA Rules not processed for user `09217832f8e74db38d990d25faee4305`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:32.861983 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9552b241-f195-48ac-91d9-f847ce2745aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:32.897381 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e48cc216-a218-4448-aed0-b72feaf446c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db1d2cdb3e7f41f3ab43df79a2aa580d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:32.898551 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e48cc216-a218-4448-aed0-b72feaf446c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db1d2cdb3e7f41f3ab43df79a2aa580d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:32.902196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:32.910622 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:32.969576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1314/2609] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:32.975019 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552b241-f195-48ac-91d9-f847ce2745aa None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:32.976751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9552b241-f195-48ac-91d9-f847ce2745aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:32.991144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552b241-f195-48ac-91d9-f847ce2745aa None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:32.995845 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5427d-08b5-4a4d-a7b4-d143d505c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:32.996567 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5427d-08b5-4a4d-a7b4-d143d505c57d admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:33.000144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5427d-08b5-4a4d-a7b4-d143d505c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:33.000144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5427d-08b5-4a4d-a7b4-d143d505c57d admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:33.000144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5427d-08b5-4a4d-a7b4-d143d505c57d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:33.000144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5427d-08b5-4a4d-a7b4-d143d505c57d admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:33.020723 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e48cc216-a218-4448-aed0-b72feaf446c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db1d2cdb3e7f41f3ab43df79a2aa580d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.036256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e48cc216-a218-4448-aed0-b72feaf446c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db1d2cdb3e7f41f3ab43df79a2aa580d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.037096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e48cc216-a218-4448-aed0-b72feaf446c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db1d2cdb3e7f41f3ab43df79a2aa580d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.058665 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1296/2610] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:32 2022] DELETE /identity/v3/users/db1d2cdb3e7f41f3ab43df79a2aa580d => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:33.060173 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cc216-a218-4448-aed0-b72feaf446c6 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:33.061670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e48cc216-a218-4448-aed0-b72feaf446c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:33.138108 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cc216-a218-4448-aed0-b72feaf446c6 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:33.144637 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a3891-5719-46bc-ba96-add79049198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:33.145431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a3891-5719-46bc-ba96-add79049198b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:33.146695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a3891-5719-46bc-ba96-add79049198b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:33.147000 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a3891-5719-46bc-ba96-add79049198b admin admin] PATH_INFO: `/v3/users/44282c98deae417fbfc7a62c8ad6ad1c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:33.149005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a3891-5719-46bc-ba96-add79049198b admin admin] RBAC: Authorizing `identity:delete_user(user_id=44282c98deae417fbfc7a62c8ad6ad1c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:33.150981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a3891-5719-46bc-ba96-add79049198b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:33.157234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1315/2611] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:32 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:33.162190 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5427d-08b5-4a4d-a7b4-d143d505c57d admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:33.234308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5427d-08b5-4a4d-a7b4-d143d505c57d admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:33.243134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cddee4-15ac-4103-8b90-90862717db78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:33.244282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cddee4-15ac-4103-8b90-90862717db78 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:33.244282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cddee4-15ac-4103-8b90-90862717db78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:33.244487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cddee4-15ac-4103-8b90-90862717db78 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:33.245053 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cddee4-15ac-4103-8b90-90862717db78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:33.247019 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cddee4-15ac-4103-8b90-90862717db78 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:33.364884 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-274a3891-5719-46bc-ba96-add79049198b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44282c98deae417fbfc7a62c8ad6ad1c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.365687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-274a3891-5719-46bc-ba96-add79049198b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44282c98deae417fbfc7a62c8ad6ad1c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.380829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1316/2612] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:33 2022] POST /identity/v3/users => generated 296 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:33.381913 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cddee4-15ac-4103-8b90-90862717db78 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:33.383725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-09cddee4-15ac-4103-8b90-90862717db78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:33.396761 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cddee4-15ac-4103-8b90-90862717db78 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:33.402389 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ea986-357b-4a2a-9b6a-0462551bf182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:33.403122 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ea986-357b-4a2a-9b6a-0462551bf182 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:33.403419 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ea986-357b-4a2a-9b6a-0462551bf182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:33.403723 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ea986-357b-4a2a-9b6a-0462551bf182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:33.404438 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ea986-357b-4a2a-9b6a-0462551bf182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:33.406174 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ea986-357b-4a2a-9b6a-0462551bf182 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:33.418205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1317/2613] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:33.422283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ea986-357b-4a2a-9b6a-0462551bf182 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:33.435127 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ea986-357b-4a2a-9b6a-0462551bf182 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:33.441063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccdbe9-0c33-4a2d-9a3b-efe255b50b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:33.441768 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccdbe9-0c33-4a2d-9a3b-efe255b50b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:33.442051 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccdbe9-0c33-4a2d-9a3b-efe255b50b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:33.442325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccdbe9-0c33-4a2d-9a3b-efe255b50b51 admin admin] PATH_INFO: `/v3/projects/f1af514c436e4628ab4aa1745a2b74d0/users/ab870422b4864127a015f520e33e8678/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:33.454119 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-274a3891-5719-46bc-ba96-add79049198b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44282c98deae417fbfc7a62c8ad6ad1c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.459299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccdbe9-0c33-4a2d-9a3b-efe255b50b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1af514c436e4628ab4aa1745a2b74d0, user_id=ab870422b4864127a015f520e33e8678, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:33.462094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccdbe9-0c33-4a2d-9a3b-efe255b50b51 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:33.469005 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-274a3891-5719-46bc-ba96-add79049198b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44282c98deae417fbfc7a62c8ad6ad1c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.469889 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-274a3891-5719-46bc-ba96-add79049198b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44282c98deae417fbfc7a62c8ad6ad1c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.482558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1297/2614] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:33 2022] DELETE /identity/v3/users/44282c98deae417fbfc7a62c8ad6ad1c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:33.486994 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d94642-ca84-46c1-8464-600db87ac955 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:33.487287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d94642-ca84-46c1-8464-600db87ac955 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:33.487657 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d94642-ca84-46c1-8464-600db87ac955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:33.507917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-22d94642-ca84-46c1-8464-600db87ac955 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:33.509685 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-22d94642-ca84-46c1-8464-600db87ac955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:33.563401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1318/2615] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:33 2022] PUT /identity/v3/projects/f1af514c436e4628ab4aa1745a2b74d0/users/ab870422b4864127a015f520e33e8678/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:33.564842 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccdbe9-0c33-4a2d-9a3b-efe255b50b51 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:33.566900 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-52ccdbe9-0c33-4a2d-9a3b-efe255b50b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:33.573650 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1298/2616] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:33.576916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d94642-ca84-46c1-8464-600db87ac955 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:33.585936 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d94642-ca84-46c1-8464-600db87ac955 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:33.640946 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccdbe9-0c33-4a2d-9a3b-efe255b50b51 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:33.647821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045eb0b2-efc0-4b14-ad9c-dbe32ebadac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:33.648011 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768a615-8ad3-4b9b-9959-54cbc8810d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:33.648659 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eb0b2-efc0-4b14-ad9c-dbe32ebadac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:33.648800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768a615-8ad3-4b9b-9959-54cbc8810d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:33.648945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eb0b2-efc0-4b14-ad9c-dbe32ebadac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:33.649050 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768a615-8ad3-4b9b-9959-54cbc8810d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:33.649258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768a615-8ad3-4b9b-9959-54cbc8810d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:33.649359 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eb0b2-efc0-4b14-ad9c-dbe32ebadac4 admin admin] PATH_INFO: `/v3/projects/411bcc8c13534a4a8878e04b732bb92b` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:33.650149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768a615-8ad3-4b9b-9959-54cbc8810d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:33.650736 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045eb0b2-efc0-4b14-ad9c-dbe32ebadac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=411bcc8c13534a4a8878e04b732bb92b)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:33.652363 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768a615-8ad3-4b9b-9959-54cbc8810d89 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:33.652954 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045eb0b2-efc0-4b14-ad9c-dbe32ebadac4 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:33.665825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1299/2617] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:33.665825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768a615-8ad3-4b9b-9959-54cbc8810d89 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:33.667299 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4768a615-8ad3-4b9b-9959-54cbc8810d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:33.728319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768a615-8ad3-4b9b-9959-54cbc8810d89 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:33.732072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9322882-c916-449c-b205-577c70d1db87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:33.732689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9322882-c916-449c-b205-577c70d1db87 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:33.732970 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9322882-c916-449c-b205-577c70d1db87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:33.733244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9322882-c916-449c-b205-577c70d1db87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:33.743306 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9322882-c916-449c-b205-577c70d1db87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:33.744755 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9322882-c916-449c-b205-577c70d1db87 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:33.749305 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-045eb0b2-efc0-4b14-ad9c-dbe32ebadac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411bcc8c13534a4a8878e04b732bb92b', 'request_id': 'req-045eb0b2-efc0-4b14-ad9c-dbe32ebadac4'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.755047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1300/2618] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:33.755819 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9322882-c916-449c-b205-577c70d1db87 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:33.768769 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9322882-c916-449c-b205-577c70d1db87 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:33.816910 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-045eb0b2-efc0-4b14-ad9c-dbe32ebadac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411bcc8c13534a4a8878e04b732bb92b', 'request_id': 'req-045eb0b2-efc0-4b14-ad9c-dbe32ebadac4'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.823227 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-045eb0b2-efc0-4b14-ad9c-dbe32ebadac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411bcc8c13534a4a8878e04b732bb92b', 'request_id': 'req-045eb0b2-efc0-4b14-ad9c-dbe32ebadac4'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.828023 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35c764-e1f7-4f7f-8890-b198aa90ac10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:33.828708 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35c764-e1f7-4f7f-8890-b198aa90ac10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:33.828981 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35c764-e1f7-4f7f-8890-b198aa90ac10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:33.829256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35c764-e1f7-4f7f-8890-b198aa90ac10 admin admin] PATH_INFO: `/v3/projects/f1af514c436e4628ab4aa1745a2b74d0/users/ab870422b4864127a015f520e33e8678/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:33.831474 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35c764-e1f7-4f7f-8890-b198aa90ac10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1af514c436e4628ab4aa1745a2b74d0, user_id=ab870422b4864127a015f520e33e8678, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:33.834433 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35c764-e1f7-4f7f-8890-b198aa90ac10 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:33.835549 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-045eb0b2-efc0-4b14-ad9c-dbe32ebadac4 admin admin] The token cache is being invalidate because project 411bcc8c13534a4a8878e04b732bb92b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:33.836043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-045eb0b2-efc0-4b14-ad9c-dbe32ebadac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.837016 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-045eb0b2-efc0-4b14-ad9c-dbe32ebadac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.839726 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1319/2619] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:33 2022] DELETE /identity/v3/projects/411bcc8c13534a4a8878e04b732bb92b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:33.846327 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d306d3-9107-41c5-8c76-80fe2f241443 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:33.846622 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d306d3-9107-41c5-8c76-80fe2f241443 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:33.847058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d306d3-9107-41c5-8c76-80fe2f241443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:33.848111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1301/2620] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:33 2022] PUT /identity/v3/projects/f1af514c436e4628ab4aa1745a2b74d0/users/ab870422b4864127a015f520e33e8678/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:33.870734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-36d306d3-9107-41c5-8c76-80fe2f241443 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:33.871990 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-36d306d3-9107-41c5-8c76-80fe2f241443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:33.945997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1320/2621] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:33.947869 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c6d5b-668a-476e-b442-13baf95be3ce None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:33.948154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c6d5b-668a-476e-b442-13baf95be3ce None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:33.948431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c6d5b-668a-476e-b442-13baf95be3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:33.970170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-f22c6d5b-668a-476e-b442-13baf95be3ce None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:33.971675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f22c6d5b-668a-476e-b442-13baf95be3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:33.985613 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1302/2622] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:33.987196 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d306d3-9107-41c5-8c76-80fe2f241443 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:33.997403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d306d3-9107-41c5-8c76-80fe2f241443 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:34.034571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:34.046577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1603e-805f-49eb-a554-1afd1a530c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:34.050227 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1603e-805f-49eb-a554-1afd1a530c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:34.050713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1603e-805f-49eb-a554-1afd1a530c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:34.051188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1603e-805f-49eb-a554-1afd1a530c45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:34.052096 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1603e-805f-49eb-a554-1afd1a530c45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:34.053026 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1603e-805f-49eb-a554-1afd1a530c45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:34.055355 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1603e-805f-49eb-a554-1afd1a530c45 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:34.079510 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1321/2623] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:34.079695 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c6d5b-668a-476e-b442-13baf95be3ce None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:34.092840 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c6d5b-668a-476e-b442-13baf95be3ce None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:34.101453 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4eba5-0e15-4aff-b471-edeae000027a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:34.103845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4eba5-0e15-4aff-b471-edeae000027a admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:34.104411 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4eba5-0e15-4aff-b471-edeae000027a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:34.105242 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4eba5-0e15-4aff-b471-edeae000027a admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:34.106269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4eba5-0e15-4aff-b471-edeae000027a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:34.109431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4eba5-0e15-4aff-b471-edeae000027a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:34.183183 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:34.600961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1303/2624] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:34 2022] POST /identity/v3/projects => generated 375 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:34.604364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1603e-805f-49eb-a554-1afd1a530c45 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:34.614905 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1603e-805f-49eb-a554-1afd1a530c45 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:34.649319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4eba5-0e15-4aff-b471-edeae000027a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:34.651318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8bb4eba5-0e15-4aff-b471-edeae000027a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:34.740780 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3576a6-f03f-41ae-b639-2631c4ab3cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:34.741713 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3576a6-f03f-41ae-b639-2631c4ab3cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:34.743327 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3576a6-f03f-41ae-b639-2631c4ab3cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:34.744033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3576a6-f03f-41ae-b639-2631c4ab3cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:34.745225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3576a6-f03f-41ae-b639-2631c4ab3cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:34.752681 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3576a6-f03f-41ae-b639-2631c4ab3cf4 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:34.760448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4eba5-0e15-4aff-b471-edeae000027a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:34.768554 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9c65e-da51-440f-a8b4-4faf8e0ba181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:34.769302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9c65e-da51-440f-a8b4-4faf8e0ba181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:34.769669 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9c65e-da51-440f-a8b4-4faf8e0ba181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:34.770018 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9c65e-da51-440f-a8b4-4faf8e0ba181 admin admin] PATH_INFO: `/v3/projects/095f6b9f1a3841eea4de0c1dd06879f5` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:34.771402 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9c65e-da51-440f-a8b4-4faf8e0ba181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=095f6b9f1a3841eea4de0c1dd06879f5)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:34.774195 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9c65e-da51-440f-a8b4-4faf8e0ba181 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:34.870048 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1322/2625] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:34 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:34.870877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3576a6-f03f-41ae-b639-2631c4ab3cf4 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:34.881079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3576a6-f03f-41ae-b639-2631c4ab3cf4 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:34.886075 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e69f8-0bbf-4e2d-b1f8-d309208fce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:34.886719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e69f8-0bbf-4e2d-b1f8-d309208fce2f admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:34.887002 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e69f8-0bbf-4e2d-b1f8-d309208fce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:34.887279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e69f8-0bbf-4e2d-b1f8-d309208fce2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:34.888149 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e69f8-0bbf-4e2d-b1f8-d309208fce2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:34.891769 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e69f8-0bbf-4e2d-b1f8-d309208fce2f admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:34.941615 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1323/2626] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:34.943493 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e69f8-0bbf-4e2d-b1f8-d309208fce2f admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:34.944246 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-33c9c65e-da51-440f-a8b4-4faf8e0ba181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095f6b9f1a3841eea4de0c1dd06879f5', 'request_id': 'req-33c9c65e-da51-440f-a8b4-4faf8e0ba181'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:34.958223 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e69f8-0bbf-4e2d-b1f8-d309208fce2f admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:35.039877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36238829-44ee-462e-a95d-0ddce73a4859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:35.040138 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-33c9c65e-da51-440f-a8b4-4faf8e0ba181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095f6b9f1a3841eea4de0c1dd06879f5', 'request_id': 'req-33c9c65e-da51-440f-a8b4-4faf8e0ba181'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:35.040613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36238829-44ee-462e-a95d-0ddce73a4859 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:35.040836 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36238829-44ee-462e-a95d-0ddce73a4859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:35.041116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36238829-44ee-462e-a95d-0ddce73a4859 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:35.042064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36238829-44ee-462e-a95d-0ddce73a4859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:35.044624 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36238829-44ee-462e-a95d-0ddce73a4859 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:35.047719 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-33c9c65e-da51-440f-a8b4-4faf8e0ba181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095f6b9f1a3841eea4de0c1dd06879f5', 'request_id': 'req-33c9c65e-da51-440f-a8b4-4faf8e0ba181'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:35.057166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1324/2627] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:35.061402 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36238829-44ee-462e-a95d-0ddce73a4859 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:35.071265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-33c9c65e-da51-440f-a8b4-4faf8e0ba181 admin admin] The token cache is being invalidate because project 095f6b9f1a3841eea4de0c1dd06879f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:35.071639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-33c9c65e-da51-440f-a8b4-4faf8e0ba181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:35.072367 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-33c9c65e-da51-440f-a8b4-4faf8e0ba181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:35.073680 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36238829-44ee-462e-a95d-0ddce73a4859 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:35.074735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1304/2628] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:34 2022] DELETE /identity/v3/projects/095f6b9f1a3841eea4de0c1dd06879f5 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:35.078662 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9c65e-da51-440f-a8b4-4faf8e0ba181 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:35.080432 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-33c9c65e-da51-440f-a8b4-4faf8e0ba181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:35.082711 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056ef83-40f4-47ff-8933-a955e3af1f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:35.085550 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056ef83-40f4-47ff-8933-a955e3af1f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:35.091154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056ef83-40f4-47ff-8933-a955e3af1f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:35.091154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056ef83-40f4-47ff-8933-a955e3af1f42 admin admin] PATH_INFO: `/v3/projects/cd2973e243f44d91849a8a7e100fe33d/users/05e36bec01384b4191af39890dfcfb13/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:35.098128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9c65e-da51-440f-a8b4-4faf8e0ba181 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:35.103021 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95037ccd-f94a-4774-b0ca-c7162f573aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:35.103748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95037ccd-f94a-4774-b0ca-c7162f573aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:35.104109 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95037ccd-f94a-4774-b0ca-c7162f573aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:35.104665 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95037ccd-f94a-4774-b0ca-c7162f573aa1 admin admin] PATH_INFO: `/v3/users/3d0c4329d45840d3b349682aad052f01` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:35.105636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056ef83-40f4-47ff-8933-a955e3af1f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2973e243f44d91849a8a7e100fe33d, user_id=05e36bec01384b4191af39890dfcfb13, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:35.106382 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95037ccd-f94a-4774-b0ca-c7162f573aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0c4329d45840d3b349682aad052f01)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:35.108843 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056ef83-40f4-47ff-8933-a955e3af1f42 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:35.109320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95037ccd-f94a-4774-b0ca-c7162f573aa1 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:35.223456 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1325/2629] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:35 2022] PUT /identity/v3/projects/cd2973e243f44d91849a8a7e100fe33d/users/05e36bec01384b4191af39890dfcfb13/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:35.296546 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063f61b-2e2a-4b8a-82c7-91b4718f2334 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:35.296846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063f61b-2e2a-4b8a-82c7-91b4718f2334 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:35.297134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063f61b-2e2a-4b8a-82c7-91b4718f2334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:35.311468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-95037ccd-f94a-4774-b0ca-c7162f573aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0c4329d45840d3b349682aad052f01'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:35.312264 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-95037ccd-f94a-4774-b0ca-c7162f573aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0c4329d45840d3b349682aad052f01'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:35.339446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-0063f61b-2e2a-4b8a-82c7-91b4718f2334 None None] MFA Rules not processed for user `05e36bec01384b4191af39890dfcfb13`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:35.340716 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-0063f61b-2e2a-4b8a-82c7-91b4718f2334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:35.369357 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-95037ccd-f94a-4774-b0ca-c7162f573aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0c4329d45840d3b349682aad052f01'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:35.391249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-95037ccd-f94a-4774-b0ca-c7162f573aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0c4329d45840d3b349682aad052f01'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:35.393665 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-95037ccd-f94a-4774-b0ca-c7162f573aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0c4329d45840d3b349682aad052f01'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:35.409450 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1305/2630] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:35 2022] DELETE /identity/v3/users/3d0c4329d45840d3b349682aad052f01 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:35.418951 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1326/2631] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:35.429870 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:35.432248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95037ccd-f94a-4774-b0ca-c7162f573aa1 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:35.434168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-95037ccd-f94a-4774-b0ca-c7162f573aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:35.496545 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95037ccd-f94a-4774-b0ca-c7162f573aa1 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:35.500205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355e550-c5c2-45d3-ba59-21a1ae3942c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:35.500895 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e550-c5c2-45d3-ba59-21a1ae3942c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:35.501196 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e550-c5c2-45d3-ba59-21a1ae3942c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:35.501451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e550-c5c2-45d3-ba59-21a1ae3942c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:35.563839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355e550-c5c2-45d3-ba59-21a1ae3942c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:35.566693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355e550-c5c2-45d3-ba59-21a1ae3942c0 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:35.578484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1306/2632] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:35.765778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:35.927943 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063f61b-2e2a-4b8a-82c7-91b4718f2334 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:35.929389 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-0063f61b-2e2a-4b8a-82c7-91b4718f2334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:36.034679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063f61b-2e2a-4b8a-82c7-91b4718f2334 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:36.138759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b26dfe-fd1b-4729-bf41-1b9054874fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:36.139430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b26dfe-fd1b-4729-bf41-1b9054874fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:36.139718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b26dfe-fd1b-4729-bf41-1b9054874fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:36.140000 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b26dfe-fd1b-4729-bf41-1b9054874fbf admin admin] PATH_INFO: `/v3/projects/7948518b29224f92a75c938be1488a64` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:36.141977 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b26dfe-fd1b-4729-bf41-1b9054874fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7948518b29224f92a75c938be1488a64)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:36.144411 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b26dfe-fd1b-4729-bf41-1b9054874fbf admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:36.329871 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-63b26dfe-fd1b-4729-bf41-1b9054874fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7948518b29224f92a75c938be1488a64', 'request_id': 'req-63b26dfe-fd1b-4729-bf41-1b9054874fbf'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:36.446719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-63b26dfe-fd1b-4729-bf41-1b9054874fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7948518b29224f92a75c938be1488a64', 'request_id': 'req-63b26dfe-fd1b-4729-bf41-1b9054874fbf'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:36.463396 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-63b26dfe-fd1b-4729-bf41-1b9054874fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7948518b29224f92a75c938be1488a64', 'request_id': 'req-63b26dfe-fd1b-4729-bf41-1b9054874fbf'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:36.473073 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-63b26dfe-fd1b-4729-bf41-1b9054874fbf admin admin] The token cache is being invalidate because project 7948518b29224f92a75c938be1488a64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:36.473846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-63b26dfe-fd1b-4729-bf41-1b9054874fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:36.474948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-63b26dfe-fd1b-4729-bf41-1b9054874fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:36.480591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1327/2633] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:35 2022] DELETE /identity/v3/projects/7948518b29224f92a75c938be1488a64 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:36.482378 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8008b32-889c-4383-a5e4-63bd62d697e1 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:36.482879 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8008b32-889c-4383-a5e4-63bd62d697e1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:36.482991 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8008b32-889c-4383-a5e4-63bd62d697e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:36.513622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e8008b32-889c-4383-a5e4-63bd62d697e1 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:36.515040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e8008b32-889c-4383-a5e4-63bd62d697e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:36.587374 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1307/2634] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:36.596741 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca561c-96cb-486f-9b3a-52f073aaa240 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:36.597125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca561c-96cb-486f-9b3a-52f073aaa240 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:36.597980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca561c-96cb-486f-9b3a-52f073aaa240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:36.623432 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-b3ca561c-96cb-486f-9b3a-52f073aaa240 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:36.624956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-b3ca561c-96cb-486f-9b3a-52f073aaa240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:36.635460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1328/2635] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:36.639664 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8008b32-889c-4383-a5e4-63bd62d697e1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:36.653492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8008b32-889c-4383-a5e4-63bd62d697e1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:36.662929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a592c-f3c6-4c51-b7c6-2d4e91aae625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:36.662929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a592c-f3c6-4c51-b7c6-2d4e91aae625 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:36.662929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a592c-f3c6-4c51-b7c6-2d4e91aae625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:36.663332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a592c-f3c6-4c51-b7c6-2d4e91aae625 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:36.664344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a592c-f3c6-4c51-b7c6-2d4e91aae625 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:36.664722 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a592c-f3c6-4c51-b7c6-2d4e91aae625 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:36.666457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a592c-f3c6-4c51-b7c6-2d4e91aae625 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:36.683722 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1308/2636] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:36.688139 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca561c-96cb-486f-9b3a-52f073aaa240 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:36.698707 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca561c-96cb-486f-9b3a-52f073aaa240 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:36.703863 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ceee0-b6c5-42d3-9eae-80e5a6a94e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:36.705539 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ceee0-b6c5-42d3-9eae-80e5a6a94e60 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:36.706119 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ceee0-b6c5-42d3-9eae-80e5a6a94e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:36.706616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ceee0-b6c5-42d3-9eae-80e5a6a94e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:36.707925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ceee0-b6c5-42d3-9eae-80e5a6a94e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:36.710111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ceee0-b6c5-42d3-9eae-80e5a6a94e60 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:36.818087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1329/2637] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:36 2022] POST /identity/v3/projects => generated 363 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:36.822261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a592c-f3c6-4c51-b7c6-2d4e91aae625 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:36.836038 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a592c-f3c6-4c51-b7c6-2d4e91aae625 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:36.906678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfd460-f6a9-4ce6-8804-5d0829868832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:36.907310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfd460-f6a9-4ce6-8804-5d0829868832 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:36.907584 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfd460-f6a9-4ce6-8804-5d0829868832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:36.908528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfd460-f6a9-4ce6-8804-5d0829868832 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:36.909290 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfd460-f6a9-4ce6-8804-5d0829868832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:36.911688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfd460-f6a9-4ce6-8804-5d0829868832 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:36.917590 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:37.055344 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1309/2638] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:36 2022] POST /identity/v3/users => generated 282 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:37.056155 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ceee0-b6c5-42d3-9eae-80e5a6a94e60 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:37.073162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ceee0-b6c5-42d3-9eae-80e5a6a94e60 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:37.078828 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157e268-760b-41b1-8c12-c983b42a8367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:37.083663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157e268-760b-41b1-8c12-c983b42a8367 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:37.083663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157e268-760b-41b1-8c12-c983b42a8367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:37.083663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157e268-760b-41b1-8c12-c983b42a8367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:37.083663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157e268-760b-41b1-8c12-c983b42a8367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:37.083663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157e268-760b-41b1-8c12-c983b42a8367 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:37.099703 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfd460-f6a9-4ce6-8804-5d0829868832 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:37.110162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1330/2639] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:37.116089 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfd460-f6a9-4ce6-8804-5d0829868832 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:37.133095 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f5064-d15b-4d3e-b9aa-aa56b590195c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:37.133888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f5064-d15b-4d3e-b9aa-aa56b590195c admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:37.136016 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f5064-d15b-4d3e-b9aa-aa56b590195c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:37.136016 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f5064-d15b-4d3e-b9aa-aa56b590195c admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:37.136016 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f5064-d15b-4d3e-b9aa-aa56b590195c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:37.137289 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f5064-d15b-4d3e-b9aa-aa56b590195c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:37.151475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1310/2640] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:37.156426 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157e268-760b-41b1-8c12-c983b42a8367 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:37.170530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157e268-760b-41b1-8c12-c983b42a8367 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:37.177908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b588c-288c-4e2c-bc7f-7dc14002bd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:37.179247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b588c-288c-4e2c-bc7f-7dc14002bd60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:37.179745 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b588c-288c-4e2c-bc7f-7dc14002bd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:37.180213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b588c-288c-4e2c-bc7f-7dc14002bd60 admin admin] PATH_INFO: `/v3/projects/8290960c56c14a8c878a695aa5a223b0/users/7096f59e9e78416d95fc5aadddae640e/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:37.201039 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b588c-288c-4e2c-bc7f-7dc14002bd60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8290960c56c14a8c878a695aa5a223b0, user_id=7096f59e9e78416d95fc5aadddae640e, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:37.204436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b588c-288c-4e2c-bc7f-7dc14002bd60 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:37.274734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:37.309107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1331/2641] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:37 2022] PUT /identity/v3/projects/8290960c56c14a8c878a695aa5a223b0/users/7096f59e9e78416d95fc5aadddae640e/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:37.321783 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d3f31-3b73-474c-8e1f-0e03c5f3cae4 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:37.322136 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d3f31-3b73-474c-8e1f-0e03c5f3cae4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:37.322479 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d3f31-3b73-474c-8e1f-0e03c5f3cae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:37.357041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-759d3f31-3b73-474c-8e1f-0e03c5f3cae4 None None] MFA Rules not processed for user `7096f59e9e78416d95fc5aadddae640e`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:37.358406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-759d3f31-3b73-474c-8e1f-0e03c5f3cae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:37.480036 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1311/2642] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:37 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:37.481244 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b588c-288c-4e2c-bc7f-7dc14002bd60 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:37.578029 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b588c-288c-4e2c-bc7f-7dc14002bd60 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:37.584987 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a6c3b-60cd-496e-8d08-1657bbe5e443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:37.585756 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a6c3b-60cd-496e-8d08-1657bbe5e443 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:37.586047 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a6c3b-60cd-496e-8d08-1657bbe5e443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:37.586331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a6c3b-60cd-496e-8d08-1657bbe5e443 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:37.587367 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a6c3b-60cd-496e-8d08-1657bbe5e443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:37.589560 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a6c3b-60cd-496e-8d08-1657bbe5e443 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:37.700879 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1332/2643] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:37 2022] POST /identity/v3/projects => generated 363 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:37.702156 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d3f31-3b73-474c-8e1f-0e03c5f3cae4 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:37.717723 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d3f31-3b73-474c-8e1f-0e03c5f3cae4 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:37.812235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14262320-288f-4c3f-b4d6-73812b3c276d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:37.813156 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262320-288f-4c3f-b4d6-73812b3c276d admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:37.813635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262320-288f-4c3f-b4d6-73812b3c276d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:37.814111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262320-288f-4c3f-b4d6-73812b3c276d admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:37.815632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14262320-288f-4c3f-b4d6-73812b3c276d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:37.817563 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14262320-288f-4c3f-b4d6-73812b3c276d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:37.946533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1312/2644] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:37 2022] POST /identity/v3/users => generated 288 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:37.950707 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a6c3b-60cd-496e-8d08-1657bbe5e443 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:37.963997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a6c3b-60cd-496e-8d08-1657bbe5e443 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:37.969243 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2044f-13bb-4f0f-b815-7dfd5bf62527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:37.971791 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2044f-13bb-4f0f-b815-7dfd5bf62527 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:37.972322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2044f-13bb-4f0f-b815-7dfd5bf62527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:37.972937 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2044f-13bb-4f0f-b815-7dfd5bf62527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:37.979176 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2044f-13bb-4f0f-b815-7dfd5bf62527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:37.981380 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2044f-13bb-4f0f-b815-7dfd5bf62527 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:38.008994 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1333/2645] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:38.010255 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14262320-288f-4c3f-b4d6-73812b3c276d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:38.022851 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14262320-288f-4c3f-b4d6-73812b3c276d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:38.028529 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebae15-e00e-4f8a-b1ac-d986858aa66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:38.029215 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebae15-e00e-4f8a-b1ac-d986858aa66a admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:38.029536 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebae15-e00e-4f8a-b1ac-d986858aa66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:38.029942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebae15-e00e-4f8a-b1ac-d986858aa66a admin admin] PATH_INFO: `/v3/projects/0b3a27f50a584946a95bd3a9149be1d0/users/c2495db139a24392a1b4b1be1c26884e/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:38.047637 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebae15-e00e-4f8a-b1ac-d986858aa66a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3a27f50a584946a95bd3a9149be1d0, user_id=c2495db139a24392a1b4b1be1c26884e, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:38.051455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebae15-e00e-4f8a-b1ac-d986858aa66a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:38.182638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1313/2646] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:38 2022] PUT /identity/v3/projects/0b3a27f50a584946a95bd3a9149be1d0/users/c2495db139a24392a1b4b1be1c26884e/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:38.186356 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2044f-13bb-4f0f-b815-7dfd5bf62527 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:38.199452 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2044f-13bb-4f0f-b815-7dfd5bf62527 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:38.289236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78f7e8-e641-4d0f-aa86-2fe487a577e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:38.292746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78f7e8-e641-4d0f-aa86-2fe487a577e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:38.292746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78f7e8-e641-4d0f-aa86-2fe487a577e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:38.292746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78f7e8-e641-4d0f-aa86-2fe487a577e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:38.292746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78f7e8-e641-4d0f-aa86-2fe487a577e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:38.293226 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78f7e8-e641-4d0f-aa86-2fe487a577e1 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:38.304256 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1334/2647] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:38.308409 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebae15-e00e-4f8a-b1ac-d986858aa66a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:38.320378 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebae15-e00e-4f8a-b1ac-d986858aa66a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:38.325566 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0503417-1d8f-4af0-a8ce-ecc711763691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:38.326373 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0503417-1d8f-4af0-a8ce-ecc711763691 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:38.326743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0503417-1d8f-4af0-a8ce-ecc711763691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:38.327072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0503417-1d8f-4af0-a8ce-ecc711763691 admin admin] PATH_INFO: `/v3/projects/0b3a27f50a584946a95bd3a9149be1d0/users/c2495db139a24392a1b4b1be1c26884e/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:38.329315 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0503417-1d8f-4af0-a8ce-ecc711763691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3a27f50a584946a95bd3a9149be1d0, user_id=c2495db139a24392a1b4b1be1c26884e, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:38.332899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0503417-1d8f-4af0-a8ce-ecc711763691 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:38.346002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1314/2648] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:38 2022] PUT /identity/v3/projects/0b3a27f50a584946a95bd3a9149be1d0/users/c2495db139a24392a1b4b1be1c26884e/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:38.356749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf5e7a-013c-4718-a163-652744908bd1 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:38.357044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf5e7a-013c-4718-a163-652744908bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:38.357318 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf5e7a-013c-4718-a163-652744908bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:38.386838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-e6bf5e7a-013c-4718-a163-652744908bd1 None None] MFA Rules not processed for user `c2495db139a24392a1b4b1be1c26884e`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:38.388308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-e6bf5e7a-013c-4718-a163-652744908bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:38.440875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:38.489065 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1335/2649] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:38 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:38.547265 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0503417-1d8f-4af0-a8ce-ecc711763691 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:38.554610 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d0503417-1d8f-4af0-a8ce-ecc711763691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:38.681830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0503417-1d8f-4af0-a8ce-ecc711763691 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:38.694192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be804e2-384a-44c7-946f-55e5a896ec4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:38.694851 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be804e2-384a-44c7-946f-55e5a896ec4a service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:38.695134 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be804e2-384a-44c7-946f-55e5a896ec4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:38.695415 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be804e2-384a-44c7-946f-55e5a896ec4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:38.703647 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:38.720574 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be804e2-384a-44c7-946f-55e5a896ec4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:38.721997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be804e2-384a-44c7-946f-55e5a896ec4a service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:38.734506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1315/2650] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:38 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:39.077801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf5e7a-013c-4718-a163-652744908bd1 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:39.089909 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf5e7a-013c-4718-a163-652744908bd1 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:39.095180 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a5ac1-4b21-4011-a74a-5e7ea3193d20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:39.096246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a5ac1-4b21-4011-a74a-5e7ea3193d20 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:39.096751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a5ac1-4b21-4011-a74a-5e7ea3193d20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:39.097246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a5ac1-4b21-4011-a74a-5e7ea3193d20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:39.193236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a5ac1-4b21-4011-a74a-5e7ea3193d20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:39.195942 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a5ac1-4b21-4011-a74a-5e7ea3193d20 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:39.222709 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1336/2651] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:39 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:39.305591 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:40.709660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:40.976468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dad7b-12d4-48c3-9d0b-28c033994fe2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:40.976889 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dad7b-12d4-48c3-9d0b-28c033994fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:40.977030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dad7b-12d4-48c3-9d0b-28c033994fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:41.013151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9b8dad7b-12d4-48c3-9d0b-28c033994fe2 None None] MFA Rules not processed for user `ab870422b4864127a015f520e33e8678`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:41.014765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9b8dad7b-12d4-48c3-9d0b-28c033994fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:41.094242 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1316/2652] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:41.113544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a5ac1-4b21-4011-a74a-5e7ea3193d20 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:41.115168 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ed4a5ac1-4b21-4011-a74a-5e7ea3193d20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:41.229715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a5ac1-4b21-4011-a74a-5e7ea3193d20 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:41.235590 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bc221-0d42-4a9b-8e21-0a7db0274796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:41.236269 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bc221-0d42-4a9b-8e21-0a7db0274796 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:41.236552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bc221-0d42-4a9b-8e21-0a7db0274796 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:41.236831 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bc221-0d42-4a9b-8e21-0a7db0274796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:41.240128 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-cd5bc221-0d42-4a9b-8e21-0a7db0274796 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:41.309636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bc221-0d42-4a9b-8e21-0a7db0274796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:41.311247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bc221-0d42-4a9b-8e21-0a7db0274796 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:41.321330 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1337/2653] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:41.578067 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dad7b-12d4-48c3-9d0b-28c033994fe2 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:41.581011 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9b8dad7b-12d4-48c3-9d0b-28c033994fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:41.679596 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dad7b-12d4-48c3-9d0b-28c033994fe2 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:41.688456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d65ae0-b414-4b42-8daa-867bbe5b5011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:41.688456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d65ae0-b414-4b42-8daa-867bbe5b5011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:41.688456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d65ae0-b414-4b42-8daa-867bbe5b5011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:41.688456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d65ae0-b414-4b42-8daa-867bbe5b5011 admin admin] PATH_INFO: `/v3/users/05e36bec01384b4191af39890dfcfb13` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:41.688788 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d65ae0-b414-4b42-8daa-867bbe5b5011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e36bec01384b4191af39890dfcfb13)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:41.690352 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d65ae0-b414-4b42-8daa-867bbe5b5011 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:41.717513 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:INSERT=1,keystone:SELECT=95,keystone:DELETE=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:41.928430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-83d65ae0-b414-4b42-8daa-867bbe5b5011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e36bec01384b4191af39890dfcfb13'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:41.929095 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-83d65ae0-b414-4b42-8daa-867bbe5b5011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e36bec01384b4191af39890dfcfb13'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:42.031438 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-83d65ae0-b414-4b42-8daa-867bbe5b5011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e36bec01384b4191af39890dfcfb13'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:42.045145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-83d65ae0-b414-4b42-8daa-867bbe5b5011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e36bec01384b4191af39890dfcfb13'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:42.045955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-83d65ae0-b414-4b42-8daa-867bbe5b5011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e36bec01384b4191af39890dfcfb13'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:42.059380 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1317/2654] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:41 2022] DELETE /identity/v3/users/05e36bec01384b4191af39890dfcfb13 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:42.063930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91f191-7865-4888-966c-d0dd32a031c7 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:42.063930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91f191-7865-4888-966c-d0dd32a031c7 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:42.069412 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91f191-7865-4888-966c-d0dd32a031c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:42.084730 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-2b91f191-7865-4888-966c-d0dd32a031c7 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:42.085995 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2b91f191-7865-4888-966c-d0dd32a031c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:42.113462 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:42.150521 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1338/2655] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:42.158668 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d65ae0-b414-4b42-8daa-867bbe5b5011 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:42.160164 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-83d65ae0-b414-4b42-8daa-867bbe5b5011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:42.218542 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d65ae0-b414-4b42-8daa-867bbe5b5011 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:42.224444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac50771-7943-40c4-8924-a4daa7e5271e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:42.224444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac50771-7943-40c4-8924-a4daa7e5271e service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:42.224444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac50771-7943-40c4-8924-a4daa7e5271e service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:42.224444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac50771-7943-40c4-8924-a4daa7e5271e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:42.234442 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac50771-7943-40c4-8924-a4daa7e5271e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:42.235932 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac50771-7943-40c4-8924-a4daa7e5271e service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:42.246514 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1318/2656] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:42.737054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91f191-7865-4888-966c-d0dd32a031c7 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:42.739253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2b91f191-7865-4888-966c-d0dd32a031c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:42.754202 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91f191-7865-4888-966c-d0dd32a031c7 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:42.759969 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d3072-d75b-4546-8e7a-05aef960426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:42.760958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d3072-d75b-4546-8e7a-05aef960426a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:42.761453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d3072-d75b-4546-8e7a-05aef960426a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:42.769154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d3072-d75b-4546-8e7a-05aef960426a admin admin] PATH_INFO: `/v3/projects/cd2973e243f44d91849a8a7e100fe33d` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:42.769154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d3072-d75b-4546-8e7a-05aef960426a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd2973e243f44d91849a8a7e100fe33d)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:42.769154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d3072-d75b-4546-8e7a-05aef960426a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:42.925820 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4b8d3072-d75b-4546-8e7a-05aef960426a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd2973e243f44d91849a8a7e100fe33d', 'request_id': 'req-4b8d3072-d75b-4546-8e7a-05aef960426a'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:43.036834 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4b8d3072-d75b-4546-8e7a-05aef960426a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd2973e243f44d91849a8a7e100fe33d', 'request_id': 'req-4b8d3072-d75b-4546-8e7a-05aef960426a'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:43.056455 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4b8d3072-d75b-4546-8e7a-05aef960426a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd2973e243f44d91849a8a7e100fe33d', 'request_id': 'req-4b8d3072-d75b-4546-8e7a-05aef960426a'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:43.071932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4b8d3072-d75b-4546-8e7a-05aef960426a admin admin] The token cache is being invalidate because project cd2973e243f44d91849a8a7e100fe33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:43.071932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4b8d3072-d75b-4546-8e7a-05aef960426a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:43.072538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4b8d3072-d75b-4546-8e7a-05aef960426a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:43.074353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1339/2657] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:42 2022] DELETE /identity/v3/projects/cd2973e243f44d91849a8a7e100fe33d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:43.079145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720b2f5-dbb1-4463-ad17-e4f59e4722f8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:43.080141 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720b2f5-dbb1-4463-ad17-e4f59e4722f8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:43.080353 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720b2f5-dbb1-4463-ad17-e4f59e4722f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:43.108200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8720b2f5-dbb1-4463-ad17-e4f59e4722f8 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:43.109625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8720b2f5-dbb1-4463-ad17-e4f59e4722f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:43.162718 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d3072-d75b-4546-8e7a-05aef960426a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:43.164208 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4b8d3072-d75b-4546-8e7a-05aef960426a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:43.193426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1319/2658] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:43.202092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e4f78-5472-452b-acc2-dde472fddb68 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:43.202389 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e4f78-5472-452b-acc2-dde472fddb68 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:43.202843 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e4f78-5472-452b-acc2-dde472fddb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:43.238351 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d10e4f78-5472-452b-acc2-dde472fddb68 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:43.241010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d10e4f78-5472-452b-acc2-dde472fddb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:43.249850 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1320/2659] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:43.255010 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e4f78-5472-452b-acc2-dde472fddb68 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:43.269842 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d3072-d75b-4546-8e7a-05aef960426a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:43.270013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e4f78-5472-452b-acc2-dde472fddb68 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:43.274721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ef435-e99c-47b3-9e83-f8b3e62d2f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:43.275443 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99550a1-b057-44d3-adcc-c22054779f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:43.275785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ef435-e99c-47b3-9e83-f8b3e62d2f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:43.276212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99550a1-b057-44d3-adcc-c22054779f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:43.276565 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99550a1-b057-44d3-adcc-c22054779f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:43.276856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ef435-e99c-47b3-9e83-f8b3e62d2f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:43.276986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99550a1-b057-44d3-adcc-c22054779f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:43.277401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ef435-e99c-47b3-9e83-f8b3e62d2f00 admin admin] PATH_INFO: `/v3/users/266d0eb38b744e05bc3c510ed0d31749` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:43.277801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99550a1-b057-44d3-adcc-c22054779f22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:43.278151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99550a1-b057-44d3-adcc-c22054779f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:43.279244 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ef435-e99c-47b3-9e83-f8b3e62d2f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=266d0eb38b744e05bc3c510ed0d31749)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:43.279750 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99550a1-b057-44d3-adcc-c22054779f22 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:43.281597 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ef435-e99c-47b3-9e83-f8b3e62d2f00 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:43.297512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1321/2660] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:43.301042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99550a1-b057-44d3-adcc-c22054779f22 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:43.313057 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99550a1-b057-44d3-adcc-c22054779f22 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:43.325612 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77353212-2885-4381-8db5-fda93e20bec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:43.326254 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77353212-2885-4381-8db5-fda93e20bec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:43.326537 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77353212-2885-4381-8db5-fda93e20bec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:43.326813 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77353212-2885-4381-8db5-fda93e20bec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:43.327488 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77353212-2885-4381-8db5-fda93e20bec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:43.330179 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77353212-2885-4381-8db5-fda93e20bec0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:43.433899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1322/2661] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:43 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:43.437267 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77353212-2885-4381-8db5-fda93e20bec0 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:43.442829 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:43.508747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-204ef435-e99c-47b3-9e83-f8b3e62d2f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '266d0eb38b744e05bc3c510ed0d31749'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:43.509394 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-204ef435-e99c-47b3-9e83-f8b3e62d2f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '266d0eb38b744e05bc3c510ed0d31749'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:43.512365 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77353212-2885-4381-8db5-fda93e20bec0 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:43.517837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643e676-5fb8-4e9f-b5e8-5ecc5bb5e2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:43.518725 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643e676-5fb8-4e9f-b5e8-5ecc5bb5e2ba admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:43.519008 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643e676-5fb8-4e9f-b5e8-5ecc5bb5e2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:43.519281 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643e676-5fb8-4e9f-b5e8-5ecc5bb5e2ba admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:43.519945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643e676-5fb8-4e9f-b5e8-5ecc5bb5e2ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:43.521888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643e676-5fb8-4e9f-b5e8-5ecc5bb5e2ba admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:43.576603 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-204ef435-e99c-47b3-9e83-f8b3e62d2f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '266d0eb38b744e05bc3c510ed0d31749'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:43.601217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:43.618233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-204ef435-e99c-47b3-9e83-f8b3e62d2f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '266d0eb38b744e05bc3c510ed0d31749'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:43.633644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-204ef435-e99c-47b3-9e83-f8b3e62d2f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '266d0eb38b744e05bc3c510ed0d31749'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:43.640338 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1340/2662] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:43 2022] DELETE /identity/v3/users/266d0eb38b744e05bc3c510ed0d31749 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:43.648824 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4eb6d-0f67-4323-a244-cf3540961334 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:43.649216 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4eb6d-0f67-4323-a244-cf3540961334 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:43.649657 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4eb6d-0f67-4323-a244-cf3540961334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:43.650073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1323/2663] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:43 2022] POST /identity/v3/users => generated 285 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:43.660647 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643e676-5fb8-4e9f-b5e8-5ecc5bb5e2ba admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:43.662738 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9643e676-5fb8-4e9f-b5e8-5ecc5bb5e2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:43.675050 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-7ea4eb6d-0f67-4323-a244-cf3540961334 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:43.675901 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643e676-5fb8-4e9f-b5e8-5ecc5bb5e2ba admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:43.680979 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7ea4eb6d-0f67-4323-a244-cf3540961334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:43.775574 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1341/2664] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:43.792523 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4eb6d-0f67-4323-a244-cf3540961334 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:43.795186 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7ea4eb6d-0f67-4323-a244-cf3540961334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:43.869249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674a542-8327-47f7-a479-de47621de62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:43.870303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674a542-8327-47f7-a479-de47621de62f admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:43.870764 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674a542-8327-47f7-a479-de47621de62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:43.871226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674a542-8327-47f7-a479-de47621de62f admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:43.872263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674a542-8327-47f7-a479-de47621de62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:43.874062 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674a542-8327-47f7-a479-de47621de62f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:43.884177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1324/2665] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:43.888223 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674a542-8327-47f7-a479-de47621de62f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:43.889730 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4eb6d-0f67-4323-a244-cf3540961334 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:43.898316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d742c-e7df-4008-9d87-c977d4759c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:43.898316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d742c-e7df-4008-9d87-c977d4759c40 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:43.898316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d742c-e7df-4008-9d87-c977d4759c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:43.898316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d742c-e7df-4008-9d87-c977d4759c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:43.899222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674a542-8327-47f7-a479-de47621de62f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:43.903902 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45494c15-1335-4b7b-a2c6-a37dfed47d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:43.904504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45494c15-1335-4b7b-a2c6-a37dfed47d4f admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:43.904790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45494c15-1335-4b7b-a2c6-a37dfed47d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:43.904894 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d742c-e7df-4008-9d87-c977d4759c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:43.905072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45494c15-1335-4b7b-a2c6-a37dfed47d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:43.905793 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45494c15-1335-4b7b-a2c6-a37dfed47d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:43.906316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d742c-e7df-4008-9d87-c977d4759c40 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:43.907359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45494c15-1335-4b7b-a2c6-a37dfed47d4f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:43.917228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1342/2666] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:43.922059 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1325/2667] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:43.925497 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d742c-e7df-4008-9d87-c977d4759c40 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:43.935244 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d742c-e7df-4008-9d87-c977d4759c40 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:43.942000 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd70e4-dcf8-446e-b179-be2667b583e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:43.942699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd70e4-dcf8-446e-b179-be2667b583e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:43.942987 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd70e4-dcf8-446e-b179-be2667b583e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:43.943270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd70e4-dcf8-446e-b179-be2667b583e3 admin admin] PATH_INFO: `/v3/projects/f69a10aa384245c594d57a05dac17a44/users/63cfd897f8d843049cfb0705e0e969a4/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:43.980326 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd70e4-dcf8-446e-b179-be2667b583e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69a10aa384245c594d57a05dac17a44, user_id=63cfd897f8d843049cfb0705e0e969a4, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:43.983116 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd70e4-dcf8-446e-b179-be2667b583e3 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:44.077072 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1343/2668] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:43 2022] PUT /identity/v3/projects/f69a10aa384245c594d57a05dac17a44/users/63cfd897f8d843049cfb0705e0e969a4/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:44.091521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872f510-9249-47e4-a441-9233fdcc6686 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:44.092645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872f510-9249-47e4-a441-9233fdcc6686 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:44.097809 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872f510-9249-47e4-a441-9233fdcc6686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:44.134417 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-5872f510-9249-47e4-a441-9233fdcc6686 None None] MFA Rules not processed for user `63cfd897f8d843049cfb0705e0e969a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:44.136088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5872f510-9249-47e4-a441-9233fdcc6686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:44.238908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1326/2669] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:44.248271 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd70e4-dcf8-446e-b179-be2667b583e3 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:44.251101 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c8cd70e4-dcf8-446e-b179-be2667b583e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:44.319946 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd70e4-dcf8-446e-b179-be2667b583e3 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:44.327401 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd907f2-b363-41ff-bded-8d82eedbc05f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628ef75fa7194253bcf6cd6c85211738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:44.328439 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd907f2-b363-41ff-bded-8d82eedbc05f service glance] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:44.328928 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd907f2-b363-41ff-bded-8d82eedbc05f service glance] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:44.329389 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd907f2-b363-41ff-bded-8d82eedbc05f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:44.341005 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd907f2-b363-41ff-bded-8d82eedbc05f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:44.342742 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd907f2-b363-41ff-bded-8d82eedbc05f service glance] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:44.366062 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1344/2670] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:44.567715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872f510-9249-47e4-a441-9233fdcc6686 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:44.567715 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5872f510-9249-47e4-a441-9233fdcc6686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:44.578468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:44.707197 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872f510-9249-47e4-a441-9233fdcc6686 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:44.721710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dc3ed-cf11-475f-9219-aeec59ba9422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:44.722582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dc3ed-cf11-475f-9219-aeec59ba9422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:44.723047 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dc3ed-cf11-475f-9219-aeec59ba9422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:44.723469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dc3ed-cf11-475f-9219-aeec59ba9422 admin admin] PATH_INFO: `/v3/projects/c25c369e47c2443b9a2136d60ea6962e` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:44.725131 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1dc3ed-cf11-475f-9219-aeec59ba9422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c25c369e47c2443b9a2136d60ea6962e)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:44.725907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:44.728162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1dc3ed-cf11-475f-9219-aeec59ba9422 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:44.877381 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6c1dc3ed-cf11-475f-9219-aeec59ba9422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c25c369e47c2443b9a2136d60ea6962e', 'request_id': 'req-6c1dc3ed-cf11-475f-9219-aeec59ba9422'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:44.980068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6c1dc3ed-cf11-475f-9219-aeec59ba9422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c25c369e47c2443b9a2136d60ea6962e', 'request_id': 'req-6c1dc3ed-cf11-475f-9219-aeec59ba9422'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:44.989241 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6c1dc3ed-cf11-475f-9219-aeec59ba9422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c25c369e47c2443b9a2136d60ea6962e', 'request_id': 'req-6c1dc3ed-cf11-475f-9219-aeec59ba9422'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:45.000814 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6c1dc3ed-cf11-475f-9219-aeec59ba9422 admin admin] The token cache is being invalidate because project c25c369e47c2443b9a2136d60ea6962e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:45.001889 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6c1dc3ed-cf11-475f-9219-aeec59ba9422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:45.002631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6c1dc3ed-cf11-475f-9219-aeec59ba9422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:45.004207 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1327/2671] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:44 2022] DELETE /identity/v3/projects/c25c369e47c2443b9a2136d60ea6962e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:45.009621 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f827cd-0ef4-46d9-a6e5-a9df844a186f None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.010123 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f827cd-0ef4-46d9-a6e5-a9df844a186f None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.010746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f827cd-0ef4-46d9-a6e5-a9df844a186f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.032765 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-f7f827cd-0ef4-46d9-a6e5-a9df844a186f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:45.034356 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f7f827cd-0ef4-46d9-a6e5-a9df844a186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:45.141944 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1345/2672] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:45.146977 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb86e2-11ed-45be-80d2-a8ad420a6c4e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.147753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb86e2-11ed-45be-80d2-a8ad420a6c4e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.148266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb86e2-11ed-45be-80d2-a8ad420a6c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.170440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-5eeb86e2-11ed-45be-80d2-a8ad420a6c4e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:45.172512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5eeb86e2-11ed-45be-80d2-a8ad420a6c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:45.186914 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1328/2673] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:45.192273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f827cd-0ef4-46d9-a6e5-a9df844a186f None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:45.202901 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f827cd-0ef4-46d9-a6e5-a9df844a186f None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:45.208530 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177228d5-63a4-4400-8c07-3cfbde87514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:45.209168 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177228d5-63a4-4400-8c07-3cfbde87514b admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.209446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177228d5-63a4-4400-8c07-3cfbde87514b admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.209744 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177228d5-63a4-4400-8c07-3cfbde87514b admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.210445 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177228d5-63a4-4400-8c07-3cfbde87514b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:45.210747 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177228d5-63a4-4400-8c07-3cfbde87514b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:45.212503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177228d5-63a4-4400-8c07-3cfbde87514b admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:45.224835 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1346/2674] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:45.229366 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb86e2-11ed-45be-80d2-a8ad420a6c4e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:45.243938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb86e2-11ed-45be-80d2-a8ad420a6c4e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:45.253107 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c221a-f36e-4294-a14e-fa4dcb8d539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:45.254101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c221a-f36e-4294-a14e-fa4dcb8d539e admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.254758 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c221a-f36e-4294-a14e-fa4dcb8d539e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.255266 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c221a-f36e-4294-a14e-fa4dcb8d539e admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.256052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c221a-f36e-4294-a14e-fa4dcb8d539e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:45.261508 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c221a-f36e-4294-a14e-fa4dcb8d539e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:45.403013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1329/2675] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:45 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:45.408162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177228d5-63a4-4400-8c07-3cfbde87514b admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:45.419745 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177228d5-63a4-4400-8c07-3cfbde87514b admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:45.554316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bebe1-dc0f-4581-9c53-871ba872fd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:45.555414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bebe1-dc0f-4581-9c53-871ba872fd03 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.555866 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bebe1-dc0f-4581-9c53-871ba872fd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.556299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bebe1-dc0f-4581-9c53-871ba872fd03 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.557136 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bebe1-dc0f-4581-9c53-871ba872fd03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:45.559296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bebe1-dc0f-4581-9c53-871ba872fd03 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:45.715746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1347/2676] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:45 2022] POST /identity/v3/users => generated 292 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:45.718524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c221a-f36e-4294-a14e-fa4dcb8d539e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:45.730370 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c221a-f36e-4294-a14e-fa4dcb8d539e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:45.736611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a2a7-f12a-4bae-bdc9-8526ce40f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:45.739108 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a2a7-f12a-4bae-bdc9-8526ce40f0fb admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.739108 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a2a7-f12a-4bae-bdc9-8526ce40f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.739108 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a2a7-f12a-4bae-bdc9-8526ce40f0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.739108 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945a2a7-f12a-4bae-bdc9-8526ce40f0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:45.740429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945a2a7-f12a-4bae-bdc9-8526ce40f0fb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:45.753127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1330/2677] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:45.757030 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bebe1-dc0f-4581-9c53-871ba872fd03 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:45.768699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bebe1-dc0f-4581-9c53-871ba872fd03 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:45.773893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68555dda-770d-4262-8e49-c6f2fd645e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:45.774542 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68555dda-770d-4262-8e49-c6f2fd645e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.774829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68555dda-770d-4262-8e49-c6f2fd645e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.775107 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68555dda-770d-4262-8e49-c6f2fd645e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.775816 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68555dda-770d-4262-8e49-c6f2fd645e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:45.777514 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68555dda-770d-4262-8e49-c6f2fd645e17 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:45.790045 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1348/2678] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:45.794426 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a2a7-f12a-4bae-bdc9-8526ce40f0fb admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:45.805520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a2a7-f12a-4bae-bdc9-8526ce40f0fb admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:45.810184 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0068f-bad5-47c4-b666-57605c5d17fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:45.810898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0068f-bad5-47c4-b666-57605c5d17fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.811181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0068f-bad5-47c4-b666-57605c5d17fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.811460 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0068f-bad5-47c4-b666-57605c5d17fb admin admin] PATH_INFO: `/v3/projects/3b943474d46246eea1e484012a6a2cc9/users/8932249d3803489296e8da12a32c7621/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.831247 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0068f-bad5-47c4-b666-57605c5d17fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b943474d46246eea1e484012a6a2cc9, user_id=8932249d3803489296e8da12a32c7621, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:45.834023 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0068f-bad5-47c4-b666-57605c5d17fb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:45.937369 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1331/2679] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:45 2022] PUT /identity/v3/projects/3b943474d46246eea1e484012a6a2cc9/users/8932249d3803489296e8da12a32c7621/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:45.949238 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c5474-927f-4997-b979-c384c623adf5 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.949556 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c5474-927f-4997-b979-c384c623adf5 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.950020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c5474-927f-4997-b979-c384c623adf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.981236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-b98c5474-927f-4997-b979-c384c623adf5 None None] MFA Rules not processed for user `8932249d3803489296e8da12a32c7621`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:45.982313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-b98c5474-927f-4997-b979-c384c623adf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:46.035925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:46.053099 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1349/2680] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:46.057623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0068f-bad5-47c4-b666-57605c5d17fb admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:46.095552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:46.125017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0068f-bad5-47c4-b666-57605c5d17fb admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:46.130442 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495e4c4-a80e-4783-a840-9aa6ec52d949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:46.131080 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495e4c4-a80e-4783-a840-9aa6ec52d949 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:46.133074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495e4c4-a80e-4783-a840-9aa6ec52d949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:46.133074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495e4c4-a80e-4783-a840-9aa6ec52d949 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:46.133074 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495e4c4-a80e-4783-a840-9aa6ec52d949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:46.135913 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495e4c4-a80e-4783-a840-9aa6ec52d949 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:46.227037 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1332/2681] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:46 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:46.231049 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c5474-927f-4997-b979-c384c623adf5 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:46.245265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c5474-927f-4997-b979-c384c623adf5 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:46.307656 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbfbc0-42c0-4362-bea8-66648031d90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:46.308393 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbfbc0-42c0-4362-bea8-66648031d90c admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:46.308757 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbfbc0-42c0-4362-bea8-66648031d90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:46.309105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbfbc0-42c0-4362-bea8-66648031d90c admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:46.310037 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbfbc0-42c0-4362-bea8-66648031d90c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:46.312039 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbfbc0-42c0-4362-bea8-66648031d90c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:46.426295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1350/2682] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:46 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:46.430699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495e4c4-a80e-4783-a840-9aa6ec52d949 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:46.441234 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495e4c4-a80e-4783-a840-9aa6ec52d949 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:46.446270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46589178-a737-4fc9-aa95-4a66b05fcc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:46.447073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46589178-a737-4fc9-aa95-4a66b05fcc4f admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:46.447356 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46589178-a737-4fc9-aa95-4a66b05fcc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:46.447639 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46589178-a737-4fc9-aa95-4a66b05fcc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:46.448429 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46589178-a737-4fc9-aa95-4a66b05fcc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:46.450068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46589178-a737-4fc9-aa95-4a66b05fcc4f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:46.461291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1333/2683] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:46.465564 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbfbc0-42c0-4362-bea8-66648031d90c admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:46.476539 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbfbc0-42c0-4362-bea8-66648031d90c admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:46.481140 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4b456-0a85-41cf-b9fc-0901b6ba7e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:46.481789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4b456-0a85-41cf-b9fc-0901b6ba7e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:46.482077 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4b456-0a85-41cf-b9fc-0901b6ba7e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:46.482383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4b456-0a85-41cf-b9fc-0901b6ba7e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:46.483083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4b456-0a85-41cf-b9fc-0901b6ba7e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:46.484695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4b456-0a85-41cf-b9fc-0901b6ba7e78 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:46.496064 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1351/2684] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:46.499975 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46589178-a737-4fc9-aa95-4a66b05fcc4f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:46.510499 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46589178-a737-4fc9-aa95-4a66b05fcc4f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:46.515041 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8e6a7-a7de-4f5c-bbe7-3a9570346411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:46.515697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8e6a7-a7de-4f5c-bbe7-3a9570346411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:46.515980 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8e6a7-a7de-4f5c-bbe7-3a9570346411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:46.516258 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8e6a7-a7de-4f5c-bbe7-3a9570346411 admin admin] PATH_INFO: `/v3/projects/b175cfb06836483195010c2f544e3e80/users/533a0d95b668413ab2621ae0f5994e9f/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:46.531693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8e6a7-a7de-4f5c-bbe7-3a9570346411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b175cfb06836483195010c2f544e3e80, user_id=533a0d95b668413ab2621ae0f5994e9f, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:46.535007 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8e6a7-a7de-4f5c-bbe7-3a9570346411 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:46.644171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1334/2685] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:46 2022] PUT /identity/v3/projects/b175cfb06836483195010c2f544e3e80/users/533a0d95b668413ab2621ae0f5994e9f/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:46.717385 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ff74c-9885-4aa5-ab46-bea94d266c2a None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:46.717727 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ff74c-9885-4aa5-ab46-bea94d266c2a None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:46.718012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ff74c-9885-4aa5-ab46-bea94d266c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:46.748615 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-216ff74c-9885-4aa5-ab46-bea94d266c2a None None] MFA Rules not processed for user `533a0d95b668413ab2621ae0f5994e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:46.749805 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-216ff74c-9885-4aa5-ab46-bea94d266c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:46.943156 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1352/2686] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:46.947913 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8e6a7-a7de-4f5c-bbe7-3a9570346411 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:47.020269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8e6a7-a7de-4f5c-bbe7-3a9570346411 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:47.026892 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228caec4-1983-4eb4-a5c0-b524759e11d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:47.027753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228caec4-1983-4eb4-a5c0-b524759e11d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:47.028222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228caec4-1983-4eb4-a5c0-b524759e11d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:47.028601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228caec4-1983-4eb4-a5c0-b524759e11d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:47.029458 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228caec4-1983-4eb4-a5c0-b524759e11d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:47.032095 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228caec4-1983-4eb4-a5c0-b524759e11d8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:47.190812 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1335/2687] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:46 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:47.195042 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ff74c-9885-4aa5-ab46-bea94d266c2a None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:47.207389 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ff74c-9885-4aa5-ab46-bea94d266c2a None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:47.274145 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719080a0-9dbc-40d4-82e9-64d5a01106c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:47.274841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719080a0-9dbc-40d4-82e9-64d5a01106c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:47.275062 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719080a0-9dbc-40d4-82e9-64d5a01106c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:47.275555 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719080a0-9dbc-40d4-82e9-64d5a01106c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:47.276321 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719080a0-9dbc-40d4-82e9-64d5a01106c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:47.278487 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719080a0-9dbc-40d4-82e9-64d5a01106c9 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:47.286570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:47.363559 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1353/2688] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:47 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:47.367630 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228caec4-1983-4eb4-a5c0-b524759e11d8 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:47.379241 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228caec4-1983-4eb4-a5c0-b524759e11d8 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:47.384310 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4246970-1da8-4296-8049-e4a7db00265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:47.385054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4246970-1da8-4296-8049-e4a7db00265d admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:47.385282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4246970-1da8-4296-8049-e4a7db00265d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:47.385611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4246970-1da8-4296-8049-e4a7db00265d admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:47.386374 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4246970-1da8-4296-8049-e4a7db00265d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:47.391744 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4246970-1da8-4296-8049-e4a7db00265d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:47.400566 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1336/2689] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:47.404932 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719080a0-9dbc-40d4-82e9-64d5a01106c9 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:47.415269 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719080a0-9dbc-40d4-82e9-64d5a01106c9 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:47.420403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae739d9-acbe-4536-aded-29570638305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:47.420528 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae739d9-acbe-4536-aded-29570638305c admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:47.420803 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae739d9-acbe-4536-aded-29570638305c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:47.421081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae739d9-acbe-4536-aded-29570638305c admin admin] PATH_INFO: `/v3/projects/bd67012207ce4137880f8b6bf65209b2/users/92d1472ec8ba45559639b6df326449bb/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:47.437931 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae739d9-acbe-4536-aded-29570638305c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd67012207ce4137880f8b6bf65209b2, user_id=92d1472ec8ba45559639b6df326449bb, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:47.441252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae739d9-acbe-4536-aded-29570638305c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:47.557620 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1354/2690] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:47 2022] PUT /identity/v3/projects/bd67012207ce4137880f8b6bf65209b2/users/92d1472ec8ba45559639b6df326449bb/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:47.561724 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4246970-1da8-4296-8049-e4a7db00265d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:47.572238 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4246970-1da8-4296-8049-e4a7db00265d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:47.625007 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:47.631827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d2a25-596b-4c88-942e-96deeaa2ce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:47.632457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d2a25-596b-4c88-942e-96deeaa2ce31 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:47.632738 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d2a25-596b-4c88-942e-96deeaa2ce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:47.633013 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d2a25-596b-4c88-942e-96deeaa2ce31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:47.635834 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d2a25-596b-4c88-942e-96deeaa2ce31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:47.635834 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d2a25-596b-4c88-942e-96deeaa2ce31 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:47.646716 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1337/2691] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:47.651363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae739d9-acbe-4536-aded-29570638305c admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:47.662629 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae739d9-acbe-4536-aded-29570638305c admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:47.667369 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacbdc3-37cc-4628-98ca-9b77029066a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:47.681417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacbdc3-37cc-4628-98ca-9b77029066a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:47.681417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacbdc3-37cc-4628-98ca-9b77029066a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:47.681417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacbdc3-37cc-4628-98ca-9b77029066a6 admin admin] PATH_INFO: `/v3/projects/bd67012207ce4137880f8b6bf65209b2/users/92d1472ec8ba45559639b6df326449bb/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:47.681417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacbdc3-37cc-4628-98ca-9b77029066a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd67012207ce4137880f8b6bf65209b2, user_id=92d1472ec8ba45559639b6df326449bb, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:47.681417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacbdc3-37cc-4628-98ca-9b77029066a6 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:47.686889 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1355/2692] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:47 2022] PUT /identity/v3/projects/bd67012207ce4137880f8b6bf65209b2/users/92d1472ec8ba45559639b6df326449bb/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:47.698698 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09e2cb-f77c-48b1-b30a-36afdbaae154 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:47.698985 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09e2cb-f77c-48b1-b30a-36afdbaae154 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:47.702555 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09e2cb-f77c-48b1-b30a-36afdbaae154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:47.737892 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ac09e2cb-f77c-48b1-b30a-36afdbaae154 None None] MFA Rules not processed for user `92d1472ec8ba45559639b6df326449bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:47.739787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ac09e2cb-f77c-48b1-b30a-36afdbaae154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:47.834558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1338/2693] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:47.846777 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacbdc3-37cc-4628-98ca-9b77029066a6 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:47.848862 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-eeacbdc3-37cc-4628-98ca-9b77029066a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:47.915519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacbdc3-37cc-4628-98ca-9b77029066a6 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:47.919469 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecd510-7435-4b36-9073-8c0a8af4d402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:47.920097 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecd510-7435-4b36-9073-8c0a8af4d402 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:47.920377 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecd510-7435-4b36-9073-8c0a8af4d402 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:47.920654 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecd510-7435-4b36-9073-8c0a8af4d402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:47.991405 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecd510-7435-4b36-9073-8c0a8af4d402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:47.993096 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecd510-7435-4b36-9073-8c0a8af4d402 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:48.003523 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1356/2694] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:50.037969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09e2cb-f77c-48b1-b30a-36afdbaae154 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:50.039492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ac09e2cb-f77c-48b1-b30a-36afdbaae154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:50.052274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09e2cb-f77c-48b1-b30a-36afdbaae154 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:50.056036 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e78b4-3fc1-4522-8e04-2cd35ebf9f52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:50.056649 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e78b4-3fc1-4522-8e04-2cd35ebf9f52 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:50.056943 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e78b4-3fc1-4522-8e04-2cd35ebf9f52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:50.057244 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e78b4-3fc1-4522-8e04-2cd35ebf9f52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:50.117391 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e78b4-3fc1-4522-8e04-2cd35ebf9f52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:50.119101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e78b4-3fc1-4522-8e04-2cd35ebf9f52 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:50.129902 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1339/2695] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:51.077808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecd510-7435-4b36-9073-8c0a8af4d402 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:51.079287 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-69ecd510-7435-4b36-9073-8c0a8af4d402 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:51.149984 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecd510-7435-4b36-9073-8c0a8af4d402 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:51.154846 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c12dc-a0b6-45ff-8a87-52e5f6a04f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:51.155493 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c12dc-a0b6-45ff-8a87-52e5f6a04f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.155778 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c12dc-a0b6-45ff-8a87-52e5f6a04f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.156062 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c12dc-a0b6-45ff-8a87-52e5f6a04f7a admin admin] PATH_INFO: `/v3/users/7096f59e9e78416d95fc5aadddae640e` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.157246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c12dc-a0b6-45ff-8a87-52e5f6a04f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7096f59e9e78416d95fc5aadddae640e)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:51.159775 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c12dc-a0b6-45ff-8a87-52e5f6a04f7a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:51.165282 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:51.372126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-603c12dc-a0b6-45ff-8a87-52e5f6a04f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7096f59e9e78416d95fc5aadddae640e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:51.372908 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-603c12dc-a0b6-45ff-8a87-52e5f6a04f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7096f59e9e78416d95fc5aadddae640e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:51.436971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-603c12dc-a0b6-45ff-8a87-52e5f6a04f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7096f59e9e78416d95fc5aadddae640e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:51.445513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-603c12dc-a0b6-45ff-8a87-52e5f6a04f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7096f59e9e78416d95fc5aadddae640e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:51.458578 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-603c12dc-a0b6-45ff-8a87-52e5f6a04f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7096f59e9e78416d95fc5aadddae640e'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:51.464729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1357/2696] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:51 2022] DELETE /identity/v3/users/7096f59e9e78416d95fc5aadddae640e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:51.469571 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed38ba-0b02-430c-ba11-bc96e1d89cb9 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.470659 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed38ba-0b02-430c-ba11-bc96e1d89cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.471482 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed38ba-0b02-430c-ba11-bc96e1d89cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.498815 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b0ed38ba-0b02-430c-ba11-bc96e1d89cb9 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:51.500681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b0ed38ba-0b02-430c-ba11-bc96e1d89cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:51.567709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1340/2697] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:51.579221 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c12dc-a0b6-45ff-8a87-52e5f6a04f7a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:51.581702 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-603c12dc-a0b6-45ff-8a87-52e5f6a04f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:51.629324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed38ba-0b02-430c-ba11-bc96e1d89cb9 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:51.631342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b0ed38ba-0b02-430c-ba11-bc96e1d89cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:51.647680 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c12dc-a0b6-45ff-8a87-52e5f6a04f7a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:51.651874 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739c87f-8cf0-4e49-943c-a6772c8f3a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:51.652501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739c87f-8cf0-4e49-943c-a6772c8f3a30 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.652801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739c87f-8cf0-4e49-943c-a6772c8f3a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.653095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739c87f-8cf0-4e49-943c-a6772c8f3a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.655324 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:51.664902 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739c87f-8cf0-4e49-943c-a6772c8f3a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:51.673734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739c87f-8cf0-4e49-943c-a6772c8f3a30 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:51.677966 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1358/2698] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:51.696973 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed38ba-0b02-430c-ba11-bc96e1d89cb9 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:51.700593 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b781792-1587-4cfc-9d5b-2c5d717b9e12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:51.701225 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b781792-1587-4cfc-9d5b-2c5d717b9e12 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.701540 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b781792-1587-4cfc-9d5b-2c5d717b9e12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.701821 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b781792-1587-4cfc-9d5b-2c5d717b9e12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.703790 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0b781792-1587-4cfc-9d5b-2c5d717b9e12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:51.778029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b781792-1587-4cfc-9d5b-2c5d717b9e12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:51.782763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b781792-1587-4cfc-9d5b-2c5d717b9e12 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:51.790455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1341/2699] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:52.113516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739c87f-8cf0-4e49-943c-a6772c8f3a30 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:52.115405 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7739c87f-8cf0-4e49-943c-a6772c8f3a30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:52.137182 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739c87f-8cf0-4e49-943c-a6772c8f3a30 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:52.142341 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:52.143254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:52.144466 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:52.144466 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72 admin admin] PATH_INFO: `/v3/projects/8290960c56c14a8c878a695aa5a223b0` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:52.145982 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8290960c56c14a8c878a695aa5a223b0)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:52.147873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:52.309917 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8290960c56c14a8c878a695aa5a223b0', 'request_id': 'req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:52.419410 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8290960c56c14a8c878a695aa5a223b0', 'request_id': 'req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:52.426507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8290960c56c14a8c878a695aa5a223b0', 'request_id': 'req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:52.439603 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72 admin admin] The token cache is being invalidate because project 8290960c56c14a8c878a695aa5a223b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:52.439889 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:52.440701 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:52.442290 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1359/2700] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:52 2022] DELETE /identity/v3/projects/8290960c56c14a8c878a695aa5a223b0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:52.446756 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b781792-1587-4cfc-9d5b-2c5d717b9e12 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:52.457888 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b781792-1587-4cfc-9d5b-2c5d717b9e12 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:52.517524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ce138-e59d-4612-a44a-68f5d486e720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:52.518485 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ce138-e59d-4612-a44a-68f5d486e720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:52.518713 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ce138-e59d-4612-a44a-68f5d486e720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:52.518986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ce138-e59d-4612-a44a-68f5d486e720 admin admin] PATH_INFO: `/v3/users/c2495db139a24392a1b4b1be1c26884e` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:52.520145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ce138-e59d-4612-a44a-68f5d486e720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2495db139a24392a1b4b1be1c26884e)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:52.522214 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ce138-e59d-4612-a44a-68f5d486e720 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:52.757382 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e47ce138-e59d-4612-a44a-68f5d486e720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2495db139a24392a1b4b1be1c26884e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:52.758137 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e47ce138-e59d-4612-a44a-68f5d486e720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2495db139a24392a1b4b1be1c26884e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:52.836913 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e47ce138-e59d-4612-a44a-68f5d486e720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2495db139a24392a1b4b1be1c26884e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:52.848875 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:52.850210 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e47ce138-e59d-4612-a44a-68f5d486e720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2495db139a24392a1b4b1be1c26884e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:52.850832 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e47ce138-e59d-4612-a44a-68f5d486e720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2495db139a24392a1b4b1be1c26884e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:52.863709 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1342/2701] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:52 2022] DELETE /identity/v3/users/c2495db139a24392a1b4b1be1c26884e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:53.399883 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:53.404952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:53.422198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fc66c-64af-4577-ae2a-ad3043f5ad72 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:53.430819 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:53.481054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4c367-87d3-46e9-ac42-d35af52a79a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:53.481731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4c367-87d3-46e9-ac42-d35af52a79a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:53.482013 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4c367-87d3-46e9-ac42-d35af52a79a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:53.482287 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4c367-87d3-46e9-ac42-d35af52a79a3 admin admin] PATH_INFO: `/v3/projects/0b3a27f50a584946a95bd3a9149be1d0` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:53.483446 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4c367-87d3-46e9-ac42-d35af52a79a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3a27f50a584946a95bd3a9149be1d0)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:53.485324 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4c367-87d3-46e9-ac42-d35af52a79a3 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:53.628444 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-74e4c367-87d3-46e9-ac42-d35af52a79a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3a27f50a584946a95bd3a9149be1d0', 'request_id': 'req-74e4c367-87d3-46e9-ac42-d35af52a79a3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:53.688467 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-74e4c367-87d3-46e9-ac42-d35af52a79a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3a27f50a584946a95bd3a9149be1d0', 'request_id': 'req-74e4c367-87d3-46e9-ac42-d35af52a79a3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:53.697920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-74e4c367-87d3-46e9-ac42-d35af52a79a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3a27f50a584946a95bd3a9149be1d0', 'request_id': 'req-74e4c367-87d3-46e9-ac42-d35af52a79a3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:53.709898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-74e4c367-87d3-46e9-ac42-d35af52a79a3 admin admin] The token cache is being invalidate because project 0b3a27f50a584946a95bd3a9149be1d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:53.710320 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-74e4c367-87d3-46e9-ac42-d35af52a79a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:53.710885 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-74e4c367-87d3-46e9-ac42-d35af52a79a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:53.712417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1360/2702] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:53 2022] DELETE /identity/v3/projects/0b3a27f50a584946a95bd3a9149be1d0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:53.717372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84b1bf-b43f-424b-9d65-9f5ed5f8624c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:53.717881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84b1bf-b43f-424b-9d65-9f5ed5f8624c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:53.717978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84b1bf-b43f-424b-9d65-9f5ed5f8624c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:53.741149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9b84b1bf-b43f-424b-9d65-9f5ed5f8624c None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:53.741149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9b84b1bf-b43f-424b-9d65-9f5ed5f8624c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:53.804932 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1343/2703] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:53.813108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d84a4-9938-4f4c-9a58-254d282b9328 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:53.813258 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d84a4-9938-4f4c-9a58-254d282b9328 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:53.813454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d84a4-9938-4f4c-9a58-254d282b9328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:53.836511 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-254d84a4-9938-4f4c-9a58-254d282b9328 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:53.837891 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-254d84a4-9938-4f4c-9a58-254d282b9328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:53.846570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1361/2704] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:53.851261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84b1bf-b43f-424b-9d65-9f5ed5f8624c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:53.862303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84b1bf-b43f-424b-9d65-9f5ed5f8624c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:53.866962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a8cfa-4e14-4d86-a6fc-52e917528e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:53.867712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a8cfa-4e14-4d86-a6fc-52e917528e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:53.868022 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a8cfa-4e14-4d86-a6fc-52e917528e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:53.868305 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a8cfa-4e14-4d86-a6fc-52e917528e0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:53.869007 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a8cfa-4e14-4d86-a6fc-52e917528e0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:53.869319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a8cfa-4e14-4d86-a6fc-52e917528e0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:53.871078 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a8cfa-4e14-4d86-a6fc-52e917528e0b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:53.887525 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1344/2705] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:39:53.889197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d84a4-9938-4f4c-9a58-254d282b9328 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:53.898877 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d84a4-9938-4f4c-9a58-254d282b9328 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:53.903632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f0e4a-55f7-410e-9ec1-c04c4f1768fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:53.908317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f0e4a-55f7-410e-9ec1-c04c4f1768fc admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:53.908317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f0e4a-55f7-410e-9ec1-c04c4f1768fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:53.908317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f0e4a-55f7-410e-9ec1-c04c4f1768fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:53.908317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f0e4a-55f7-410e-9ec1-c04c4f1768fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:53.908317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f0e4a-55f7-410e-9ec1-c04c4f1768fc admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:54.015673 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1362/2706] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:53 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:54.022481 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a8cfa-4e14-4d86-a6fc-52e917528e0b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:54.034794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a8cfa-4e14-4d86-a6fc-52e917528e0b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:54.092352 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3e2e1-c9a8-482d-9f8b-2eadbdb3449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:54.092900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3e2e1-c9a8-482d-9f8b-2eadbdb3449d admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:54.093229 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3e2e1-c9a8-482d-9f8b-2eadbdb3449d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:54.093528 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3e2e1-c9a8-482d-9f8b-2eadbdb3449d admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:54.094181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3e2e1-c9a8-482d-9f8b-2eadbdb3449d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:54.096612 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3e2e1-c9a8-482d-9f8b-2eadbdb3449d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:54.168882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1345/2707] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:54 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:54.173729 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f0e4a-55f7-410e-9ec1-c04c4f1768fc admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:54.184297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f0e4a-55f7-410e-9ec1-c04c4f1768fc admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:54.189876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01433dc3-8ffb-4e98-ae88-44f30edf5a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:54.190531 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01433dc3-8ffb-4e98-ae88-44f30edf5a66 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:54.190816 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01433dc3-8ffb-4e98-ae88-44f30edf5a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:54.192663 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01433dc3-8ffb-4e98-ae88-44f30edf5a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:54.193419 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01433dc3-8ffb-4e98-ae88-44f30edf5a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:54.195143 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01433dc3-8ffb-4e98-ae88-44f30edf5a66 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:54.208161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1363/2708] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:54.216887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3e2e1-c9a8-482d-9f8b-2eadbdb3449d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:54.227476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3e2e1-c9a8-482d-9f8b-2eadbdb3449d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:54.232512 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcde486-82b5-4268-9032-14e4d4f14296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:54.233127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcde486-82b5-4268-9032-14e4d4f14296 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:54.233408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcde486-82b5-4268-9032-14e4d4f14296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:54.233720 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcde486-82b5-4268-9032-14e4d4f14296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:54.234414 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcde486-82b5-4268-9032-14e4d4f14296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:54.236052 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcde486-82b5-4268-9032-14e4d4f14296 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:54.247240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1346/2709] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:54.256822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01433dc3-8ffb-4e98-ae88-44f30edf5a66 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:54.269851 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01433dc3-8ffb-4e98-ae88-44f30edf5a66 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:54.275001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93843b9-8556-4b52-b737-41c0ab8b26a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:54.275688 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93843b9-8556-4b52-b737-41c0ab8b26a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:54.276001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93843b9-8556-4b52-b737-41c0ab8b26a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:54.276279 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93843b9-8556-4b52-b737-41c0ab8b26a3 admin admin] PATH_INFO: `/v3/projects/07fbc873261943e88953274d9d6b9b06/users/d8f2e26f89624edeb7d13fae9eb12ed3/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:54.292206 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93843b9-8556-4b52-b737-41c0ab8b26a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07fbc873261943e88953274d9d6b9b06, user_id=d8f2e26f89624edeb7d13fae9eb12ed3, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:54.294853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93843b9-8556-4b52-b737-41c0ab8b26a3 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:54.391120 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1364/2710] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:54 2022] PUT /identity/v3/projects/07fbc873261943e88953274d9d6b9b06/users/d8f2e26f89624edeb7d13fae9eb12ed3/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:54.403645 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c690d-4251-475f-92de-29aa918c77a3 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:54.403936 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c690d-4251-475f-92de-29aa918c77a3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:54.404217 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c690d-4251-475f-92de-29aa918c77a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:54.434302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-279c690d-4251-475f-92de-29aa918c77a3 None None] MFA Rules not processed for user `d8f2e26f89624edeb7d13fae9eb12ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:54.435547 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-279c690d-4251-475f-92de-29aa918c77a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:54.479076 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:54.501784 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1347/2711] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:54.506649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93843b9-8556-4b52-b737-41c0ab8b26a3 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:54.550428 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:54.570936 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93843b9-8556-4b52-b737-41c0ab8b26a3 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:54.575694 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9704227-64a7-489d-a679-824a566b5528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:54.576316 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9704227-64a7-489d-a679-824a566b5528 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:54.576601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9704227-64a7-489d-a679-824a566b5528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:54.576879 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9704227-64a7-489d-a679-824a566b5528 admin admin] PATH_INFO: `/v3/projects` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:54.577585 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9704227-64a7-489d-a679-824a566b5528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:54.579965 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9704227-64a7-489d-a679-824a566b5528 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:54.684553 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1365/2712] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:54 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:54.688759 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c690d-4251-475f-92de-29aa918c77a3 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:54.699877 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c690d-4251-475f-92de-29aa918c77a3 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:54.761922 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefe77f-92dc-46d1-988a-dd527d50de83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:54.762538 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefe77f-92dc-46d1-988a-dd527d50de83 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:54.762826 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefe77f-92dc-46d1-988a-dd527d50de83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:54.763105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefe77f-92dc-46d1-988a-dd527d50de83 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:54.763773 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefe77f-92dc-46d1-988a-dd527d50de83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:54.765821 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefe77f-92dc-46d1-988a-dd527d50de83 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:54.849066 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1348/2713] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:54 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:54.853302 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9704227-64a7-489d-a679-824a566b5528 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:54.865161 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9704227-64a7-489d-a679-824a566b5528 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:54.870706 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79019c-489a-4cd7-8545-73b7c013821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:54.871343 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79019c-489a-4cd7-8545-73b7c013821f admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:54.871623 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79019c-489a-4cd7-8545-73b7c013821f admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:54.871895 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79019c-489a-4cd7-8545-73b7c013821f admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:54.872592 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79019c-489a-4cd7-8545-73b7c013821f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:54.874443 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79019c-489a-4cd7-8545-73b7c013821f admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:54.885699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1366/2714] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:54.890378 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefe77f-92dc-46d1-988a-dd527d50de83 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:54.901313 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefe77f-92dc-46d1-988a-dd527d50de83 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:54.905863 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ec41e-6f23-48d4-91e6-c0a12a57319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:54.906520 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ec41e-6f23-48d4-91e6-c0a12a57319a admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:54.906823 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ec41e-6f23-48d4-91e6-c0a12a57319a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:54.907064 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ec41e-6f23-48d4-91e6-c0a12a57319a admin admin] PATH_INFO: `/v3/projects/cd97044760004696b181df7868f3cbed/users/5951d22be4df412ca5c9d04a8b1c6df9/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:54.928554 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ec41e-6f23-48d4-91e6-c0a12a57319a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd97044760004696b181df7868f3cbed, user_id=5951d22be4df412ca5c9d04a8b1c6df9, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:54.931217 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ec41e-6f23-48d4-91e6-c0a12a57319a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:55.020350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1349/2715] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:54 2022] PUT /identity/v3/projects/cd97044760004696b181df7868f3cbed/users/5951d22be4df412ca5c9d04a8b1c6df9/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:55.027245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79019c-489a-4cd7-8545-73b7c013821f admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:55.039700 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79019c-489a-4cd7-8545-73b7c013821f admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:55.101217 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa190cf6-720e-4252-84bf-22b9754f28bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:55.102090 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa190cf6-720e-4252-84bf-22b9754f28bf admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:55.102400 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa190cf6-720e-4252-84bf-22b9754f28bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:55.102643 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa190cf6-720e-4252-84bf-22b9754f28bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:55.106324 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa190cf6-720e-4252-84bf-22b9754f28bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:55.106324 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa190cf6-720e-4252-84bf-22b9754f28bf admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:55.119508 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1367/2716] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:55.120758 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ec41e-6f23-48d4-91e6-c0a12a57319a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:55.131964 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ec41e-6f23-48d4-91e6-c0a12a57319a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:55.136940 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cdeb7-594b-4421-9522-f0c8b707f327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:55.138080 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cdeb7-594b-4421-9522-f0c8b707f327 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:55.138080 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cdeb7-594b-4421-9522-f0c8b707f327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:55.138080 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cdeb7-594b-4421-9522-f0c8b707f327 admin admin] PATH_INFO: `/v3/projects/cd97044760004696b181df7868f3cbed/users/5951d22be4df412ca5c9d04a8b1c6df9/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:55.141249 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cdeb7-594b-4421-9522-f0c8b707f327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd97044760004696b181df7868f3cbed, user_id=5951d22be4df412ca5c9d04a8b1c6df9, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:55.144775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cdeb7-594b-4421-9522-f0c8b707f327 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:55.159842 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1350/2717] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:55 2022] PUT /identity/v3/projects/cd97044760004696b181df7868f3cbed/users/5951d22be4df412ca5c9d04a8b1c6df9/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:55.170257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce07d4-70c7-4751-aaca-2f8e9a862084 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:55.170543 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce07d4-70c7-4751-aaca-2f8e9a862084 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:55.170844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce07d4-70c7-4751-aaca-2f8e9a862084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:55.200882 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-b7ce07d4-70c7-4751-aaca-2f8e9a862084 None None] MFA Rules not processed for user `5951d22be4df412ca5c9d04a8b1c6df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:55.202348 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-b7ce07d4-70c7-4751-aaca-2f8e9a862084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:55.290545 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1368/2718] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:55.307978 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cdeb7-594b-4421-9522-f0c8b707f327 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:55.309713 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-da0cdeb7-594b-4421-9522-f0c8b707f327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:55.375681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cdeb7-594b-4421-9522-f0c8b707f327 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:55.380083 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc89616-5d71-4d7d-9e73-0a46f7a95734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:55.380924 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc89616-5d71-4d7d-9e73-0a46f7a95734 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:55.381248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc89616-5d71-4d7d-9e73-0a46f7a95734 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:55.381597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc89616-5d71-4d7d-9e73-0a46f7a95734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:55.393273 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc89616-5d71-4d7d-9e73-0a46f7a95734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:55.394735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc89616-5d71-4d7d-9e73-0a46f7a95734 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:55.404938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1351/2719] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:55.435381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce07d4-70c7-4751-aaca-2f8e9a862084 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:55.479781 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:55.509188 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce07d4-70c7-4751-aaca-2f8e9a862084 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:55.513842 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ca20f-9920-447a-950d-5210db61edfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:55.514484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ca20f-9920-447a-950d-5210db61edfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:55.514788 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ca20f-9920-447a-950d-5210db61edfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:55.515059 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ca20f-9920-447a-950d-5210db61edfa admin admin] PATH_INFO: `/v3/users/d8f2e26f89624edeb7d13fae9eb12ed3` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:55.516236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ca20f-9920-447a-950d-5210db61edfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f2e26f89624edeb7d13fae9eb12ed3)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:55.519352 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ca20f-9920-447a-950d-5210db61edfa admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:55.733456 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f57ca20f-9920-447a-950d-5210db61edfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f2e26f89624edeb7d13fae9eb12ed3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:55.734094 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f57ca20f-9920-447a-950d-5210db61edfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f2e26f89624edeb7d13fae9eb12ed3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:55.814398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f57ca20f-9920-447a-950d-5210db61edfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f2e26f89624edeb7d13fae9eb12ed3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:55.822303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f57ca20f-9920-447a-950d-5210db61edfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f2e26f89624edeb7d13fae9eb12ed3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:55.835878 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f57ca20f-9920-447a-950d-5210db61edfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f2e26f89624edeb7d13fae9eb12ed3'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:55.842611 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1369/2720] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:55 2022] DELETE /identity/v3/users/d8f2e26f89624edeb7d13fae9eb12ed3 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:55.847881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058f975-cda1-4682-b8b6-f5af6123cab8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:55.848386 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058f975-cda1-4682-b8b6-f5af6123cab8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:55.848495 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058f975-cda1-4682-b8b6-f5af6123cab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:55.868588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2058f975-cda1-4682-b8b6-f5af6123cab8 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:55.869873 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2058f975-cda1-4682-b8b6-f5af6123cab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:55.906831 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:55.934205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1352/2721] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:55.944288 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ca20f-9920-447a-950d-5210db61edfa admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:55.946358 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f57ca20f-9920-447a-950d-5210db61edfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:56.017460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ca20f-9920-447a-950d-5210db61edfa admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:56.021896 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157017-05b6-45cc-902e-0d48eb321d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:56.022432 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157017-05b6-45cc-902e-0d48eb321d34 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:56.022710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157017-05b6-45cc-902e-0d48eb321d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:56.022982 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157017-05b6-45cc-902e-0d48eb321d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:56.033397 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1157017-05b6-45cc-902e-0d48eb321d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:56.034893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1157017-05b6-45cc-902e-0d48eb321d34 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:56.045691 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1370/2722] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:56.473297 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058f975-cda1-4682-b8b6-f5af6123cab8 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:56.475114 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2058f975-cda1-4682-b8b6-f5af6123cab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:56.489243 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058f975-cda1-4682-b8b6-f5af6123cab8 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:56.495125 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e601c-de76-4687-9d75-f8e996b0ff9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:56.495800 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e601c-de76-4687-9d75-f8e996b0ff9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:56.496200 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e601c-de76-4687-9d75-f8e996b0ff9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:56.496355 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e601c-de76-4687-9d75-f8e996b0ff9b admin admin] PATH_INFO: `/v3/projects/07fbc873261943e88953274d9d6b9b06` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:56.497633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e601c-de76-4687-9d75-f8e996b0ff9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=07fbc873261943e88953274d9d6b9b06)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:56.499697 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e601c-de76-4687-9d75-f8e996b0ff9b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:56.553021 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157017-05b6-45cc-902e-0d48eb321d34 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:56.555089 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c1157017-05b6-45cc-902e-0d48eb321d34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:56.568698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157017-05b6-45cc-902e-0d48eb321d34 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:56.573213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f0c67-3802-4bbb-b30c-c7474f726485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:56.576814 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f0c67-3802-4bbb-b30c-c7474f726485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:56.576814 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f0c67-3802-4bbb-b30c-c7474f726485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:56.576814 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f0c67-3802-4bbb-b30c-c7474f726485 admin admin] PATH_INFO: `/v3/users/8932249d3803489296e8da12a32c7621` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:56.576814 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f0c67-3802-4bbb-b30c-c7474f726485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8932249d3803489296e8da12a32c7621)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:56.577388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f0c67-3802-4bbb-b30c-c7474f726485 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:56.614439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ad7e601c-de76-4687-9d75-f8e996b0ff9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07fbc873261943e88953274d9d6b9b06', 'request_id': 'req-ad7e601c-de76-4687-9d75-f8e996b0ff9b'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:56.705597 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ad7e601c-de76-4687-9d75-f8e996b0ff9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07fbc873261943e88953274d9d6b9b06', 'request_id': 'req-ad7e601c-de76-4687-9d75-f8e996b0ff9b'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:56.712585 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ad7e601c-de76-4687-9d75-f8e996b0ff9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07fbc873261943e88953274d9d6b9b06', 'request_id': 'req-ad7e601c-de76-4687-9d75-f8e996b0ff9b'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:56.723157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ad7e601c-de76-4687-9d75-f8e996b0ff9b admin admin] The token cache is being invalidate because project 07fbc873261943e88953274d9d6b9b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:56.723448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ad7e601c-de76-4687-9d75-f8e996b0ff9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:56.724072 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ad7e601c-de76-4687-9d75-f8e996b0ff9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:56.725630 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1353/2723] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:56 2022] DELETE /identity/v3/projects/07fbc873261943e88953274d9d6b9b06 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:56.729393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e601c-de76-4687-9d75-f8e996b0ff9b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:56.730841 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ad7e601c-de76-4687-9d75-f8e996b0ff9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:56.771814 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-219f0c67-3802-4bbb-b30c-c7474f726485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8932249d3803489296e8da12a32c7621'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:56.772692 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-219f0c67-3802-4bbb-b30c-c7474f726485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8932249d3803489296e8da12a32c7621'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:56.776887 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:56.800881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e601c-de76-4687-9d75-f8e996b0ff9b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:56.805855 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd98a21-d758-468a-b0ad-633a117b2755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:56.806592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd98a21-d758-468a-b0ad-633a117b2755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:56.806823 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd98a21-d758-468a-b0ad-633a117b2755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:56.807101 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd98a21-d758-468a-b0ad-633a117b2755 admin admin] PATH_INFO: `/v3/users/5951d22be4df412ca5c9d04a8b1c6df9` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:56.808290 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd98a21-d758-468a-b0ad-633a117b2755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5951d22be4df412ca5c9d04a8b1c6df9)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:56.810237 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd98a21-d758-468a-b0ad-633a117b2755 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:56.836605 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-219f0c67-3802-4bbb-b30c-c7474f726485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8932249d3803489296e8da12a32c7621'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:56.844620 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-219f0c67-3802-4bbb-b30c-c7474f726485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8932249d3803489296e8da12a32c7621'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:56.857841 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-219f0c67-3802-4bbb-b30c-c7474f726485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8932249d3803489296e8da12a32c7621'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:56.864857 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1371/2724] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:56 2022] DELETE /identity/v3/users/8932249d3803489296e8da12a32c7621 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:56.869566 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c961568-d77a-4dfb-9ba1-312750b0c4d7 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:56.869852 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c961568-d77a-4dfb-9ba1-312750b0c4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:56.870165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c961568-d77a-4dfb-9ba1-312750b0c4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:56.890563 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-3c961568-d77a-4dfb-9ba1-312750b0c4d7 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:56.891805 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-3c961568-d77a-4dfb-9ba1-312750b0c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:56.954930 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1372/2725] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:56.967168 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c961568-d77a-4dfb-9ba1-312750b0c4d7 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:56.968626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-3c961568-d77a-4dfb-9ba1-312750b0c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:56.984683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ddd98a21-d758-468a-b0ad-633a117b2755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5951d22be4df412ca5c9d04a8b1c6df9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:56.985339 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ddd98a21-d758-468a-b0ad-633a117b2755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5951d22be4df412ca5c9d04a8b1c6df9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:57.029387 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c961568-d77a-4dfb-9ba1-312750b0c4d7 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:57.033578 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a931f0-ca37-4e48-b982-2ce9b186e87a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:57.034204 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a931f0-ca37-4e48-b982-2ce9b186e87a service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:57.034484 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a931f0-ca37-4e48-b982-2ce9b186e87a service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:57.034927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a931f0-ca37-4e48-b982-2ce9b186e87a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:57.036728 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-46a931f0-ca37-4e48-b982-2ce9b186e87a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:57.049616 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a931f0-ca37-4e48-b982-2ce9b186e87a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:57.051022 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a931f0-ca37-4e48-b982-2ce9b186e87a service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:57.053688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ddd98a21-d758-468a-b0ad-633a117b2755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5951d22be4df412ca5c9d04a8b1c6df9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:57.060892 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1373/2726] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:57.063523 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:57.068329 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ddd98a21-d758-468a-b0ad-633a117b2755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5951d22be4df412ca5c9d04a8b1c6df9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:57.069628 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ddd98a21-d758-468a-b0ad-633a117b2755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5951d22be4df412ca5c9d04a8b1c6df9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:57.083685 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1354/2727] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:56 2022] DELETE /identity/v3/users/5951d22be4df412ca5c9d04a8b1c6df9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:57.490587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a931f0-ca37-4e48-b982-2ce9b186e87a service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:57.491997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-46a931f0-ca37-4e48-b982-2ce9b186e87a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:57.505794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a931f0-ca37-4e48-b982-2ce9b186e87a service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:57.525280 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd98a21-d758-468a-b0ad-633a117b2755 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:57.526897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ddd98a21-d758-468a-b0ad-633a117b2755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:57.589227 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:57.590056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:57.590338 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:57.590615 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2 admin admin] PATH_INFO: `/v3/projects/3b943474d46246eea1e484012a6a2cc9` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:57.591780 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b943474d46246eea1e484012a6a2cc9)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:57.593709 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:57.603783 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd98a21-d758-468a-b0ad-633a117b2755 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:57.607204 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:57.613860 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a57f38-742a-4e9a-a64c-2a0b97fcb320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:57.614827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a57f38-742a-4e9a-a64c-2a0b97fcb320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:57.615108 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a57f38-742a-4e9a-a64c-2a0b97fcb320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:57.615385 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a57f38-742a-4e9a-a64c-2a0b97fcb320 admin admin] PATH_INFO: `/v3/projects/cd97044760004696b181df7868f3cbed` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:57.616755 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a57f38-742a-4e9a-a64c-2a0b97fcb320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd97044760004696b181df7868f3cbed)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:57.619146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a57f38-742a-4e9a-a64c-2a0b97fcb320 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:57.692821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b943474d46246eea1e484012a6a2cc9', 'request_id': 'req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:57.738257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-49a57f38-742a-4e9a-a64c-2a0b97fcb320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd97044760004696b181df7868f3cbed', 'request_id': 'req-49a57f38-742a-4e9a-a64c-2a0b97fcb320'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:57.819538 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b943474d46246eea1e484012a6a2cc9', 'request_id': 'req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:57.825879 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b943474d46246eea1e484012a6a2cc9', 'request_id': 'req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:57.838515 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2 admin admin] The token cache is being invalidate because project 3b943474d46246eea1e484012a6a2cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:57.838873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:57.839626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:57.841255 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1374/2728] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:57 2022] DELETE /identity/v3/projects/3b943474d46246eea1e484012a6a2cc9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:57.846181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:57.847601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:57.876746 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-49a57f38-742a-4e9a-a64c-2a0b97fcb320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd97044760004696b181df7868f3cbed', 'request_id': 'req-49a57f38-742a-4e9a-a64c-2a0b97fcb320'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:57.884085 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-49a57f38-742a-4e9a-a64c-2a0b97fcb320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd97044760004696b181df7868f3cbed', 'request_id': 'req-49a57f38-742a-4e9a-a64c-2a0b97fcb320'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:57.896221 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-49a57f38-742a-4e9a-a64c-2a0b97fcb320 admin admin] The token cache is being invalidate because project cd97044760004696b181df7868f3cbed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:57.896521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-49a57f38-742a-4e9a-a64c-2a0b97fcb320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:57.897561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-49a57f38-742a-4e9a-a64c-2a0b97fcb320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:57.899353 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1355/2729] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:57 2022] DELETE /identity/v3/projects/cd97044760004696b181df7868f3cbed => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:57.904168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd02e6-0c57-42ce-b71c-0a246960a9be None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:57.904456 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd02e6-0c57-42ce-b71c-0a246960a9be None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:57.904731 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd02e6-0c57-42ce-b71c-0a246960a9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:57.916238 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1271ad-ea81-4b8c-be37-ab5a2e5cc0c2 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:57.925558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-03bd02e6-0c57-42ce-b71c-0a246960a9be None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:57.926801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-03bd02e6-0c57-42ce-b71c-0a246960a9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:57.977733 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797a906-f554-4c02-899c-49a7cf56c9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:57.978385 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797a906-f554-4c02-899c-49a7cf56c9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:57.978666 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797a906-f554-4c02-899c-49a7cf56c9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:57.979649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797a906-f554-4c02-899c-49a7cf56c9d0 admin admin] PATH_INFO: `/v3/users/533a0d95b668413ab2621ae0f5994e9f` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:57.981019 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797a906-f554-4c02-899c-49a7cf56c9d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=533a0d95b668413ab2621ae0f5994e9f)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:57.983396 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797a906-f554-4c02-899c-49a7cf56c9d0 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:57.997490 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1356/2730] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:58.005592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54561c3-941e-4268-aa2b-2f8ab62b67e4 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:58.005883 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54561c3-941e-4268-aa2b-2f8ab62b67e4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:58.006168 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54561c3-941e-4268-aa2b-2f8ab62b67e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:58.026104 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a54561c3-941e-4268-aa2b-2f8ab62b67e4 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:58.027371 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a54561c3-941e-4268-aa2b-2f8ab62b67e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:58.036271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1357/2731] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:58.040482 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54561c3-941e-4268-aa2b-2f8ab62b67e4 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:58.046081 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:58.050492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54561c3-941e-4268-aa2b-2f8ab62b67e4 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:58.055431 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f4e47-e9b5-4713-a02a-e155f62ae860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:58.056287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4e47-e9b5-4713-a02a-e155f62ae860 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:58.056626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4e47-e9b5-4713-a02a-e155f62ae860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:58.057015 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4e47-e9b5-4713-a02a-e155f62ae860 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:58.057772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f4e47-e9b5-4713-a02a-e155f62ae860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:58.058085 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f4e47-e9b5-4713-a02a-e155f62ae860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:58.059667 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f4e47-e9b5-4713-a02a-e155f62ae860 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:58.072644 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1358/2732] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:39:58.077944 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f4e47-e9b5-4713-a02a-e155f62ae860 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:58.088830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f4e47-e9b5-4713-a02a-e155f62ae860 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:58.094219 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add1ccf-0f06-41a2-a1bd-c238f09bd2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:58.095394 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add1ccf-0f06-41a2-a1bd-c238f09bd2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:58.095830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add1ccf-0f06-41a2-a1bd-c238f09bd2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:58.096112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add1ccf-0f06-41a2-a1bd-c238f09bd2c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:58.096778 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add1ccf-0f06-41a2-a1bd-c238f09bd2c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:58.098692 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add1ccf-0f06-41a2-a1bd-c238f09bd2c7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:58.174475 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f797a906-f554-4c02-899c-49a7cf56c9d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533a0d95b668413ab2621ae0f5994e9f'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:58.175154 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f797a906-f554-4c02-899c-49a7cf56c9d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533a0d95b668413ab2621ae0f5994e9f'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:58.177722 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:58.193572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1359/2733] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:58 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:58.194685 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add1ccf-0f06-41a2-a1bd-c238f09bd2c7 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:58.196402 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8add1ccf-0f06-41a2-a1bd-c238f09bd2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:58.250861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f797a906-f554-4c02-899c-49a7cf56c9d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533a0d95b668413ab2621ae0f5994e9f'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:58.259198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f797a906-f554-4c02-899c-49a7cf56c9d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533a0d95b668413ab2621ae0f5994e9f'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:58.276753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add1ccf-0f06-41a2-a1bd-c238f09bd2c7 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:58.278347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-f797a906-f554-4c02-899c-49a7cf56c9d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533a0d95b668413ab2621ae0f5994e9f'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:58.282093 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f806a8-7d78-4dd5-ac84-9310cf6fbb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:58.283882 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f806a8-7d78-4dd5-ac84-9310cf6fbb69 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:58.284157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f806a8-7d78-4dd5-ac84-9310cf6fbb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:58.284430 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f806a8-7d78-4dd5-ac84-9310cf6fbb69 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:58.285090 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f806a8-7d78-4dd5-ac84-9310cf6fbb69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:58.286060 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1375/2734] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:57 2022] DELETE /identity/v3/users/533a0d95b668413ab2621ae0f5994e9f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:58.287191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f806a8-7d78-4dd5-ac84-9310cf6fbb69 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:58.379874 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1360/2735] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:58 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:58.383823 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797a906-f554-4c02-899c-49a7cf56c9d0 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:58.451141 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797a906-f554-4c02-899c-49a7cf56c9d0 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:58.456892 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20dc2a-c7a7-43da-bc2d-04ec5a79b707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:58.457454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20dc2a-c7a7-43da-bc2d-04ec5a79b707 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:58.458079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20dc2a-c7a7-43da-bc2d-04ec5a79b707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:58.458363 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20dc2a-c7a7-43da-bc2d-04ec5a79b707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:58.459144 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20dc2a-c7a7-43da-bc2d-04ec5a79b707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:58.460793 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20dc2a-c7a7-43da-bc2d-04ec5a79b707 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:58.478442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1376/2736] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:58.479226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f806a8-7d78-4dd5-ac84-9310cf6fbb69 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:58.505921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f806a8-7d78-4dd5-ac84-9310cf6fbb69 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:58.507279 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c045321-9301-40c6-b19d-4285242222aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:58.507989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c045321-9301-40c6-b19d-4285242222aa admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:58.508270 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c045321-9301-40c6-b19d-4285242222aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:58.508593 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c045321-9301-40c6-b19d-4285242222aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:58.509341 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c045321-9301-40c6-b19d-4285242222aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:58.511096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c045321-9301-40c6-b19d-4285242222aa admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:58.523666 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1361/2737] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:58.527771 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20dc2a-c7a7-43da-bc2d-04ec5a79b707 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:58.538211 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20dc2a-c7a7-43da-bc2d-04ec5a79b707 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:58.543073 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8199338-4b75-423c-b3ea-a0d9f9d03917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:58.543792 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8199338-4b75-423c-b3ea-a0d9f9d03917 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:58.544079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8199338-4b75-423c-b3ea-a0d9f9d03917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:58.544371 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8199338-4b75-423c-b3ea-a0d9f9d03917 admin admin] PATH_INFO: `/v3/projects/2fbcd251cdeb434ab3d3587bfeb96e94/users/7a3d527f66444155926e92066d543d26/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:58.561716 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8199338-4b75-423c-b3ea-a0d9f9d03917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbcd251cdeb434ab3d3587bfeb96e94, user_id=7a3d527f66444155926e92066d543d26, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:58.565247 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8199338-4b75-423c-b3ea-a0d9f9d03917 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:58.657632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1377/2738] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:58 2022] PUT /identity/v3/projects/2fbcd251cdeb434ab3d3587bfeb96e94/users/7a3d527f66444155926e92066d543d26/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:58.668830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c44cc5-af67-4c3f-b8e0-a1206e1fd3a9 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:58.669124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c44cc5-af67-4c3f-b8e0-a1206e1fd3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:58.669412 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c44cc5-af67-4c3f-b8e0-a1206e1fd3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:58.699771 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b3c44cc5-af67-4c3f-b8e0-a1206e1fd3a9 None None] MFA Rules not processed for user `7a3d527f66444155926e92066d543d26`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:58.701004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b3c44cc5-af67-4c3f-b8e0-a1206e1fd3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:58.739373 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8199338-4b75-423c-b3ea-a0d9f9d03917 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:58.745647 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-b8199338-4b75-423c-b3ea-a0d9f9d03917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:58.779967 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1362/2739] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:58.784669 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c44cc5-af67-4c3f-b8e0-a1206e1fd3a9 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:58.820118 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8199338-4b75-423c-b3ea-a0d9f9d03917 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:58.825067 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcce2d3-cde3-4232-a11c-76110bb239a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:58.825746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcce2d3-cde3-4232-a11c-76110bb239a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:58.826831 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcce2d3-cde3-4232-a11c-76110bb239a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:58.826831 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcce2d3-cde3-4232-a11c-76110bb239a1 admin admin] PATH_INFO: `/v3/projects/b175cfb06836483195010c2f544e3e80` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:58.827504 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcce2d3-cde3-4232-a11c-76110bb239a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b175cfb06836483195010c2f544e3e80)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:58.830240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcce2d3-cde3-4232-a11c-76110bb239a1 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:58.835611 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:58.858123 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c44cc5-af67-4c3f-b8e0-a1206e1fd3a9 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:58.864523 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248aefa-2af1-445b-98f7-068c0a9a4e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:58.865154 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248aefa-2af1-445b-98f7-068c0a9a4e7f admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:58.865441 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248aefa-2af1-445b-98f7-068c0a9a4e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:58.865938 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248aefa-2af1-445b-98f7-068c0a9a4e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:58.866787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248aefa-2af1-445b-98f7-068c0a9a4e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:58.868710 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248aefa-2af1-445b-98f7-068c0a9a4e7f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:58.928986 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:58.934998 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-dbcce2d3-cde3-4232-a11c-76110bb239a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b175cfb06836483195010c2f544e3e80', 'request_id': 'req-dbcce2d3-cde3-4232-a11c-76110bb239a1'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:58.948359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1363/2740] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:58 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:58.952569 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248aefa-2af1-445b-98f7-068c0a9a4e7f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:59.016741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248aefa-2af1-445b-98f7-068c0a9a4e7f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:59.021870 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4803ae8-31ef-4639-bf3c-f71c63492958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:59.022625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4803ae8-31ef-4639-bf3c-f71c63492958 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:59.022910 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4803ae8-31ef-4639-bf3c-f71c63492958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:59.023212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4803ae8-31ef-4639-bf3c-f71c63492958 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:59.023880 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4803ae8-31ef-4639-bf3c-f71c63492958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:59.025830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4803ae8-31ef-4639-bf3c-f71c63492958 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:59.051221 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-dbcce2d3-cde3-4232-a11c-76110bb239a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b175cfb06836483195010c2f544e3e80', 'request_id': 'req-dbcce2d3-cde3-4232-a11c-76110bb239a1'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:59.057798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-dbcce2d3-cde3-4232-a11c-76110bb239a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b175cfb06836483195010c2f544e3e80', 'request_id': 'req-dbcce2d3-cde3-4232-a11c-76110bb239a1'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:59.070597 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-dbcce2d3-cde3-4232-a11c-76110bb239a1 admin admin] The token cache is being invalidate because project b175cfb06836483195010c2f544e3e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:59.070883 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-dbcce2d3-cde3-4232-a11c-76110bb239a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:59.071570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-dbcce2d3-cde3-4232-a11c-76110bb239a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:59.073072 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1378/2741] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:58 2022] DELETE /identity/v3/projects/b175cfb06836483195010c2f544e3e80 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:59.076797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcce2d3-cde3-4232-a11c-76110bb239a1 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:59.078087 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-dbcce2d3-cde3-4232-a11c-76110bb239a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:59.122765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1364/2742] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:58 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:59.123824 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4803ae8-31ef-4639-bf3c-f71c63492958 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:59.125667 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e4803ae8-31ef-4639-bf3c-f71c63492958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:59.138516 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4803ae8-31ef-4639-bf3c-f71c63492958 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:59.145765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffea0e-e324-4815-92eb-65fa6ef7a58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:59.146432 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffea0e-e324-4815-92eb-65fa6ef7a58b admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:59.152712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffea0e-e324-4815-92eb-65fa6ef7a58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:59.152712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffea0e-e324-4815-92eb-65fa6ef7a58b admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:59.152712 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffea0e-e324-4815-92eb-65fa6ef7a58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:59.153016 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcce2d3-cde3-4232-a11c-76110bb239a1 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:59.153105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffea0e-e324-4815-92eb-65fa6ef7a58b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:59.153712 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46140d41-91bc-49c0-9032-fc2bd69cc662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:59.154362 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46140d41-91bc-49c0-9032-fc2bd69cc662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:59.154644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46140d41-91bc-49c0-9032-fc2bd69cc662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:59.154927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46140d41-91bc-49c0-9032-fc2bd69cc662 admin admin] PATH_INFO: `/v3/users/92d1472ec8ba45559639b6df326449bb` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:59.156194 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46140d41-91bc-49c0-9032-fc2bd69cc662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d1472ec8ba45559639b6df326449bb)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:59.159001 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46140d41-91bc-49c0-9032-fc2bd69cc662 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:59.160959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1365/2743] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:59.165964 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffea0e-e324-4815-92eb-65fa6ef7a58b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:59.177272 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffea0e-e324-4815-92eb-65fa6ef7a58b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:59.186023 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bce58-64ef-46dd-a6dc-70cc4dd658a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:59.186023 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bce58-64ef-46dd-a6dc-70cc4dd658a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:59.186023 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bce58-64ef-46dd-a6dc-70cc4dd658a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:59.186023 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bce58-64ef-46dd-a6dc-70cc4dd658a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:59.186450 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bce58-64ef-46dd-a6dc-70cc4dd658a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:59.186450 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bce58-64ef-46dd-a6dc-70cc4dd658a4 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:59.198588 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1366/2744] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:59.202901 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bce58-64ef-46dd-a6dc-70cc4dd658a4 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:59.213855 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bce58-64ef-46dd-a6dc-70cc4dd658a4 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:59.219466 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29b7b3-8eed-4dc9-a6a4-c4e4a7b5af72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:59.221521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29b7b3-8eed-4dc9-a6a4-c4e4a7b5af72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:59.221521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29b7b3-8eed-4dc9-a6a4-c4e4a7b5af72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:59.221521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29b7b3-8eed-4dc9-a6a4-c4e4a7b5af72 admin admin] PATH_INFO: `/v3/projects/d7c70f304b1b46ce873a569a46d6ee24/users/e76a58d170a044ff81bf378860a29acc/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:59.237504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29b7b3-8eed-4dc9-a6a4-c4e4a7b5af72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c70f304b1b46ce873a569a46d6ee24, user_id=e76a58d170a044ff81bf378860a29acc, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:59.240794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29b7b3-8eed-4dc9-a6a4-c4e4a7b5af72 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:59.346296 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1367/2745] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:59 2022] PUT /identity/v3/projects/d7c70f304b1b46ce873a569a46d6ee24/users/e76a58d170a044ff81bf378860a29acc/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:59.356674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44a7df-5d67-4628-bc4b-7bbc4c1f5ad0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:59.357081 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44a7df-5d67-4628-bc4b-7bbc4c1f5ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:59.357406 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44a7df-5d67-4628-bc4b-7bbc4c1f5ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:59.384232 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-46140d41-91bc-49c0-9032-fc2bd69cc662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d1472ec8ba45559639b6df326449bb'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:59.384232 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-46140d41-91bc-49c0-9032-fc2bd69cc662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d1472ec8ba45559639b6df326449bb'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:59.389165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ca44a7df-5d67-4628-bc4b-7bbc4c1f5ad0 None None] MFA Rules not processed for user `e76a58d170a044ff81bf378860a29acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:59.390735 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ca44a7df-5d67-4628-bc4b-7bbc4c1f5ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:59.445200 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-46140d41-91bc-49c0-9032-fc2bd69cc662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d1472ec8ba45559639b6df326449bb'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:59.450129 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:59.452953 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-46140d41-91bc-49c0-9032-fc2bd69cc662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d1472ec8ba45559639b6df326449bb'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:59.460342 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1368/2746] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:39:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:59.464843 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44a7df-5d67-4628-bc4b-7bbc4c1f5ad0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:59.466174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ca44a7df-5d67-4628-bc4b-7bbc4c1f5ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:59.466386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-46140d41-91bc-49c0-9032-fc2bd69cc662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d1472ec8ba45559639b6df326449bb'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:59.475291 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1379/2747] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:59 2022] DELETE /identity/v3/users/92d1472ec8ba45559639b6df326449bb => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:59.542806 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44a7df-5d67-4628-bc4b-7bbc4c1f5ad0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:59.607468 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3015a-0997-4202-905f-c214e7fdd68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:59.608095 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3015a-0997-4202-905f-c214e7fdd68d admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:59.608374 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3015a-0997-4202-905f-c214e7fdd68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:59.608649 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3015a-0997-4202-905f-c214e7fdd68d admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:59.609316 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3015a-0997-4202-905f-c214e7fdd68d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:59.611970 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3015a-0997-4202-905f-c214e7fdd68d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:59.747433 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1369/2748] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:59 2022] POST /identity/v3/projects => generated 385 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:59.749052 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46140d41-91bc-49c0-9032-fc2bd69cc662 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:59.765800 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46140d41-91bc-49c0-9032-fc2bd69cc662 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:59.814821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:59.830054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22341ab7-3f6e-4872-b22a-cf69a5f3777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:59.830669 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341ab7-3f6e-4872-b22a-cf69a5f3777b admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:59.831153 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341ab7-3f6e-4872-b22a-cf69a5f3777b admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:59.831429 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341ab7-3f6e-4872-b22a-cf69a5f3777b admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:59.832114 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22341ab7-3f6e-4872-b22a-cf69a5f3777b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:59.834069 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22341ab7-3f6e-4872-b22a-cf69a5f3777b admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:59.912527 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3015a-0997-4202-905f-c214e7fdd68d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:59.914739 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-36a3015a-0997-4202-905f-c214e7fdd68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:59.940610 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1380/2749] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:59 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:59.943755 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22341ab7-3f6e-4872-b22a-cf69a5f3777b admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:59.944068 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3015a-0997-4202-905f-c214e7fdd68d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:59.948942 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5d9ec-3e34-47f7-aaec-6a0a35f6aa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:59.949631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5d9ec-3e34-47f7-aaec-6a0a35f6aa80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:59.949911 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5d9ec-3e34-47f7-aaec-6a0a35f6aa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:59.950186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5d9ec-3e34-47f7-aaec-6a0a35f6aa80 admin admin] PATH_INFO: `/v3/projects/bd67012207ce4137880f8b6bf65209b2` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:59.951378 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5d9ec-3e34-47f7-aaec-6a0a35f6aa80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd67012207ce4137880f8b6bf65209b2)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:59.953268 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5d9ec-3e34-47f7-aaec-6a0a35f6aa80 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:59.955056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22341ab7-3f6e-4872-b22a-cf69a5f3777b admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:59.962893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af915087-6c7e-476a-9a7e-6d85f21615c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:59.962893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af915087-6c7e-476a-9a7e-6d85f21615c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:59.962893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af915087-6c7e-476a-9a7e-6d85f21615c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:59.962893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af915087-6c7e-476a-9a7e-6d85f21615c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:59.963295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af915087-6c7e-476a-9a7e-6d85f21615c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:59.963643 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af915087-6c7e-476a-9a7e-6d85f21615c0 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:59.976695 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1381/2750] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:59.980335 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af915087-6c7e-476a-9a7e-6d85f21615c0 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:59.991787 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af915087-6c7e-476a-9a7e-6d85f21615c0 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:59.996548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eab4c-c796-4792-bf5f-bac4b1480333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:59.997283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eab4c-c796-4792-bf5f-bac4b1480333 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:59.997595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eab4c-c796-4792-bf5f-bac4b1480333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:59.997880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eab4c-c796-4792-bf5f-bac4b1480333 admin admin] PATH_INFO: `/v3/projects/18d4d543df7a41d8b03a9036836e6ea0/users/cec5c3f3c1554e78ac9e6e55a56c8902/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:00.012721 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414eab4c-c796-4792-bf5f-bac4b1480333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d4d543df7a41d8b03a9036836e6ea0, user_id=cec5c3f3c1554e78ac9e6e55a56c8902, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:00.015454 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414eab4c-c796-4792-bf5f-bac4b1480333 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:00.126952 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1382/2751] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:59 2022] PUT /identity/v3/projects/18d4d543df7a41d8b03a9036836e6ea0/users/cec5c3f3c1554e78ac9e6e55a56c8902/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:40:00.130807 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eab4c-c796-4792-bf5f-bac4b1480333 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:00.135191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-95e5d9ec-3e34-47f7-aaec-6a0a35f6aa80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd67012207ce4137880f8b6bf65209b2', 'request_id': 'req-95e5d9ec-3e34-47f7-aaec-6a0a35f6aa80'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:00.196015 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eab4c-c796-4792-bf5f-bac4b1480333 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:00.245507 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-95e5d9ec-3e34-47f7-aaec-6a0a35f6aa80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd67012207ce4137880f8b6bf65209b2', 'request_id': 'req-95e5d9ec-3e34-47f7-aaec-6a0a35f6aa80'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:00.253990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-95e5d9ec-3e34-47f7-aaec-6a0a35f6aa80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd67012207ce4137880f8b6bf65209b2', 'request_id': 'req-95e5d9ec-3e34-47f7-aaec-6a0a35f6aa80'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:00.254237 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a39de-d183-4d5a-bf8c-647443feeefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:00.254941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a39de-d183-4d5a-bf8c-647443feeefa admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:00.255304 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a39de-d183-4d5a-bf8c-647443feeefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:00.255577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a39de-d183-4d5a-bf8c-647443feeefa admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:00.256398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a39de-d183-4d5a-bf8c-647443feeefa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:00.258056 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a39de-d183-4d5a-bf8c-647443feeefa admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:00.273176 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1383/2752] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:00.275345 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a39de-d183-4d5a-bf8c-647443feeefa admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:00.278509 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-95e5d9ec-3e34-47f7-aaec-6a0a35f6aa80 admin admin] The token cache is being invalidate because project bd67012207ce4137880f8b6bf65209b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:00.278743 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-95e5d9ec-3e34-47f7-aaec-6a0a35f6aa80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:00.279424 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-95e5d9ec-3e34-47f7-aaec-6a0a35f6aa80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:00.280969 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1370/2753] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:59 2022] DELETE /identity/v3/projects/bd67012207ce4137880f8b6bf65209b2 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:40:00.285998 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a564301-d580-4879-8aa7-b28d95000247 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:00.286270 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a39de-d183-4d5a-bf8c-647443feeefa admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:00.286410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a564301-d580-4879-8aa7-b28d95000247 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:00.286584 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a564301-d580-4879-8aa7-b28d95000247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:00.290817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c401d-1df4-4af3-a15b-cba20fe51fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:00.291480 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c401d-1df4-4af3-a15b-cba20fe51fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:00.291760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c401d-1df4-4af3-a15b-cba20fe51fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:00.292034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c401d-1df4-4af3-a15b-cba20fe51fe2 admin admin] PATH_INFO: `/v3/projects/18d4d543df7a41d8b03a9036836e6ea0/users/cec5c3f3c1554e78ac9e6e55a56c8902/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:00.293976 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c401d-1df4-4af3-a15b-cba20fe51fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d4d543df7a41d8b03a9036836e6ea0, user_id=cec5c3f3c1554e78ac9e6e55a56c8902, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:00.296587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c401d-1df4-4af3-a15b-cba20fe51fe2 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:00.308212 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8a564301-d580-4879-8aa7-b28d95000247 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:00.309489 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8a564301-d580-4879-8aa7-b28d95000247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:00.309897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1384/2754] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:00 2022] PUT /identity/v3/projects/18d4d543df7a41d8b03a9036836e6ea0/users/cec5c3f3c1554e78ac9e6e55a56c8902/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:40:00.316262 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:00.382824 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d8fe0-0136-4127-81a2-17254650f243 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:00.383210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d8fe0-0136-4127-81a2-17254650f243 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:00.383567 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d8fe0-0136-4127-81a2-17254650f243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:00.390322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1371/2755] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:00.400963 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31355029-78b3-4e09-a0eb-527a9f8d2e0b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:00.401350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31355029-78b3-4e09-a0eb-527a9f8d2e0b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:00.401961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31355029-78b3-4e09-a0eb-527a9f8d2e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:00.416497 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-c09d8fe0-0136-4127-81a2-17254650f243 None None] MFA Rules not processed for user `cec5c3f3c1554e78ac9e6e55a56c8902`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:00.421043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c09d8fe0-0136-4127-81a2-17254650f243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:00.426578 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-31355029-78b3-4e09-a0eb-527a9f8d2e0b None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:00.427779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-31355029-78b3-4e09-a0eb-527a9f8d2e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:00.436116 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1372/2756] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:40:00.441309 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31355029-78b3-4e09-a0eb-527a9f8d2e0b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:00.441685 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:00.452002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31355029-78b3-4e09-a0eb-527a9f8d2e0b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:00.457461 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b93ea-ded9-4b97-bffc-b972d67a2379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:00.458170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b93ea-ded9-4b97-bffc-b972d67a2379 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:00.460919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b93ea-ded9-4b97-bffc-b972d67a2379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:00.460919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b93ea-ded9-4b97-bffc-b972d67a2379 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:00.460919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b93ea-ded9-4b97-bffc-b972d67a2379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:40:00.460919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b93ea-ded9-4b97-bffc-b972d67a2379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:00.461518 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b93ea-ded9-4b97-bffc-b972d67a2379 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:00.478008 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1373/2757] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:40:00.479328 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b93ea-ded9-4b97-bffc-b972d67a2379 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:00.491111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b93ea-ded9-4b97-bffc-b972d67a2379 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:00.493895 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1385/2758] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:00.497521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5de15e-025b-4445-9878-c224a11003bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:00.497521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5de15e-025b-4445-9878-c224a11003bf admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:00.497521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5de15e-025b-4445-9878-c224a11003bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:00.497521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5de15e-025b-4445-9878-c224a11003bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:00.498059 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5de15e-025b-4445-9878-c224a11003bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:00.499982 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5de15e-025b-4445-9878-c224a11003bf admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:00.509377 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d8fe0-0136-4127-81a2-17254650f243 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:00.510801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c09d8fe0-0136-4127-81a2-17254650f243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:00.572447 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d8fe0-0136-4127-81a2-17254650f243 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:00.573906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1374/2759] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:40:00 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:40:00.581504 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5de15e-025b-4445-9878-c224a11003bf admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:00.627595 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b88a0c-a9ea-421c-b6e8-ce868e998e94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:00.628229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b88a0c-a9ea-421c-b6e8-ce868e998e94 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:00.628510 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b88a0c-a9ea-421c-b6e8-ce868e998e94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:00.628785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b88a0c-a9ea-421c-b6e8-ce868e998e94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:00.665100 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5de15e-025b-4445-9878-c224a11003bf admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:00.669795 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb6c08-c186-4c06-99a7-f0e054d38bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:00.670415 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb6c08-c186-4c06-99a7-f0e054d38bfa admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:00.670711 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb6c08-c186-4c06-99a7-f0e054d38bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:00.671088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb6c08-c186-4c06-99a7-f0e054d38bfa admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:00.671801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb6c08-c186-4c06-99a7-f0e054d38bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:00.673977 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb6c08-c186-4c06-99a7-f0e054d38bfa admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:00.695211 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b88a0c-a9ea-421c-b6e8-ce868e998e94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:00.696803 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b88a0c-a9ea-421c-b6e8-ce868e998e94 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:00.707793 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1386/2760] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:00.749171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1375/2761] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:40:00 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:00.753544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b88a0c-a9ea-421c-b6e8-ce868e998e94 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:00.764088 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b88a0c-a9ea-421c-b6e8-ce868e998e94 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:00.771174 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918f4b7-41ff-4456-b875-fdfb182cbd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:00.772109 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918f4b7-41ff-4456-b875-fdfb182cbd71 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:00.772607 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918f4b7-41ff-4456-b875-fdfb182cbd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:00.773134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918f4b7-41ff-4456-b875-fdfb182cbd71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:00.773912 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918f4b7-41ff-4456-b875-fdfb182cbd71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:00.775674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918f4b7-41ff-4456-b875-fdfb182cbd71 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:00.789668 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1387/2762] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:40:00.794686 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb6c08-c186-4c06-99a7-f0e054d38bfa admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:00.805176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb6c08-c186-4c06-99a7-f0e054d38bfa admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:00.810290 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3f77e-3acb-42ff-8d23-37eb9a1da54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:00.810908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3f77e-3acb-42ff-8d23-37eb9a1da54c admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:00.811192 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3f77e-3acb-42ff-8d23-37eb9a1da54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:00.811550 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3f77e-3acb-42ff-8d23-37eb9a1da54c admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:00.812167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3f77e-3acb-42ff-8d23-37eb9a1da54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:00.814465 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3f77e-3acb-42ff-8d23-37eb9a1da54c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:00.825242 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1376/2763] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:00.830191 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918f4b7-41ff-4456-b875-fdfb182cbd71 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:00.840689 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918f4b7-41ff-4456-b875-fdfb182cbd71 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:00.845784 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e295af-056a-4733-a12c-50aab03ad3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:00.846483 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e295af-056a-4733-a12c-50aab03ad3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:00.846875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e295af-056a-4733-a12c-50aab03ad3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:00.849413 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e295af-056a-4733-a12c-50aab03ad3dd admin admin] PATH_INFO: `/v3/projects/38df4274ea31412e88459e12dfb1f56f/users/c2988e5d2f3b44a89f48a5c3a4aaf4d7/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:00.859327 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=100 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:00.863660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e295af-056a-4733-a12c-50aab03ad3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=38df4274ea31412e88459e12dfb1f56f, user_id=c2988e5d2f3b44a89f48a5c3a4aaf4d7, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:00.866359 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e295af-056a-4733-a12c-50aab03ad3dd admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:00.931560 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1388/2764] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:00 2022] PUT /identity/v3/projects/38df4274ea31412e88459e12dfb1f56f/users/c2988e5d2f3b44a89f48a5c3a4aaf4d7/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:40:00.947358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aa14a-9812-4101-89d8-214f4680ee07 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:00.947700 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aa14a-9812-4101-89d8-214f4680ee07 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:00.947983 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aa14a-9812-4101-89d8-214f4680ee07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:00.978979 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-0e3aa14a-9812-4101-89d8-214f4680ee07 None None] MFA Rules not processed for user `c2988e5d2f3b44a89f48a5c3a4aaf4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:00.980206 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0e3aa14a-9812-4101-89d8-214f4680ee07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:01.028640 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:01.055340 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1377/2765] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:01.819552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e295af-056a-4733-a12c-50aab03ad3dd admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:01.821244 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-84e295af-056a-4733-a12c-50aab03ad3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:01.880923 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e295af-056a-4733-a12c-50aab03ad3dd admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:01.884435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fb45c-de5d-4a67-a210-dd6d9470b70e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:01.885054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fb45c-de5d-4a67-a210-dd6d9470b70e service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:01.885331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fb45c-de5d-4a67-a210-dd6d9470b70e service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:01.885636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fb45c-de5d-4a67-a210-dd6d9470b70e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:01.887370 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-824fb45c-de5d-4a67-a210-dd6d9470b70e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:01.947602 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fb45c-de5d-4a67-a210-dd6d9470b70e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:01.949053 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fb45c-de5d-4a67-a210-dd6d9470b70e service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:01.959503 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1389/2766] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:02.397929 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3aa14a-9812-4101-89d8-214f4680ee07 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:02.399360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0e3aa14a-9812-4101-89d8-214f4680ee07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:02.457427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3aa14a-9812-4101-89d8-214f4680ee07 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:02.461053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e138e-6241-465a-a5d3-57b4d773d61f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628ef75fa7194253bcf6cd6c85211738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:02.461705 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e138e-6241-465a-a5d3-57b4d773d61f service glance] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:02.461986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e138e-6241-465a-a5d3-57b4d773d61f service glance] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:02.462257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e138e-6241-465a-a5d3-57b4d773d61f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:02.471601 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e138e-6241-465a-a5d3-57b4d773d61f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:02.473035 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e138e-6241-465a-a5d3-57b4d773d61f service glance] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:02.482891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1378/2767] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:06.982931 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fb45c-de5d-4a67-a210-dd6d9470b70e service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:06.991870 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fb45c-de5d-4a67-a210-dd6d9470b70e service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:06.995778 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c4879-c37c-4c95-a657-3e7e5bbc8381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:06.996501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c4879-c37c-4c95-a657-3e7e5bbc8381 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:06.996787 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c4879-c37c-4c95-a657-3e7e5bbc8381 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:06.997067 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c4879-c37c-4c95-a657-3e7e5bbc8381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:06.998855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-cf4c4879-c37c-4c95-a657-3e7e5bbc8381 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:07.060512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c4879-c37c-4c95-a657-3e7e5bbc8381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:07.062081 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c4879-c37c-4c95-a657-3e7e5bbc8381 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:07.071675 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1390/2768] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:11.138260 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e138e-6241-465a-a5d3-57b4d773d61f service glance] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:11.139664 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-dd6e138e-6241-465a-a5d3-57b4d773d61f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:11.208309 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e138e-6241-465a-a5d3-57b4d773d61f service glance] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:11.212812 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cedb57-6898-4146-b65b-be3eb01122eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:11.213494 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cedb57-6898-4146-b65b-be3eb01122eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:11.213779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cedb57-6898-4146-b65b-be3eb01122eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:11.214056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cedb57-6898-4146-b65b-be3eb01122eb admin admin] PATH_INFO: `/v3/users/7a3d527f66444155926e92066d543d26` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:11.215222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cedb57-6898-4146-b65b-be3eb01122eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a3d527f66444155926e92066d543d26)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:11.217126 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cedb57-6898-4146-b65b-be3eb01122eb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:11.424765 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-83cedb57-6898-4146-b65b-be3eb01122eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a3d527f66444155926e92066d543d26'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:11.425407 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-83cedb57-6898-4146-b65b-be3eb01122eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a3d527f66444155926e92066d543d26'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:11.485422 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-83cedb57-6898-4146-b65b-be3eb01122eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a3d527f66444155926e92066d543d26'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:11.499215 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-83cedb57-6898-4146-b65b-be3eb01122eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a3d527f66444155926e92066d543d26'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:11.502195 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-83cedb57-6898-4146-b65b-be3eb01122eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a3d527f66444155926e92066d543d26'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:11.513441 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:11.519092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1379/2769] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:11 2022] DELETE /identity/v3/users/7a3d527f66444155926e92066d543d26 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:11.523751 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04aaad-9a7e-4a44-a8dc-84e1a63100f9 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:11.524229 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04aaad-9a7e-4a44-a8dc-84e1a63100f9 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:11.524451 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04aaad-9a7e-4a44-a8dc-84e1a63100f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:11.544798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-fc04aaad-9a7e-4a44-a8dc-84e1a63100f9 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:11.546884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-fc04aaad-9a7e-4a44-a8dc-84e1a63100f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:11.591821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:11.613690 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1391/2770] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:11.623609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cedb57-6898-4146-b65b-be3eb01122eb admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:11.625058 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-83cedb57-6898-4146-b65b-be3eb01122eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:11.627008 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd9f9c-4c8a-48df-ae67-7fea9ed73d54 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:11.627295 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd9f9c-4c8a-48df-ae67-7fea9ed73d54 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:11.627647 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd9f9c-4c8a-48df-ae67-7fea9ed73d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:11.646434 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-71dd9f9c-4c8a-48df-ae67-7fea9ed73d54 None None] MFA Rules not processed for user `09217832f8e74db38d990d25faee4305`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:11.647635 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-71dd9f9c-4c8a-48df-ae67-7fea9ed73d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:11.697787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cedb57-6898-4146-b65b-be3eb01122eb admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:11.701377 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cada8-841a-4f63-a833-08b1ca313a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:11.702055 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cada8-841a-4f63-a833-08b1ca313a85 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:11.702338 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cada8-841a-4f63-a833-08b1ca313a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:11.702618 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cada8-841a-4f63-a833-08b1ca313a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:11.719742 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cada8-841a-4f63-a833-08b1ca313a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:11.719742 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cada8-841a-4f63-a833-08b1ca313a85 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:11.719956 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1392/2771] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:40:11.725558 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1380/2772] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:40:12.199156 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd9f9c-4c8a-48df-ae67-7fea9ed73d54 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:12.200720 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-71dd9f9c-4c8a-48df-ae67-7fea9ed73d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:12.218214 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd9f9c-4c8a-48df-ae67-7fea9ed73d54 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:12.223992 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692b552-d59f-4d7e-85b2-17e61e2c0270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:12.224772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692b552-d59f-4d7e-85b2-17e61e2c0270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:12.225128 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692b552-d59f-4d7e-85b2-17e61e2c0270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:12.225520 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692b552-d59f-4d7e-85b2-17e61e2c0270 admin admin] PATH_INFO: `/v3/projects/2fbcd251cdeb434ab3d3587bfeb96e94` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:12.226882 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692b552-d59f-4d7e-85b2-17e61e2c0270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fbcd251cdeb434ab3d3587bfeb96e94)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:12.229166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692b552-d59f-4d7e-85b2-17e61e2c0270 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:12.343779 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5692b552-d59f-4d7e-85b2-17e61e2c0270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fbcd251cdeb434ab3d3587bfeb96e94', 'request_id': 'req-5692b552-d59f-4d7e-85b2-17e61e2c0270'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:12.419252 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5692b552-d59f-4d7e-85b2-17e61e2c0270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fbcd251cdeb434ab3d3587bfeb96e94', 'request_id': 'req-5692b552-d59f-4d7e-85b2-17e61e2c0270'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:12.425834 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5692b552-d59f-4d7e-85b2-17e61e2c0270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fbcd251cdeb434ab3d3587bfeb96e94', 'request_id': 'req-5692b552-d59f-4d7e-85b2-17e61e2c0270'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:12.437241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5692b552-d59f-4d7e-85b2-17e61e2c0270 admin admin] The token cache is being invalidate because project 2fbcd251cdeb434ab3d3587bfeb96e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:12.437572 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5692b552-d59f-4d7e-85b2-17e61e2c0270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:12.438364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-5692b552-d59f-4d7e-85b2-17e61e2c0270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:12.439883 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1393/2773] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:12 2022] DELETE /identity/v3/projects/2fbcd251cdeb434ab3d3587bfeb96e94 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:40:12.443897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cada8-841a-4f63-a833-08b1ca313a85 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:12.453704 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cada8-841a-4f63-a833-08b1ca313a85 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:12.513952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773eada-6c17-4b91-ad4a-69c71687046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:12.514676 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773eada-6c17-4b91-ad4a-69c71687046a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:12.514961 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773eada-6c17-4b91-ad4a-69c71687046a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:12.515240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773eada-6c17-4b91-ad4a-69c71687046a admin admin] PATH_INFO: `/v3/users/e76a58d170a044ff81bf378860a29acc` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:12.517097 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773eada-6c17-4b91-ad4a-69c71687046a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e76a58d170a044ff81bf378860a29acc)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:12.519317 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773eada-6c17-4b91-ad4a-69c71687046a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:12.702036 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4773eada-6c17-4b91-ad4a-69c71687046a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e76a58d170a044ff81bf378860a29acc'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:12.702700 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4773eada-6c17-4b91-ad4a-69c71687046a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e76a58d170a044ff81bf378860a29acc'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:12.784772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4773eada-6c17-4b91-ad4a-69c71687046a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e76a58d170a044ff81bf378860a29acc'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:12.810326 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4773eada-6c17-4b91-ad4a-69c71687046a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e76a58d170a044ff81bf378860a29acc'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:12.811054 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4773eada-6c17-4b91-ad4a-69c71687046a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e76a58d170a044ff81bf378860a29acc'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:12.825061 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1381/2774] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:12 2022] DELETE /identity/v3/users/e76a58d170a044ff81bf378860a29acc => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:13.269649 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692b552-d59f-4d7e-85b2-17e61e2c0270 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:13.270634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5692b552-d59f-4d7e-85b2-17e61e2c0270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:13.284037 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692b552-d59f-4d7e-85b2-17e61e2c0270 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:13.347266 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f00f3-cad1-4ce2-939f-da63b24b5d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:13.348036 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f00f3-cad1-4ce2-939f-da63b24b5d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:13.348205 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f00f3-cad1-4ce2-939f-da63b24b5d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:13.348491 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f00f3-cad1-4ce2-939f-da63b24b5d2d admin admin] PATH_INFO: `/v3/projects/d7c70f304b1b46ce873a569a46d6ee24` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:13.349743 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f00f3-cad1-4ce2-939f-da63b24b5d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c70f304b1b46ce873a569a46d6ee24)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:13.351642 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f00f3-cad1-4ce2-939f-da63b24b5d2d admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:13.363309 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:13.502646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-165f00f3-cad1-4ce2-939f-da63b24b5d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c70f304b1b46ce873a569a46d6ee24', 'request_id': 'req-165f00f3-cad1-4ce2-939f-da63b24b5d2d'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:13.584631 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-165f00f3-cad1-4ce2-939f-da63b24b5d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c70f304b1b46ce873a569a46d6ee24', 'request_id': 'req-165f00f3-cad1-4ce2-939f-da63b24b5d2d'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:13.590785 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-165f00f3-cad1-4ce2-939f-da63b24b5d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c70f304b1b46ce873a569a46d6ee24', 'request_id': 'req-165f00f3-cad1-4ce2-939f-da63b24b5d2d'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:13.602731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-165f00f3-cad1-4ce2-939f-da63b24b5d2d admin admin] The token cache is being invalidate because project d7c70f304b1b46ce873a569a46d6ee24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:13.603021 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-165f00f3-cad1-4ce2-939f-da63b24b5d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:13.603765 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-165f00f3-cad1-4ce2-939f-da63b24b5d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:13.605273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1394/2775] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:13 2022] DELETE /identity/v3/projects/d7c70f304b1b46ce873a569a46d6ee24 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:13.609562 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773eada-6c17-4b91-ad4a-69c71687046a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:13.611658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4773eada-6c17-4b91-ad4a-69c71687046a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:13.628758 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773eada-6c17-4b91-ad4a-69c71687046a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:13.648908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:13.692524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eeb5b1-6aca-4e1d-b02b-cde7a1821eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:13.693245 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eeb5b1-6aca-4e1d-b02b-cde7a1821eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:13.693550 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eeb5b1-6aca-4e1d-b02b-cde7a1821eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:13.693830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eeb5b1-6aca-4e1d-b02b-cde7a1821eba admin admin] PATH_INFO: `/v3/users/cec5c3f3c1554e78ac9e6e55a56c8902` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:13.694986 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eeb5b1-6aca-4e1d-b02b-cde7a1821eba admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec5c3f3c1554e78ac9e6e55a56c8902)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:13.696935 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eeb5b1-6aca-4e1d-b02b-cde7a1821eba admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:13.886149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d3eeb5b1-6aca-4e1d-b02b-cde7a1821eba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec5c3f3c1554e78ac9e6e55a56c8902'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:13.886937 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d3eeb5b1-6aca-4e1d-b02b-cde7a1821eba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec5c3f3c1554e78ac9e6e55a56c8902'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:13.962799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d3eeb5b1-6aca-4e1d-b02b-cde7a1821eba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec5c3f3c1554e78ac9e6e55a56c8902'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:13.977805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d3eeb5b1-6aca-4e1d-b02b-cde7a1821eba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec5c3f3c1554e78ac9e6e55a56c8902'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:13.977805 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d3eeb5b1-6aca-4e1d-b02b-cde7a1821eba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec5c3f3c1554e78ac9e6e55a56c8902'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:13.989683 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1382/2776] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:13 2022] DELETE /identity/v3/users/cec5c3f3c1554e78ac9e6e55a56c8902 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:14.461900 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f00f3-cad1-4ce2-939f-da63b24b5d2d admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:14.463444 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-165f00f3-cad1-4ce2-939f-da63b24b5d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:14.466473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eeb5b1-6aca-4e1d-b02b-cde7a1821eba admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:14.468053 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d3eeb5b1-6aca-4e1d-b02b-cde7a1821eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:14.540799 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eeb5b1-6aca-4e1d-b02b-cde7a1821eba admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:14.546977 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87365939-766b-4080-a223-4f1adeb571f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:14.547638 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365939-766b-4080-a223-4f1adeb571f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:14.547921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365939-766b-4080-a223-4f1adeb571f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:14.548199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365939-766b-4080-a223-4f1adeb571f7 admin admin] PATH_INFO: `/v3/projects/18d4d543df7a41d8b03a9036836e6ea0` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:14.550357 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87365939-766b-4080-a223-4f1adeb571f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d4d543df7a41d8b03a9036836e6ea0)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:14.556129 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87365939-766b-4080-a223-4f1adeb571f7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:14.587536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f00f3-cad1-4ce2-939f-da63b24b5d2d admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:14.649656 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740e3b4-6814-42b0-9c1b-2feb849bdbe2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aae5b2e7bf74805b04d01df47693ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:14.650321 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740e3b4-6814-42b0-9c1b-2feb849bdbe2 service placement] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:14.650597 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740e3b4-6814-42b0-9c1b-2feb849bdbe2 service placement] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:14.650866 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740e3b4-6814-42b0-9c1b-2feb849bdbe2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:14.652915 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4740e3b4-6814-42b0-9c1b-2feb849bdbe2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:14.665681 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740e3b4-6814-42b0-9c1b-2feb849bdbe2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:14.667297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740e3b4-6814-42b0-9c1b-2feb849bdbe2 service placement] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:14.668568 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:14.672262 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-87365939-766b-4080-a223-4f1adeb571f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d4d543df7a41d8b03a9036836e6ea0', 'request_id': 'req-87365939-766b-4080-a223-4f1adeb571f7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:14.677802 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1395/2777] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:14.734274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-87365939-766b-4080-a223-4f1adeb571f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d4d543df7a41d8b03a9036836e6ea0', 'request_id': 'req-87365939-766b-4080-a223-4f1adeb571f7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:14.741870 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-87365939-766b-4080-a223-4f1adeb571f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d4d543df7a41d8b03a9036836e6ea0', 'request_id': 'req-87365939-766b-4080-a223-4f1adeb571f7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:14.752446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-87365939-766b-4080-a223-4f1adeb571f7 admin admin] The token cache is being invalidate because project 18d4d543df7a41d8b03a9036836e6ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:14.752738 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-87365939-766b-4080-a223-4f1adeb571f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:14.753390 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-87365939-766b-4080-a223-4f1adeb571f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:14.754950 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1383/2778] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:14 2022] DELETE /identity/v3/projects/18d4d543df7a41d8b03a9036836e6ea0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:40:14.762031 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae154a-a22f-4140-9f71-3d8d5dbb5db5 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:14.762315 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae154a-a22f-4140-9f71-3d8d5dbb5db5 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:14.762591 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae154a-a22f-4140-9f71-3d8d5dbb5db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:14.782518 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-40ae154a-a22f-4140-9f71-3d8d5dbb5db5 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:14.784336 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-40ae154a-a22f-4140-9f71-3d8d5dbb5db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:14.792975 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:14.847521 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1396/2779] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:14.855632 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb4a3a-895e-4919-a779-bc277daf0352 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:14.859497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb4a3a-895e-4919-a779-bc277daf0352 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:14.859497 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb4a3a-895e-4919-a779-bc277daf0352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:14.878598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-89cb4a3a-895e-4919-a779-bc277daf0352 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:14.879827 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-89cb4a3a-895e-4919-a779-bc277daf0352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:14.888729 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1384/2780] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:14.893819 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae154a-a22f-4140-9f71-3d8d5dbb5db5 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:14.907224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae154a-a22f-4140-9f71-3d8d5dbb5db5 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:14.914646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d7e6f-67de-47dc-a0fc-56ec711b8e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:14.915283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d7e6f-67de-47dc-a0fc-56ec711b8e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:14.915565 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d7e6f-67de-47dc-a0fc-56ec711b8e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:14.915840 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d7e6f-67de-47dc-a0fc-56ec711b8e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:14.916540 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d7e6f-67de-47dc-a0fc-56ec711b8e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:40:14.916880 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d7e6f-67de-47dc-a0fc-56ec711b8e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:14.919671 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d7e6f-67de-47dc-a0fc-56ec711b8e40 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:14.933260 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1397/2781] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:40:14.937694 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb4a3a-895e-4919-a779-bc277daf0352 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:14.947569 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb4a3a-895e-4919-a779-bc277daf0352 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:14.952279 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b00ce-9812-4675-a675-fa846dbc698e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:14.952891 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b00ce-9812-4675-a675-fa846dbc698e admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:14.953174 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b00ce-9812-4675-a675-fa846dbc698e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:14.953452 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b00ce-9812-4675-a675-fa846dbc698e admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:14.954156 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b00ce-9812-4675-a675-fa846dbc698e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:14.956700 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b00ce-9812-4675-a675-fa846dbc698e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:15.059303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1385/2782] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:40:14 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:15.063734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d7e6f-67de-47dc-a0fc-56ec711b8e40 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:15.074628 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d7e6f-67de-47dc-a0fc-56ec711b8e40 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:15.148626 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9643ef-ddea-42bc-9444-221fa2690b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:15.149245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9643ef-ddea-42bc-9444-221fa2690b6b admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:15.149557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9643ef-ddea-42bc-9444-221fa2690b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:15.149840 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9643ef-ddea-42bc-9444-221fa2690b6b admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:15.150492 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9643ef-ddea-42bc-9444-221fa2690b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:15.152516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9643ef-ddea-42bc-9444-221fa2690b6b admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:15.214337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1398/2783] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:40:15 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:15.218326 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b00ce-9812-4675-a675-fa846dbc698e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:15.229042 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b00ce-9812-4675-a675-fa846dbc698e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:15.233794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21a0cc-ee3e-458e-b57a-27e6dd955412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:15.234408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21a0cc-ee3e-458e-b57a-27e6dd955412 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:15.234691 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21a0cc-ee3e-458e-b57a-27e6dd955412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:15.235014 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21a0cc-ee3e-458e-b57a-27e6dd955412 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:15.235708 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21a0cc-ee3e-458e-b57a-27e6dd955412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:15.237287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21a0cc-ee3e-458e-b57a-27e6dd955412 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:15.247161 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1386/2784] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:15.251022 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9643ef-ddea-42bc-9444-221fa2690b6b admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:15.261507 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9643ef-ddea-42bc-9444-221fa2690b6b admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:15.266204 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0327b4b-2a2b-4bdd-a076-f6b1633883e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:15.266812 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0327b4b-2a2b-4bdd-a076-f6b1633883e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:15.267091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0327b4b-2a2b-4bdd-a076-f6b1633883e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:15.267364 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0327b4b-2a2b-4bdd-a076-f6b1633883e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:15.268971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0327b4b-2a2b-4bdd-a076-f6b1633883e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:15.270537 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0327b4b-2a2b-4bdd-a076-f6b1633883e9 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:15.281198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1399/2785] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:15.285523 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21a0cc-ee3e-458e-b57a-27e6dd955412 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:15.296349 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21a0cc-ee3e-458e-b57a-27e6dd955412 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:15.303681 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf48730-ddf0-47f9-8250-8444c75a4091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:15.304349 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf48730-ddf0-47f9-8250-8444c75a4091 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:15.304627 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf48730-ddf0-47f9-8250-8444c75a4091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:15.304901 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf48730-ddf0-47f9-8250-8444c75a4091 admin admin] PATH_INFO: `/v3/projects/2ef3310f657942d1b29187c231fe87fb/users/a6eff06a4b93461e9ac7799c0552d5f9/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:15.320045 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf48730-ddf0-47f9-8250-8444c75a4091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef3310f657942d1b29187c231fe87fb, user_id=a6eff06a4b93461e9ac7799c0552d5f9, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:15.322737 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf48730-ddf0-47f9-8250-8444c75a4091 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:15.387854 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1387/2786] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:15 2022] PUT /identity/v3/projects/2ef3310f657942d1b29187c231fe87fb/users/a6eff06a4b93461e9ac7799c0552d5f9/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:15.401944 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc763da9-1f30-4679-9ec6-b7f16ad3f72b None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:15.402232 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc763da9-1f30-4679-9ec6-b7f16ad3f72b None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:15.402513 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc763da9-1f30-4679-9ec6-b7f16ad3f72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:15.431052 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-bc763da9-1f30-4679-9ec6-b7f16ad3f72b None None] MFA Rules not processed for user `a6eff06a4b93461e9ac7799c0552d5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:15.432294 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-bc763da9-1f30-4679-9ec6-b7f16ad3f72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:15.498021 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1400/2787] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:15.502702 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf48730-ddf0-47f9-8250-8444c75a4091 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:15.572615 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf48730-ddf0-47f9-8250-8444c75a4091 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:15.578012 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9fbdd-d0a9-47d2-8c91-f7558b5d3917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:15.584181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9fbdd-d0a9-47d2-8c91-f7558b5d3917 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:15.584181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9fbdd-d0a9-47d2-8c91-f7558b5d3917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:15.584181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9fbdd-d0a9-47d2-8c91-f7558b5d3917 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:15.584181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9fbdd-d0a9-47d2-8c91-f7558b5d3917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:15.584181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9fbdd-d0a9-47d2-8c91-f7558b5d3917 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:15.706514 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1388/2788] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:40:15 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:15.710860 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc763da9-1f30-4679-9ec6-b7f16ad3f72b None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:15.721885 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc763da9-1f30-4679-9ec6-b7f16ad3f72b None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:15.730485 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:15.788803 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f4a5a-ffa0-4d4b-9ce3-7be184457be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:15.789493 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f4a5a-ffa0-4d4b-9ce3-7be184457be8 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:15.789792 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f4a5a-ffa0-4d4b-9ce3-7be184457be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:15.790222 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f4a5a-ffa0-4d4b-9ce3-7be184457be8 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:15.790925 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f4a5a-ffa0-4d4b-9ce3-7be184457be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:15.792861 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f4a5a-ffa0-4d4b-9ce3-7be184457be8 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:15.917664 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1401/2789] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:40:15 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:15.918924 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9fbdd-d0a9-47d2-8c91-f7558b5d3917 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:15.932445 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9fbdd-d0a9-47d2-8c91-f7558b5d3917 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:15.937476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89d499-8ab8-4e2f-96ff-76c16fe18680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:15.938539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89d499-8ab8-4e2f-96ff-76c16fe18680 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:15.938819 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89d499-8ab8-4e2f-96ff-76c16fe18680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:15.939609 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89d499-8ab8-4e2f-96ff-76c16fe18680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:15.940393 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89d499-8ab8-4e2f-96ff-76c16fe18680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:15.942294 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89d499-8ab8-4e2f-96ff-76c16fe18680 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:15.989247 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1389/2790] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:15.992496 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f4a5a-ffa0-4d4b-9ce3-7be184457be8 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:16.003032 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f4a5a-ffa0-4d4b-9ce3-7be184457be8 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:16.008115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077d6ce-41dc-4c1e-a265-a0f4f7aeda3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:16.008739 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077d6ce-41dc-4c1e-a265-a0f4f7aeda3b admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:16.009023 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077d6ce-41dc-4c1e-a265-a0f4f7aeda3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:16.009309 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077d6ce-41dc-4c1e-a265-a0f4f7aeda3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:16.010108 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077d6ce-41dc-4c1e-a265-a0f4f7aeda3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:16.011644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077d6ce-41dc-4c1e-a265-a0f4f7aeda3b admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:16.026045 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1402/2791] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:16.027216 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89d499-8ab8-4e2f-96ff-76c16fe18680 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:16.038462 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89d499-8ab8-4e2f-96ff-76c16fe18680 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:16.043043 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194378b-11c6-421a-abc8-2f579ebe68fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:16.048049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194378b-11c6-421a-abc8-2f579ebe68fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:16.048049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194378b-11c6-421a-abc8-2f579ebe68fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:16.048049 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194378b-11c6-421a-abc8-2f579ebe68fb admin admin] PATH_INFO: `/v3/projects/e58e6fc0215c472ebbcb4b0033098c5a/users/879568b307de4f36bed0f1e8ba0a5593/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:16.062410 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194378b-11c6-421a-abc8-2f579ebe68fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58e6fc0215c472ebbcb4b0033098c5a, user_id=879568b307de4f36bed0f1e8ba0a5593, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:16.064678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194378b-11c6-421a-abc8-2f579ebe68fb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:16.206020 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1390/2792] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:16 2022] PUT /identity/v3/projects/e58e6fc0215c472ebbcb4b0033098c5a/users/879568b307de4f36bed0f1e8ba0a5593/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:40:16.217873 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f919df6-7ebf-4a29-9d69-2bc63a7b1269 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:16.218358 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f919df6-7ebf-4a29-9d69-2bc63a7b1269 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:16.218704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f919df6-7ebf-4a29-9d69-2bc63a7b1269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:16.248486 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-7f919df6-7ebf-4a29-9d69-2bc63a7b1269 None None] MFA Rules not processed for user `879568b307de4f36bed0f1e8ba0a5593`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:16.249828 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-7f919df6-7ebf-4a29-9d69-2bc63a7b1269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:16.314173 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1403/2793] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:16.319272 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194378b-11c6-421a-abc8-2f579ebe68fb admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:16.338874 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:16.384040 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194378b-11c6-421a-abc8-2f579ebe68fb admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:16.389636 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79355707-d8c4-4078-9518-212079ad8991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:16.389760 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79355707-d8c4-4078-9518-212079ad8991 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:16.390037 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79355707-d8c4-4078-9518-212079ad8991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:16.390318 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79355707-d8c4-4078-9518-212079ad8991 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:16.391166 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79355707-d8c4-4078-9518-212079ad8991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:16.396469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79355707-d8c4-4078-9518-212079ad8991 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:16.519159 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1391/2794] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:40:16 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:16.523608 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f919df6-7ebf-4a29-9d69-2bc63a7b1269 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:16.535802 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f919df6-7ebf-4a29-9d69-2bc63a7b1269 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:16.604436 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61ec6e-1abb-4e2e-bc68-b567a4e7a96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:16.605321 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61ec6e-1abb-4e2e-bc68-b567a4e7a96a admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:16.605804 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61ec6e-1abb-4e2e-bc68-b567a4e7a96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:16.606179 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61ec6e-1abb-4e2e-bc68-b567a4e7a96a admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:16.606947 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61ec6e-1abb-4e2e-bc68-b567a4e7a96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:16.609287 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61ec6e-1abb-4e2e-bc68-b567a4e7a96a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:16.705938 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1404/2795] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:40:16 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:40:16.710284 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79355707-d8c4-4078-9518-212079ad8991 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:16.722229 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79355707-d8c4-4078-9518-212079ad8991 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:16.728721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55d2ed-9e87-4c95-8e3f-90ad78c2ade6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:16.732242 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55d2ed-9e87-4c95-8e3f-90ad78c2ade6 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:16.732242 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55d2ed-9e87-4c95-8e3f-90ad78c2ade6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:16.732242 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55d2ed-9e87-4c95-8e3f-90ad78c2ade6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:16.732242 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55d2ed-9e87-4c95-8e3f-90ad78c2ade6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:16.732963 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55d2ed-9e87-4c95-8e3f-90ad78c2ade6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:16.749633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1392/2796] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:16.750828 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61ec6e-1abb-4e2e-bc68-b567a4e7a96a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:16.761516 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61ec6e-1abb-4e2e-bc68-b567a4e7a96a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:16.766207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ff4a1-ddc7-4172-b518-e7330ecf9066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:16.766961 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff4a1-ddc7-4172-b518-e7330ecf9066 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:16.767305 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff4a1-ddc7-4172-b518-e7330ecf9066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:16.767646 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff4a1-ddc7-4172-b518-e7330ecf9066 admin admin] PATH_INFO: `/v3/projects/4127807d16df46dfa96e167a60a5c25e/users/9a083f35b5d149678f3e326cfd7f5828/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:16.770865 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:16.783955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ff4a1-ddc7-4172-b518-e7330ecf9066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4127807d16df46dfa96e167a60a5c25e, user_id=9a083f35b5d149678f3e326cfd7f5828, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:16.787323 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ff4a1-ddc7-4172-b518-e7330ecf9066 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:16.896490 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1405/2797] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:16 2022] PUT /identity/v3/projects/4127807d16df46dfa96e167a60a5c25e/users/9a083f35b5d149678f3e326cfd7f5828/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:16.901573 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55d2ed-9e87-4c95-8e3f-90ad78c2ade6 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:16.915269 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55d2ed-9e87-4c95-8e3f-90ad78c2ade6 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:16.983062 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364066af-5375-4142-b292-e4e36e1a0c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:16.987906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364066af-5375-4142-b292-e4e36e1a0c79 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:16.987906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364066af-5375-4142-b292-e4e36e1a0c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:16.987906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364066af-5375-4142-b292-e4e36e1a0c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:16.987906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364066af-5375-4142-b292-e4e36e1a0c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:16.987906 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364066af-5375-4142-b292-e4e36e1a0c79 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:16.997775 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1393/2798] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:17.001855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ff4a1-ddc7-4172-b518-e7330ecf9066 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:17.013083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ff4a1-ddc7-4172-b518-e7330ecf9066 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:17.019278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33767c55-5ef5-4589-94e8-f4796a4c1148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:17.020523 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33767c55-5ef5-4589-94e8-f4796a4c1148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:17.021014 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33767c55-5ef5-4589-94e8-f4796a4c1148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:17.021126 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33767c55-5ef5-4589-94e8-f4796a4c1148 admin admin] PATH_INFO: `/v3/projects/4127807d16df46dfa96e167a60a5c25e/users/9a083f35b5d149678f3e326cfd7f5828/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:17.023228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33767c55-5ef5-4589-94e8-f4796a4c1148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4127807d16df46dfa96e167a60a5c25e, user_id=9a083f35b5d149678f3e326cfd7f5828, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:17.025914 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33767c55-5ef5-4589-94e8-f4796a4c1148 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:17.039878 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1406/2799] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:17 2022] PUT /identity/v3/projects/4127807d16df46dfa96e167a60a5c25e/users/9a083f35b5d149678f3e326cfd7f5828/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:17.050926 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb020-c85a-45fa-8618-1256836c5a6e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:17.051420 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb020-c85a-45fa-8618-1256836c5a6e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:17.051919 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb020-c85a-45fa-8618-1256836c5a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:17.100303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1dafb020-c85a-45fa-8618-1256836c5a6e None None] MFA Rules not processed for user `9a083f35b5d149678f3e326cfd7f5828`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:17.102916 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1dafb020-c85a-45fa-8618-1256836c5a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:17.188222 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1394/2800] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:17.483095 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33767c55-5ef5-4589-94e8-f4796a4c1148 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:17.485106 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-33767c55-5ef5-4589-94e8-f4796a4c1148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:17.589636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33767c55-5ef5-4589-94e8-f4796a4c1148 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:17.594510 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb3258-ac35-4842-88b8-4d9db3746450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:17.595246 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb3258-ac35-4842-88b8-4d9db3746450 service cinder] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:17.595604 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb3258-ac35-4842-88b8-4d9db3746450 service cinder] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:17.595949 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb3258-ac35-4842-88b8-4d9db3746450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:17.607019 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb3258-ac35-4842-88b8-4d9db3746450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:17.608792 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb3258-ac35-4842-88b8-4d9db3746450 service cinder] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:17.621461 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1407/2801] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:17.741252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafb020-c85a-45fa-8618-1256836c5a6e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:17.742770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1dafb020-c85a-45fa-8618-1256836c5a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:17.755753 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafb020-c85a-45fa-8618-1256836c5a6e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:17.759915 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3541f7d-bb2a-4bdf-8fe3-f79f9be46165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:17.760605 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3541f7d-bb2a-4bdf-8fe3-f79f9be46165 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:17.762469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3541f7d-bb2a-4bdf-8fe3-f79f9be46165 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:17.762469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3541f7d-bb2a-4bdf-8fe3-f79f9be46165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:17.771437 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:17.821904 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3541f7d-bb2a-4bdf-8fe3-f79f9be46165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:17.823592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3541f7d-bb2a-4bdf-8fe3-f79f9be46165 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:17.833714 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1395/2802] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:24.079941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb3258-ac35-4842-88b8-4d9db3746450 service cinder] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:24.142347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb3258-ac35-4842-88b8-4d9db3746450 service cinder] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:24.147856 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be412507-bb9a-41ed-ab17-49334a0aac7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:24.148489 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be412507-bb9a-41ed-ab17-49334a0aac7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:24.148772 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be412507-bb9a-41ed-ab17-49334a0aac7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:24.149090 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be412507-bb9a-41ed-ab17-49334a0aac7a admin admin] PATH_INFO: `/v3/users/a6eff06a4b93461e9ac7799c0552d5f9` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:24.150277 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be412507-bb9a-41ed-ab17-49334a0aac7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6eff06a4b93461e9ac7799c0552d5f9)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:24.152181 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be412507-bb9a-41ed-ab17-49334a0aac7a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:24.330604 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-be412507-bb9a-41ed-ab17-49334a0aac7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6eff06a4b93461e9ac7799c0552d5f9'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:24.331299 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-be412507-bb9a-41ed-ab17-49334a0aac7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6eff06a4b93461e9ac7799c0552d5f9'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:24.393715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-be412507-bb9a-41ed-ab17-49334a0aac7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6eff06a4b93461e9ac7799c0552d5f9'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:24.401583 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-be412507-bb9a-41ed-ab17-49334a0aac7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6eff06a4b93461e9ac7799c0552d5f9'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:24.409818 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:24.414250 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-be412507-bb9a-41ed-ab17-49334a0aac7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6eff06a4b93461e9ac7799c0552d5f9'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:24.420301 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1408/2803] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:24 2022] DELETE /identity/v3/users/a6eff06a4b93461e9ac7799c0552d5f9 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:24.424973 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859e8db-d474-4f56-8040-c0f2bbf7966e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:24.425945 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859e8db-d474-4f56-8040-c0f2bbf7966e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:24.426166 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859e8db-d474-4f56-8040-c0f2bbf7966e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:24.450608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a859e8db-d474-4f56-8040-c0f2bbf7966e None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:24.451830 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a859e8db-d474-4f56-8040-c0f2bbf7966e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:24.518028 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1396/2804] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:24.527794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be412507-bb9a-41ed-ab17-49334a0aac7a admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:24.529213 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-be412507-bb9a-41ed-ab17-49334a0aac7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:24.592462 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be412507-bb9a-41ed-ab17-49334a0aac7a admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:24.596124 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8af3d-3000-4f5a-a98d-f22b3627a393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:24.596743 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8af3d-3000-4f5a-a98d-f22b3627a393 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:24.597022 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8af3d-3000-4f5a-a98d-f22b3627a393 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:24.597332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8af3d-3000-4f5a-a98d-f22b3627a393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:24.606529 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8af3d-3000-4f5a-a98d-f22b3627a393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:24.607934 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8af3d-3000-4f5a-a98d-f22b3627a393 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:24.617884 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1409/2805] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:25.068036 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859e8db-d474-4f56-8040-c0f2bbf7966e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:25.069613 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a859e8db-d474-4f56-8040-c0f2bbf7966e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:25.088046 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859e8db-d474-4f56-8040-c0f2bbf7966e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:25.093976 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb939e-6f51-46cf-bffc-a3a656495fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:25.094633 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb939e-6f51-46cf-bffc-a3a656495fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:25.094917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb939e-6f51-46cf-bffc-a3a656495fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:25.095287 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb939e-6f51-46cf-bffc-a3a656495fc0 admin admin] PATH_INFO: `/v3/projects/2ef3310f657942d1b29187c231fe87fb` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:25.096343 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb939e-6f51-46cf-bffc-a3a656495fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef3310f657942d1b29187c231fe87fb)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:25.099141 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb939e-6f51-46cf-bffc-a3a656495fc0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:25.201849 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f2fb939e-6f51-46cf-bffc-a3a656495fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef3310f657942d1b29187c231fe87fb', 'request_id': 'req-f2fb939e-6f51-46cf-bffc-a3a656495fc0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:25.282002 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f2fb939e-6f51-46cf-bffc-a3a656495fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef3310f657942d1b29187c231fe87fb', 'request_id': 'req-f2fb939e-6f51-46cf-bffc-a3a656495fc0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:25.289459 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f2fb939e-6f51-46cf-bffc-a3a656495fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef3310f657942d1b29187c231fe87fb', 'request_id': 'req-f2fb939e-6f51-46cf-bffc-a3a656495fc0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:25.299713 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f2fb939e-6f51-46cf-bffc-a3a656495fc0 admin admin] The token cache is being invalidate because project 2ef3310f657942d1b29187c231fe87fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:25.299996 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f2fb939e-6f51-46cf-bffc-a3a656495fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:25.300804 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f2fb939e-6f51-46cf-bffc-a3a656495fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:25.302772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1397/2806] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:25 2022] DELETE /identity/v3/projects/2ef3310f657942d1b29187c231fe87fb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:25.306753 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8af3d-3000-4f5a-a98d-f22b3627a393 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:25.316676 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8af3d-3000-4f5a-a98d-f22b3627a393 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:25.372920 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb60ab-fc64-4200-8e99-d409219a72a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:25.373519 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb60ab-fc64-4200-8e99-d409219a72a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:25.373809 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb60ab-fc64-4200-8e99-d409219a72a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:25.374091 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb60ab-fc64-4200-8e99-d409219a72a3 admin admin] PATH_INFO: `/v3/users/879568b307de4f36bed0f1e8ba0a5593` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:25.375257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb60ab-fc64-4200-8e99-d409219a72a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=879568b307de4f36bed0f1e8ba0a5593)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:25.377204 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb60ab-fc64-4200-8e99-d409219a72a3 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:25.579418 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4cfb60ab-fc64-4200-8e99-d409219a72a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879568b307de4f36bed0f1e8ba0a5593'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:25.580061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4cfb60ab-fc64-4200-8e99-d409219a72a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879568b307de4f36bed0f1e8ba0a5593'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:25.668185 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4cfb60ab-fc64-4200-8e99-d409219a72a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879568b307de4f36bed0f1e8ba0a5593'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:25.675598 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4cfb60ab-fc64-4200-8e99-d409219a72a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879568b307de4f36bed0f1e8ba0a5593'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:25.688351 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-4cfb60ab-fc64-4200-8e99-d409219a72a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879568b307de4f36bed0f1e8ba0a5593'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:25.695836 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1410/2807] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:25 2022] DELETE /identity/v3/users/879568b307de4f36bed0f1e8ba0a5593 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:26.175183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb939e-6f51-46cf-bffc-a3a656495fc0 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:26.178807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f2fb939e-6f51-46cf-bffc-a3a656495fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:26.200727 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb939e-6f51-46cf-bffc-a3a656495fc0 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:26.240784 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:26.267036 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:26.268113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:26.268403 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:26.268684 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea admin admin] PATH_INFO: `/v3/projects/e58e6fc0215c472ebbcb4b0033098c5a` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:26.270058 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e58e6fc0215c472ebbcb4b0033098c5a)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:26.272303 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:26.393142 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e58e6fc0215c472ebbcb4b0033098c5a', 'request_id': 'req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:26.450693 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e58e6fc0215c472ebbcb4b0033098c5a', 'request_id': 'req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:26.457678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e58e6fc0215c472ebbcb4b0033098c5a', 'request_id': 'req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:26.468473 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea admin admin] The token cache is being invalidate because project e58e6fc0215c472ebbcb4b0033098c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:26.468760 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:26.469403 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:26.471029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1398/2808] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:26 2022] DELETE /identity/v3/projects/e58e6fc0215c472ebbcb4b0033098c5a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:26.475819 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb60ab-fc64-4200-8e99-d409219a72a3 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:26.477293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-4cfb60ab-fc64-4200-8e99-d409219a72a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:26.490822 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb60ab-fc64-4200-8e99-d409219a72a3 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:26.499552 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:26.558134 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433854a3-3010-41a4-9445-4318114241ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:26.558788 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433854a3-3010-41a4-9445-4318114241ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:26.559071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433854a3-3010-41a4-9445-4318114241ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:26.559347 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433854a3-3010-41a4-9445-4318114241ce admin admin] PATH_INFO: `/v3/users/9a083f35b5d149678f3e326cfd7f5828` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:26.560568 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433854a3-3010-41a4-9445-4318114241ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a083f35b5d149678f3e326cfd7f5828)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:26.562512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433854a3-3010-41a4-9445-4318114241ce admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:26.744228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-433854a3-3010-41a4-9445-4318114241ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a083f35b5d149678f3e326cfd7f5828'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:26.744609 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-433854a3-3010-41a4-9445-4318114241ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a083f35b5d149678f3e326cfd7f5828'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:26.814903 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-433854a3-3010-41a4-9445-4318114241ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a083f35b5d149678f3e326cfd7f5828'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:26.827132 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-433854a3-3010-41a4-9445-4318114241ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a083f35b5d149678f3e326cfd7f5828'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:26.842620 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-433854a3-3010-41a4-9445-4318114241ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a083f35b5d149678f3e326cfd7f5828'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:26.850243 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1411/2809] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:26 2022] DELETE /identity/v3/users/9a083f35b5d149678f3e326cfd7f5828 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:27.317959 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:27.319511 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:27.341650 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ce384-4c64-4a4d-a686-d4fc8ff6b0ea admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:27.402779 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9c497-198e-43d6-88c0-51b53330e8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:27.403438 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9c497-198e-43d6-88c0-51b53330e8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:27.403717 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9c497-198e-43d6-88c0-51b53330e8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:27.403989 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9c497-198e-43d6-88c0-51b53330e8ec admin admin] PATH_INFO: `/v3/projects/4127807d16df46dfa96e167a60a5c25e` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:27.405149 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9c497-198e-43d6-88c0-51b53330e8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=4127807d16df46dfa96e167a60a5c25e)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:27.407096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9c497-198e-43d6-88c0-51b53330e8ec admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:27.520451 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c1d9c497-198e-43d6-88c0-51b53330e8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4127807d16df46dfa96e167a60a5c25e', 'request_id': 'req-c1d9c497-198e-43d6-88c0-51b53330e8ec'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:27.587294 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c1d9c497-198e-43d6-88c0-51b53330e8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4127807d16df46dfa96e167a60a5c25e', 'request_id': 'req-c1d9c497-198e-43d6-88c0-51b53330e8ec'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:27.593990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c1d9c497-198e-43d6-88c0-51b53330e8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4127807d16df46dfa96e167a60a5c25e', 'request_id': 'req-c1d9c497-198e-43d6-88c0-51b53330e8ec'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:27.599935 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:27.608191 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c1d9c497-198e-43d6-88c0-51b53330e8ec admin admin] The token cache is being invalidate because project 4127807d16df46dfa96e167a60a5c25e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:27.608491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c1d9c497-198e-43d6-88c0-51b53330e8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:27.609169 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c1d9c497-198e-43d6-88c0-51b53330e8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:27.610881 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1399/2810] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:27 2022] DELETE /identity/v3/projects/4127807d16df46dfa96e167a60a5c25e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:27.616997 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c900759-39cd-47d1-82a1-c122d82e0e3f None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:27.617506 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c900759-39cd-47d1-82a1-c122d82e0e3f None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:27.617642 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c900759-39cd-47d1-82a1-c122d82e0e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:27.641498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-5c900759-39cd-47d1-82a1-c122d82e0e3f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:27.641498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5c900759-39cd-47d1-82a1-c122d82e0e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:27.707660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1412/2811] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:27.717539 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd79679-ba98-4b0d-aad9-2074b891df4f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:27.717833 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd79679-ba98-4b0d-aad9-2074b891df4f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:27.718115 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd79679-ba98-4b0d-aad9-2074b891df4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:27.738007 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3dd79679-ba98-4b0d-aad9-2074b891df4f None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:27.739250 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3dd79679-ba98-4b0d-aad9-2074b891df4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:27.747552 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1400/2812] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:27.751858 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c900759-39cd-47d1-82a1-c122d82e0e3f None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:27.762019 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c900759-39cd-47d1-82a1-c122d82e0e3f None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:27.766665 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbb6a2-aa69-48bc-976f-86cd36572c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:27.767272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbb6a2-aa69-48bc-976f-86cd36572c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:27.767805 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbb6a2-aa69-48bc-976f-86cd36572c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:27.768082 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbb6a2-aa69-48bc-976f-86cd36572c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:27.768798 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbb6a2-aa69-48bc-976f-86cd36572c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:40:27.769210 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbb6a2-aa69-48bc-976f-86cd36572c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:27.771388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbb6a2-aa69-48bc-976f-86cd36572c32 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:27.782640 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1413/2813] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:40:27.787364 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd79679-ba98-4b0d-aad9-2074b891df4f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:27.796637 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd79679-ba98-4b0d-aad9-2074b891df4f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:27.801398 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91000f73-eb18-4d18-9241-be3ec6e9f450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:27.802030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91000f73-eb18-4d18-9241-be3ec6e9f450 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:27.802309 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91000f73-eb18-4d18-9241-be3ec6e9f450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:27.802582 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91000f73-eb18-4d18-9241-be3ec6e9f450 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:27.803235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91000f73-eb18-4d18-9241-be3ec6e9f450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:27.805128 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91000f73-eb18-4d18-9241-be3ec6e9f450 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:27.903875 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1401/2814] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:40:27 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:27.908063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbb6a2-aa69-48bc-976f-86cd36572c32 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:27.918555 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbb6a2-aa69-48bc-976f-86cd36572c32 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:27.936061 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:27.976699 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0703f-5937-46bb-9cab-2a8759c5043c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:27.977328 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0703f-5937-46bb-9cab-2a8759c5043c admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:27.977644 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0703f-5937-46bb-9cab-2a8759c5043c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:27.977919 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0703f-5937-46bb-9cab-2a8759c5043c admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:27.978593 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0703f-5937-46bb-9cab-2a8759c5043c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:27.980492 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0703f-5937-46bb-9cab-2a8759c5043c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:28.079471 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1414/2815] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:40:27 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:28.089108 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91000f73-eb18-4d18-9241-be3ec6e9f450 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:28.095247 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91000f73-eb18-4d18-9241-be3ec6e9f450 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:28.100098 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ab404-b98a-4e33-86fb-d936b67b3be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:28.100770 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ab404-b98a-4e33-86fb-d936b67b3be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:28.101164 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ab404-b98a-4e33-86fb-d936b67b3be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:28.101489 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ab404-b98a-4e33-86fb-d936b67b3be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:28.102328 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ab404-b98a-4e33-86fb-d936b67b3be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:28.103952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ab404-b98a-4e33-86fb-d936b67b3be0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:28.120261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1402/2816] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:28.122875 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0703f-5937-46bb-9cab-2a8759c5043c admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:28.135941 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0703f-5937-46bb-9cab-2a8759c5043c admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:28.141291 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bddaa-f6ea-47d1-8831-cc95dca40305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:28.141954 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bddaa-f6ea-47d1-8831-cc95dca40305 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:28.142240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bddaa-f6ea-47d1-8831-cc95dca40305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:28.142764 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bddaa-f6ea-47d1-8831-cc95dca40305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:28.144059 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bddaa-f6ea-47d1-8831-cc95dca40305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:28.145748 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bddaa-f6ea-47d1-8831-cc95dca40305 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:28.157964 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1415/2817] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:28.162327 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ab404-b98a-4e33-86fb-d936b67b3be0 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:28.172608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ab404-b98a-4e33-86fb-d936b67b3be0 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:28.178166 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15afb8-f3a3-41e0-8446-47ccc49550a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:28.179009 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15afb8-f3a3-41e0-8446-47ccc49550a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:28.179111 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15afb8-f3a3-41e0-8446-47ccc49550a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:28.179381 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15afb8-f3a3-41e0-8446-47ccc49550a3 admin admin] PATH_INFO: `/v3/projects/ff16073ab1d44fb39da960e2e077219e/users/6d7c75c6de464c33929aae35e56a87e0/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:28.196246 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15afb8-f3a3-41e0-8446-47ccc49550a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff16073ab1d44fb39da960e2e077219e, user_id=6d7c75c6de464c33929aae35e56a87e0, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:28.199125 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15afb8-f3a3-41e0-8446-47ccc49550a3 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:28.338271 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1403/2818] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:28 2022] PUT /identity/v3/projects/ff16073ab1d44fb39da960e2e077219e/users/6d7c75c6de464c33929aae35e56a87e0/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:28.350278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c181080-bf5e-4e58-9e74-f42f2646f119 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:28.350593 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c181080-bf5e-4e58-9e74-f42f2646f119 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:28.350869 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c181080-bf5e-4e58-9e74-f42f2646f119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:28.384847 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-0c181080-bf5e-4e58-9e74-f42f2646f119 None None] MFA Rules not processed for user `6d7c75c6de464c33929aae35e56a87e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:28.386197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-0c181080-bf5e-4e58-9e74-f42f2646f119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:28.472063 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1416/2819] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:28.483967 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15afb8-f3a3-41e0-8446-47ccc49550a3 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:28.486368 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2d15afb8-f3a3-41e0-8446-47ccc49550a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:28.554233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15afb8-f3a3-41e0-8446-47ccc49550a3 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:28.557968 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994729b-c4fe-4bf2-b664-78674333ed16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:28.558608 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994729b-c4fe-4bf2-b664-78674333ed16 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:28.558899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994729b-c4fe-4bf2-b664-78674333ed16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:28.559176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994729b-c4fe-4bf2-b664-78674333ed16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:28.568030 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994729b-c4fe-4bf2-b664-78674333ed16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:28.569449 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994729b-c4fe-4bf2-b664-78674333ed16 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:28.578594 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1404/2820] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:28.604275 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c181080-bf5e-4e58-9e74-f42f2646f119 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:28.672419 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c181080-bf5e-4e58-9e74-f42f2646f119 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:28.677948 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fa2c9-20c0-4fce-a21d-e66435942b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:28.678601 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa2c9-20c0-4fce-a21d-e66435942b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:28.679003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa2c9-20c0-4fce-a21d-e66435942b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:28.679293 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa2c9-20c0-4fce-a21d-e66435942b25 admin admin] PATH_INFO: `/v3/users/6d7c75c6de464c33929aae35e56a87e0` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:28.680575 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fa2c9-20c0-4fce-a21d-e66435942b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7c75c6de464c33929aae35e56a87e0)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:28.682536 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fa2c9-20c0-4fce-a21d-e66435942b25 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:28.813881 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:28.826962 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-410fa2c9-20c0-4fce-a21d-e66435942b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7c75c6de464c33929aae35e56a87e0'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:28.827603 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-410fa2c9-20c0-4fce-a21d-e66435942b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7c75c6de464c33929aae35e56a87e0'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:28.887131 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-410fa2c9-20c0-4fce-a21d-e66435942b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7c75c6de464c33929aae35e56a87e0'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:28.895926 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-410fa2c9-20c0-4fce-a21d-e66435942b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7c75c6de464c33929aae35e56a87e0'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:28.907907 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-410fa2c9-20c0-4fce-a21d-e66435942b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7c75c6de464c33929aae35e56a87e0'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:28.914424 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1417/2821] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:28 2022] DELETE /identity/v3/users/6d7c75c6de464c33929aae35e56a87e0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:28.918944 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f53a53-4a80-468a-b19d-ad508fee3602 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:28.919237 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f53a53-4a80-468a-b19d-ad508fee3602 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:28.919548 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f53a53-4a80-468a-b19d-ad508fee3602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:28.939872 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-f8f53a53-4a80-468a-b19d-ad508fee3602 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:28.941144 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f8f53a53-4a80-468a-b19d-ad508fee3602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:29.002766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1405/2822] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:29.012710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fa2c9-20c0-4fce-a21d-e66435942b25 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:29.014253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-410fa2c9-20c0-4fce-a21d-e66435942b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:29.073332 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fa2c9-20c0-4fce-a21d-e66435942b25 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:29.077066 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82447e7-ea9e-41dd-bc7f-fdc2d937fcdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:29.077825 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82447e7-ea9e-41dd-bc7f-fdc2d937fcdd service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:29.078111 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82447e7-ea9e-41dd-bc7f-fdc2d937fcdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:29.078391 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82447e7-ea9e-41dd-bc7f-fdc2d937fcdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:29.088044 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82447e7-ea9e-41dd-bc7f-fdc2d937fcdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:29.089632 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82447e7-ea9e-41dd-bc7f-fdc2d937fcdd service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:29.099829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1418/2823] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:29.537955 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f53a53-4a80-468a-b19d-ad508fee3602 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:29.539186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f8f53a53-4a80-468a-b19d-ad508fee3602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:29.552014 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f53a53-4a80-468a-b19d-ad508fee3602 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:29.556626 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd776cb-a9e7-4cb3-8368-29f5b83fc3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:29.557274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd776cb-a9e7-4cb3-8368-29f5b83fc3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:29.557586 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd776cb-a9e7-4cb3-8368-29f5b83fc3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:29.557862 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd776cb-a9e7-4cb3-8368-29f5b83fc3b8 admin admin] PATH_INFO: `/v3/projects/ff16073ab1d44fb39da960e2e077219e` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:29.559427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd776cb-a9e7-4cb3-8368-29f5b83fc3b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff16073ab1d44fb39da960e2e077219e)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:29.560932 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd776cb-a9e7-4cb3-8368-29f5b83fc3b8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:29.644522 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:29.656957 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6dd776cb-a9e7-4cb3-8368-29f5b83fc3b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff16073ab1d44fb39da960e2e077219e', 'request_id': 'req-6dd776cb-a9e7-4cb3-8368-29f5b83fc3b8'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:29.719297 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6dd776cb-a9e7-4cb3-8368-29f5b83fc3b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff16073ab1d44fb39da960e2e077219e', 'request_id': 'req-6dd776cb-a9e7-4cb3-8368-29f5b83fc3b8'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:29.726226 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6dd776cb-a9e7-4cb3-8368-29f5b83fc3b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff16073ab1d44fb39da960e2e077219e', 'request_id': 'req-6dd776cb-a9e7-4cb3-8368-29f5b83fc3b8'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:29.737572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6dd776cb-a9e7-4cb3-8368-29f5b83fc3b8 admin admin] The token cache is being invalidate because project ff16073ab1d44fb39da960e2e077219e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:29.738387 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6dd776cb-a9e7-4cb3-8368-29f5b83fc3b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:29.739034 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6dd776cb-a9e7-4cb3-8368-29f5b83fc3b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:29.744670 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1406/2824] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:29 2022] DELETE /identity/v3/projects/ff16073ab1d44fb39da960e2e077219e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:29.752360 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62bd0e-b034-4606-8e0b-40e7ca259ada None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:29.752821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62bd0e-b034-4606-8e0b-40e7ca259ada None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:29.752918 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62bd0e-b034-4606-8e0b-40e7ca259ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:29.773725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-ff62bd0e-b034-4606-8e0b-40e7ca259ada None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:29.774936 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ff62bd0e-b034-4606-8e0b-40e7ca259ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:29.834577 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1419/2825] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:29.842088 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca8018-84d7-4d62-9f45-101f8bb3d1f4 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:29.842379 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca8018-84d7-4d62-9f45-101f8bb3d1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:29.842653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca8018-84d7-4d62-9f45-101f8bb3d1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:29.862396 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-69ca8018-84d7-4d62-9f45-101f8bb3d1f4 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:29.864252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-69ca8018-84d7-4d62-9f45-101f8bb3d1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:29.872146 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1407/2826] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:29.876324 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62bd0e-b034-4606-8e0b-40e7ca259ada None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:29.887079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62bd0e-b034-4606-8e0b-40e7ca259ada None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:29.891797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bea7c7-1977-4f50-98b4-b69a1ebcf02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:29.892413 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bea7c7-1977-4f50-98b4-b69a1ebcf02e admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:29.892954 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bea7c7-1977-4f50-98b4-b69a1ebcf02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:29.893234 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bea7c7-1977-4f50-98b4-b69a1ebcf02e admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:29.894012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bea7c7-1977-4f50-98b4-b69a1ebcf02e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:40:29.894544 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bea7c7-1977-4f50-98b4-b69a1ebcf02e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:29.896388 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bea7c7-1977-4f50-98b4-b69a1ebcf02e admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:29.908058 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1420/2827] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:40:29.913083 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca8018-84d7-4d62-9f45-101f8bb3d1f4 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:29.922337 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca8018-84d7-4d62-9f45-101f8bb3d1f4 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:29.927598 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82342ed-6568-4bf6-a084-7b3fc0dfd27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:29.928202 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82342ed-6568-4bf6-a084-7b3fc0dfd27b admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:29.928479 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82342ed-6568-4bf6-a084-7b3fc0dfd27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:29.928750 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82342ed-6568-4bf6-a084-7b3fc0dfd27b admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:29.929423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82342ed-6568-4bf6-a084-7b3fc0dfd27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:29.931332 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82342ed-6568-4bf6-a084-7b3fc0dfd27b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:30.005692 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1408/2828] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:40:29 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:30.009904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bea7c7-1977-4f50-98b4-b69a1ebcf02e admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:30.020169 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bea7c7-1977-4f50-98b4-b69a1ebcf02e admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:30.053842 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:30.077187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e341812-5ab1-491b-a9ff-4905cbdfdfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:30.077933 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e341812-5ab1-491b-a9ff-4905cbdfdfa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:30.078219 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e341812-5ab1-491b-a9ff-4905cbdfdfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:30.078498 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e341812-5ab1-491b-a9ff-4905cbdfdfa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:30.079160 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e341812-5ab1-491b-a9ff-4905cbdfdfa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:30.081070 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e341812-5ab1-491b-a9ff-4905cbdfdfa6 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:30.210568 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1421/2829] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:40:30 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:30.214886 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82342ed-6568-4bf6-a084-7b3fc0dfd27b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:30.225763 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82342ed-6568-4bf6-a084-7b3fc0dfd27b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:30.230288 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbff71-eb77-4956-91bd-45cc14fbdef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:30.230897 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbff71-eb77-4956-91bd-45cc14fbdef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:30.231181 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbff71-eb77-4956-91bd-45cc14fbdef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:30.231459 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbff71-eb77-4956-91bd-45cc14fbdef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:30.232204 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbff71-eb77-4956-91bd-45cc14fbdef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:30.233853 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbff71-eb77-4956-91bd-45cc14fbdef2 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:30.244282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1409/2830] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:30.248098 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e341812-5ab1-491b-a9ff-4905cbdfdfa6 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:30.258429 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e341812-5ab1-491b-a9ff-4905cbdfdfa6 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:30.267914 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ea566-7d09-4fb4-afc7-2ba05116d087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:30.268550 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ea566-7d09-4fb4-afc7-2ba05116d087 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:30.268836 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ea566-7d09-4fb4-afc7-2ba05116d087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:30.269680 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ea566-7d09-4fb4-afc7-2ba05116d087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:30.270392 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ea566-7d09-4fb4-afc7-2ba05116d087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:30.272079 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ea566-7d09-4fb4-afc7-2ba05116d087 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:30.284077 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1422/2831] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:30.288124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbff71-eb77-4956-91bd-45cc14fbdef2 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:30.297871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbff71-eb77-4956-91bd-45cc14fbdef2 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:30.303291 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259f23d-d9ab-4525-86da-5f310253163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:30.303970 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259f23d-d9ab-4525-86da-5f310253163e admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:30.304423 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259f23d-d9ab-4525-86da-5f310253163e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:30.304677 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259f23d-d9ab-4525-86da-5f310253163e admin admin] PATH_INFO: `/v3/projects/2a92cc42de224a0290e6328adb1e1924/users/48fbe830d1e74e49a869802f8094be90/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:30.320004 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259f23d-d9ab-4525-86da-5f310253163e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a92cc42de224a0290e6328adb1e1924, user_id=48fbe830d1e74e49a869802f8094be90, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:30.322698 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259f23d-d9ab-4525-86da-5f310253163e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:30.384521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1410/2832] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:30 2022] PUT /identity/v3/projects/2a92cc42de224a0290e6328adb1e1924/users/48fbe830d1e74e49a869802f8094be90/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:30.396398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857149cd-de7d-4166-8214-b48df571e7f5 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:30.396690 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857149cd-de7d-4166-8214-b48df571e7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:30.396999 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857149cd-de7d-4166-8214-b48df571e7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:30.426197 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-857149cd-de7d-4166-8214-b48df571e7f5 None None] MFA Rules not processed for user `48fbe830d1e74e49a869802f8094be90`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:30.427417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-857149cd-de7d-4166-8214-b48df571e7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:30.494165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1423/2833] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:30.505163 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259f23d-d9ab-4525-86da-5f310253163e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:30.506908 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4259f23d-d9ab-4525-86da-5f310253163e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:30.566028 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259f23d-d9ab-4525-86da-5f310253163e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:30.570120 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98792b-c5e5-4928-b09f-c6bbc1632fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:30.570747 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98792b-c5e5-4928-b09f-c6bbc1632fac service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:30.571027 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98792b-c5e5-4928-b09f-c6bbc1632fac service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:30.571301 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98792b-c5e5-4928-b09f-c6bbc1632fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:30.580113 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98792b-c5e5-4928-b09f-c6bbc1632fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:30.582130 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98792b-c5e5-4928-b09f-c6bbc1632fac service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:30.591675 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1411/2834] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:31.829362 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857149cd-de7d-4166-8214-b48df571e7f5 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:31.830808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-857149cd-de7d-4166-8214-b48df571e7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:31.906311 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857149cd-de7d-4166-8214-b48df571e7f5 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:31.913808 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fd48c-cfb5-49be-8df5-9800d43c934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:31.914483 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fd48c-cfb5-49be-8df5-9800d43c934a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:31.914765 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fd48c-cfb5-49be-8df5-9800d43c934a admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:31.915043 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fd48c-cfb5-49be-8df5-9800d43c934a admin admin] PATH_INFO: `/v3/users/63cfd897f8d843049cfb0705e0e969a4` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:31.916218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fd48c-cfb5-49be-8df5-9800d43c934a admin admin] RBAC: Authorizing `identity:delete_user(user_id=63cfd897f8d843049cfb0705e0e969a4)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:31.918218 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fd48c-cfb5-49be-8df5-9800d43c934a admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:32.101407 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-0d6fd48c-cfb5-49be-8df5-9800d43c934a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63cfd897f8d843049cfb0705e0e969a4'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:32.102084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-0d6fd48c-cfb5-49be-8df5-9800d43c934a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63cfd897f8d843049cfb0705e0e969a4'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:32.103793 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:32.191427 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-0d6fd48c-cfb5-49be-8df5-9800d43c934a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63cfd897f8d843049cfb0705e0e969a4'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:32.199037 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-0d6fd48c-cfb5-49be-8df5-9800d43c934a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63cfd897f8d843049cfb0705e0e969a4'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:32.212080 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-0d6fd48c-cfb5-49be-8df5-9800d43c934a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63cfd897f8d843049cfb0705e0e969a4'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:32.218549 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1424/2835] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:31 2022] DELETE /identity/v3/users/63cfd897f8d843049cfb0705e0e969a4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:32.223569 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077ba6d-4911-4c06-b10d-eb29254c137b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:32.223975 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077ba6d-4911-4c06-b10d-eb29254c137b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:32.224145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077ba6d-4911-4c06-b10d-eb29254c137b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:32.243905 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d077ba6d-4911-4c06-b10d-eb29254c137b None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:32.247272 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d077ba6d-4911-4c06-b10d-eb29254c137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:32.279599 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe163f-00d1-4e47-a1a0-60df568e5f5b None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:32.279887 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe163f-00d1-4e47-a1a0-60df568e5f5b None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:32.280296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe163f-00d1-4e47-a1a0-60df568e5f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:32.306484 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:32.306900 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-82fe163f-00d1-4e47-a1a0-60df568e5f5b None None] MFA Rules not processed for user `48fbe830d1e74e49a869802f8094be90`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:32.308249 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-82fe163f-00d1-4e47-a1a0-60df568e5f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:32.317262 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1412/2836] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:32.327102 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077ba6d-4911-4c06-b10d-eb29254c137b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:32.328439 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d077ba6d-4911-4c06-b10d-eb29254c137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:32.370706 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1425/2837] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:32.397395 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077ba6d-4911-4c06-b10d-eb29254c137b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:32.401871 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aea777-26fe-4bdd-ae02-0787e507b7cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:32.402285 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aea777-26fe-4bdd-ae02-0787e507b7cb service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:32.402457 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aea777-26fe-4bdd-ae02-0787e507b7cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:32.402739 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aea777-26fe-4bdd-ae02-0787e507b7cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:32.414279 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aea777-26fe-4bdd-ae02-0787e507b7cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:32.415699 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aea777-26fe-4bdd-ae02-0787e507b7cb service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:32.428572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1413/2838] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:40:33.041989 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe163f-00d1-4e47-a1a0-60df568e5f5b None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:33.043809 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-82fe163f-00d1-4e47-a1a0-60df568e5f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:33.058799 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe163f-00d1-4e47-a1a0-60df568e5f5b None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:33.070162 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359af487-d1cd-4a4e-b27d-cce8df779fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:33.071020 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359af487-d1cd-4a4e-b27d-cce8df779fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:33.071357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359af487-d1cd-4a4e-b27d-cce8df779fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:33.071694 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359af487-d1cd-4a4e-b27d-cce8df779fb1 admin admin] PATH_INFO: `/v3/projects/f69a10aa384245c594d57a05dac17a44` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:33.073355 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359af487-d1cd-4a4e-b27d-cce8df779fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f69a10aa384245c594d57a05dac17a44)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:33.075386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359af487-d1cd-4a4e-b27d-cce8df779fb1 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:33.215359 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-359af487-d1cd-4a4e-b27d-cce8df779fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f69a10aa384245c594d57a05dac17a44', 'request_id': 'req-359af487-d1cd-4a4e-b27d-cce8df779fb1'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:33.321844 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-359af487-d1cd-4a4e-b27d-cce8df779fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f69a10aa384245c594d57a05dac17a44', 'request_id': 'req-359af487-d1cd-4a4e-b27d-cce8df779fb1'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:33.328501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-359af487-d1cd-4a4e-b27d-cce8df779fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f69a10aa384245c594d57a05dac17a44', 'request_id': 'req-359af487-d1cd-4a4e-b27d-cce8df779fb1'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:33.340002 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-359af487-d1cd-4a4e-b27d-cce8df779fb1 admin admin] The token cache is being invalidate because project f69a10aa384245c594d57a05dac17a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:33.340296 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-359af487-d1cd-4a4e-b27d-cce8df779fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:33.340978 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-359af487-d1cd-4a4e-b27d-cce8df779fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:33.342622 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1426/2839] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:33 2022] DELETE /identity/v3/projects/f69a10aa384245c594d57a05dac17a44 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:33.444863 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aea777-26fe-4bdd-ae02-0787e507b7cb service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:33.455261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aea777-26fe-4bdd-ae02-0787e507b7cb service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:33.511475 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b48514-860c-4d69-b39f-5b613d4bafb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:33.512246 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b48514-860c-4d69-b39f-5b613d4bafb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:33.512411 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b48514-860c-4d69-b39f-5b613d4bafb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:33.512689 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b48514-860c-4d69-b39f-5b613d4bafb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:33.514563 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d6b48514-860c-4d69-b39f-5b613d4bafb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:33.597837 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b48514-860c-4d69-b39f-5b613d4bafb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:33.604322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b48514-860c-4d69-b39f-5b613d4bafb6 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:33.610353 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1414/2840] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:37.650638 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359af487-d1cd-4a4e-b27d-cce8df779fb1 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:37.652172 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-359af487-d1cd-4a4e-b27d-cce8df779fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:37.709855 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:37.723540 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359af487-d1cd-4a4e-b27d-cce8df779fb1 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:37.729303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd6347-6dab-480e-8ead-f7303054e808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:37.729303 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd6347-6dab-480e-8ead-f7303054e808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:37.729670 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd6347-6dab-480e-8ead-f7303054e808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:37.729958 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd6347-6dab-480e-8ead-f7303054e808 admin admin] PATH_INFO: `/v3/users/c2988e5d2f3b44a89f48a5c3a4aaf4d7` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:37.731224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd6347-6dab-480e-8ead-f7303054e808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2988e5d2f3b44a89f48a5c3a4aaf4d7)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:37.733209 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd6347-6dab-480e-8ead-f7303054e808 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:37.926928 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-70bd6347-6dab-480e-8ead-f7303054e808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2988e5d2f3b44a89f48a5c3a4aaf4d7'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:37.927878 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-70bd6347-6dab-480e-8ead-f7303054e808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2988e5d2f3b44a89f48a5c3a4aaf4d7'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:38.024421 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-70bd6347-6dab-480e-8ead-f7303054e808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2988e5d2f3b44a89f48a5c3a4aaf4d7'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:38.032308 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-70bd6347-6dab-480e-8ead-f7303054e808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2988e5d2f3b44a89f48a5c3a4aaf4d7'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:38.045829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-70bd6347-6dab-480e-8ead-f7303054e808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2988e5d2f3b44a89f48a5c3a4aaf4d7'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:38.055559 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1427/2841] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:37 2022] DELETE /identity/v3/users/c2988e5d2f3b44a89f48a5c3a4aaf4d7 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:38.058561 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7de1b-a708-4a05-a782-f126ca16ae95 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:38.059063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7de1b-a708-4a05-a782-f126ca16ae95 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:38.059917 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7de1b-a708-4a05-a782-f126ca16ae95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:38.083812 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-67a7de1b-a708-4a05-a782-f126ca16ae95 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:38.085209 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-67a7de1b-a708-4a05-a782-f126ca16ae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:38.148282 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:38.163544 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1415/2842] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:40:38.174040 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd6347-6dab-480e-8ead-f7303054e808 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:38.175776 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-70bd6347-6dab-480e-8ead-f7303054e808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:38.242015 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd6347-6dab-480e-8ead-f7303054e808 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:38.245991 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ea062-af2d-453d-841d-90be86b72dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:38.246714 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ea062-af2d-453d-841d-90be86b72dae service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:38.247077 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ea062-af2d-453d-841d-90be86b72dae service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:38.247354 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ea062-af2d-453d-841d-90be86b72dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:38.262724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ea062-af2d-453d-841d-90be86b72dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:38.264207 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ea062-af2d-453d-841d-90be86b72dae service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:38.276548 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1428/2843] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:38.669540 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7de1b-a708-4a05-a782-f126ca16ae95 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:38.671140 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-67a7de1b-a708-4a05-a782-f126ca16ae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:38.686928 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7de1b-a708-4a05-a782-f126ca16ae95 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:38.692872 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7de717-cce5-4d0d-a593-683f37a090ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:38.693580 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7de717-cce5-4d0d-a593-683f37a090ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:38.693867 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7de717-cce5-4d0d-a593-683f37a090ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:38.694224 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7de717-cce5-4d0d-a593-683f37a090ea admin admin] PATH_INFO: `/v3/projects/38df4274ea31412e88459e12dfb1f56f` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:38.695359 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7de717-cce5-4d0d-a593-683f37a090ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=38df4274ea31412e88459e12dfb1f56f)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:38.698449 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7de717-cce5-4d0d-a593-683f37a090ea admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:38.824234 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0b7de717-cce5-4d0d-a593-683f37a090ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38df4274ea31412e88459e12dfb1f56f', 'request_id': 'req-0b7de717-cce5-4d0d-a593-683f37a090ea'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:38.896760 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0b7de717-cce5-4d0d-a593-683f37a090ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38df4274ea31412e88459e12dfb1f56f', 'request_id': 'req-0b7de717-cce5-4d0d-a593-683f37a090ea'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:38.903772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0b7de717-cce5-4d0d-a593-683f37a090ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38df4274ea31412e88459e12dfb1f56f', 'request_id': 'req-0b7de717-cce5-4d0d-a593-683f37a090ea'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:38.915118 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0b7de717-cce5-4d0d-a593-683f37a090ea admin admin] The token cache is being invalidate because project 38df4274ea31412e88459e12dfb1f56f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:38.915409 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0b7de717-cce5-4d0d-a593-683f37a090ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:38.916062 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0b7de717-cce5-4d0d-a593-683f37a090ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:38.917824 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1416/2844] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:38 2022] DELETE /identity/v3/projects/38df4274ea31412e88459e12dfb1f56f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:38.923023 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c060-bca4-44cd-9635-be17f65cc6e5 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:38.923515 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c060-bca4-44cd-9635-be17f65cc6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:38.923689 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c060-bca4-44cd-9635-be17f65cc6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:38.945023 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-c954c060-bca4-44cd-9635-be17f65cc6e5 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:38.946265 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-c954c060-bca4-44cd-9635-be17f65cc6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:39.007636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1429/2845] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:39.016519 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a085d-7dd2-4061-b283-fcfa6aad788c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:39.016804 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a085d-7dd2-4061-b283-fcfa6aad788c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:39.017078 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a085d-7dd2-4061-b283-fcfa6aad788c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:39.037688 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-f20a085d-7dd2-4061-b283-fcfa6aad788c None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:39.038911 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f20a085d-7dd2-4061-b283-fcfa6aad788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:39.047172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1417/2846] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:39.053980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954c060-bca4-44cd-9635-be17f65cc6e5 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:39.061789 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954c060-bca4-44cd-9635-be17f65cc6e5 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:39.066465 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd5a28-d814-4ef7-8f23-05e26a380373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:39.067179 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd5a28-d814-4ef7-8f23-05e26a380373 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:39.067469 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd5a28-d814-4ef7-8f23-05e26a380373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:39.067755 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd5a28-d814-4ef7-8f23-05e26a380373 admin admin] PATH_INFO: `/v3/domains` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:39.068451 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd5a28-d814-4ef7-8f23-05e26a380373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:40:39.068760 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd5a28-d814-4ef7-8f23-05e26a380373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:39.070404 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd5a28-d814-4ef7-8f23-05e26a380373 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:39.082480 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1430/2847] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Jul 28 05:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:40:39.086820 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a085d-7dd2-4061-b283-fcfa6aad788c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:39.096137 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a085d-7dd2-4061-b283-fcfa6aad788c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:39.103057 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd65254-6a12-443c-8271-4f27f4d7e61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:39.103674 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd65254-6a12-443c-8271-4f27f4d7e61e admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:39.103960 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd65254-6a12-443c-8271-4f27f4d7e61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:39.104235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd65254-6a12-443c-8271-4f27f4d7e61e admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:39.104901 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd65254-6a12-443c-8271-4f27f4d7e61e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:39.106865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd65254-6a12-443c-8271-4f27f4d7e61e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:39.192091 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1418/2848] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:40:39 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:39.196272 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd5a28-d814-4ef7-8f23-05e26a380373 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:39.201417 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:39.208038 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd5a28-d814-4ef7-8f23-05e26a380373 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:39.265451 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e909003-f009-4073-9ac2-ff253300f2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:39.266165 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e909003-f009-4073-9ac2-ff253300f2ad admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:39.266448 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e909003-f009-4073-9ac2-ff253300f2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:39.266909 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e909003-f009-4073-9ac2-ff253300f2ad admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:39.267927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e909003-f009-4073-9ac2-ff253300f2ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:39.270793 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e909003-f009-4073-9ac2-ff253300f2ad admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:39.355435 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1431/2849] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:40:39 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:39.359628 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd65254-6a12-443c-8271-4f27f4d7e61e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:39.370640 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd65254-6a12-443c-8271-4f27f4d7e61e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:39.375337 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802095-3e24-4c7e-8517-535768aa9655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:39.375951 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802095-3e24-4c7e-8517-535768aa9655 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:39.376236 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802095-3e24-4c7e-8517-535768aa9655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:39.376514 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802095-3e24-4c7e-8517-535768aa9655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:39.377205 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef802095-3e24-4c7e-8517-535768aa9655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:39.379476 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef802095-3e24-4c7e-8517-535768aa9655 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:39.389838 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1419/2850] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:40:39.393988 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e909003-f009-4073-9ac2-ff253300f2ad admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:39.403838 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e909003-f009-4073-9ac2-ff253300f2ad admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:39.408468 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ef591-9620-436a-b1a3-433d11a3fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:39.409070 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ef591-9620-436a-b1a3-433d11a3fcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:39.409353 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ef591-9620-436a-b1a3-433d11a3fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:39.409659 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ef591-9620-436a-b1a3-433d11a3fcc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:39.410350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ef591-9620-436a-b1a3-433d11a3fcc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:39.411921 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ef591-9620-436a-b1a3-433d11a3fcc9 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:39.421669 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1432/2851] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:39.426112 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802095-3e24-4c7e-8517-535768aa9655 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:39.436167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802095-3e24-4c7e-8517-535768aa9655 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:39.441592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91456d53-867b-4116-ac60-16a65d684783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:39.442297 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91456d53-867b-4116-ac60-16a65d684783 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:39.442529 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91456d53-867b-4116-ac60-16a65d684783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:39.442807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91456d53-867b-4116-ac60-16a65d684783 admin admin] PATH_INFO: `/v3/projects/42f0cd3e66ff4f08bcabdd66f24995ff/users/2d005ca3fb6a40d2850c9d34a5ab7096/roles/d481402a8f1b4e189c0ecc05bce560e6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:39.457839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91456d53-867b-4116-ac60-16a65d684783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f0cd3e66ff4f08bcabdd66f24995ff, user_id=2d005ca3fb6a40d2850c9d34a5ab7096, role_id=d481402a8f1b4e189c0ecc05bce560e6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:39.460540 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91456d53-867b-4116-ac60-16a65d684783 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:39.547653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1420/2852] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:39 2022] PUT /identity/v3/projects/42f0cd3e66ff4f08bcabdd66f24995ff/users/2d005ca3fb6a40d2850c9d34a5ab7096/roles/d481402a8f1b4e189c0ecc05bce560e6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:39.553235 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada6c21-a0aa-4610-bb28-76e350431adc None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:39.553622 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada6c21-a0aa-4610-bb28-76e350431adc None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:39.553905 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada6c21-a0aa-4610-bb28-76e350431adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:39.573224 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-eada6c21-a0aa-4610-bb28-76e350431adc None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:39.574460 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-eada6c21-a0aa-4610-bb28-76e350431adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:39.632004 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1433/2853] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:39.641963 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91456d53-867b-4116-ac60-16a65d684783 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:39.645399 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-91456d53-867b-4116-ac60-16a65d684783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:39.702526 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91456d53-867b-4116-ac60-16a65d684783 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:39.706177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f383c6-971f-4287-b29d-b9667ac4cbc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:39.706988 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f383c6-971f-4287-b29d-b9667ac4cbc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:39.707273 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f383c6-971f-4287-b29d-b9667ac4cbc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:39.707554 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f383c6-971f-4287-b29d-b9667ac4cbc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:39.716506 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f383c6-971f-4287-b29d-b9667ac4cbc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:39.717974 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f383c6-971f-4287-b29d-b9667ac4cbc4 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:39.727932 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1421/2854] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:45.616409 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da2e71-97b6-486e-8941-7e82f6565e24 None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:45.617325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da2e71-97b6-486e-8941-7e82f6565e24 None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:45.617953 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da2e71-97b6-486e-8941-7e82f6565e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:45.650598 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-a1da2e71-97b6-486e-8941-7e82f6565e24 None None] MFA Rules not processed for user `2d005ca3fb6a40d2850c9d34a5ab7096`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:45.651804 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-a1da2e71-97b6-486e-8941-7e82f6565e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:45.720506 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1434/2855] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:45.725386 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f383c6-971f-4287-b29d-b9667ac4cbc4 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:45.735810 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f383c6-971f-4287-b29d-b9667ac4cbc4 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:45.741413 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc5ad8-70f5-47b1-9824-b47daf901845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:45.742235 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc5ad8-70f5-47b1-9824-b47daf901845 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:45.742515 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc5ad8-70f5-47b1-9824-b47daf901845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:45.742807 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc5ad8-70f5-47b1-9824-b47daf901845 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:45.743517 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc5ad8-70f5-47b1-9824-b47daf901845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:45.745408 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc5ad8-70f5-47b1-9824-b47daf901845 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:45.758419 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:45.853502 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1422/2856] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Jul 28 05:40:45 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:45.856157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da2e71-97b6-486e-8941-7e82f6565e24 None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:45.867071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da2e71-97b6-486e-8941-7e82f6565e24 None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:45.874636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:45.924955 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ecf4b-4dda-413d-bbeb-653480a456e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:45.925826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ecf4b-4dda-413d-bbeb-653480a456e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:45.926117 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ecf4b-4dda-413d-bbeb-653480a456e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:45.926394 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ecf4b-4dda-413d-bbeb-653480a456e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:45.927086 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ecf4b-4dda-413d-bbeb-653480a456e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:45.929125 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ecf4b-4dda-413d-bbeb-653480a456e8 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:46.039514 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1435/2857] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jul 28 05:40:45 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:46.043587 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc5ad8-70f5-47b1-9824-b47daf901845 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:46.054521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc5ad8-70f5-47b1-9824-b47daf901845 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:46.059899 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84451e6-1fb5-4252-a2da-3d04b6fec136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:46.060622 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84451e6-1fb5-4252-a2da-3d04b6fec136 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:46.060911 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84451e6-1fb5-4252-a2da-3d04b6fec136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:46.061190 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84451e6-1fb5-4252-a2da-3d04b6fec136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:46.062017 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84451e6-1fb5-4252-a2da-3d04b6fec136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:46.063690 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84451e6-1fb5-4252-a2da-3d04b6fec136 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:46.075117 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1423/2858] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:46.079766 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ecf4b-4dda-413d-bbeb-653480a456e8 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:46.090248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ecf4b-4dda-413d-bbeb-653480a456e8 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:46.094973 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96258fcf-5c66-4fce-8d68-7247f07e206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:46.095684 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96258fcf-5c66-4fce-8d68-7247f07e206c admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:46.095966 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96258fcf-5c66-4fce-8d68-7247f07e206c admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:46.096242 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96258fcf-5c66-4fce-8d68-7247f07e206c admin admin] PATH_INFO: `/v3/projects/c76b4d6891ab46e389c696871666825f/users/60c8a29bb3494032b746ee0141f52964/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:46.111576 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96258fcf-5c66-4fce-8d68-7247f07e206c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76b4d6891ab46e389c696871666825f, user_id=60c8a29bb3494032b746ee0141f52964, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:46.114883 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96258fcf-5c66-4fce-8d68-7247f07e206c admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:46.224905 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1436/2859] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:46 2022] PUT /identity/v3/projects/c76b4d6891ab46e389c696871666825f/users/60c8a29bb3494032b746ee0141f52964/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:46.228991 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84451e6-1fb5-4252-a2da-3d04b6fec136 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:46.239602 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84451e6-1fb5-4252-a2da-3d04b6fec136 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:46.305096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca726a03-60c2-4e27-840b-ee18589371a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:46.305789 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca726a03-60c2-4e27-840b-ee18589371a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:46.306073 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca726a03-60c2-4e27-840b-ee18589371a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:46.306350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca726a03-60c2-4e27-840b-ee18589371a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:46.307057 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca726a03-60c2-4e27-840b-ee18589371a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:46.308660 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca726a03-60c2-4e27-840b-ee18589371a0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:46.324825 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1424/2860] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:46.329093 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96258fcf-5c66-4fce-8d68-7247f07e206c admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:46.340550 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96258fcf-5c66-4fce-8d68-7247f07e206c admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:46.345504 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09172010-955f-4ef7-8f10-6dae67150fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:46.346225 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09172010-955f-4ef7-8f10-6dae67150fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:46.346510 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09172010-955f-4ef7-8f10-6dae67150fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:46.346898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09172010-955f-4ef7-8f10-6dae67150fcc admin admin] PATH_INFO: `/v3/projects/c76b4d6891ab46e389c696871666825f/users/60c8a29bb3494032b746ee0141f52964/roles/34617b6ad5f84a929307dfce82d9aecd` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:46.350829 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09172010-955f-4ef7-8f10-6dae67150fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76b4d6891ab46e389c696871666825f, user_id=60c8a29bb3494032b746ee0141f52964, role_id=34617b6ad5f84a929307dfce82d9aecd)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:46.353493 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09172010-955f-4ef7-8f10-6dae67150fcc admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:46.365249 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1437/2861] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:46 2022] PUT /identity/v3/projects/c76b4d6891ab46e389c696871666825f/users/60c8a29bb3494032b746ee0141f52964/roles/34617b6ad5f84a929307dfce82d9aecd => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:40:52.099667 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a976718-6ef2-4f67-807d-5753becd026d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:52.100162 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a976718-6ef2-4f67-807d-5753becd026d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:52.100273 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a976718-6ef2-4f67-807d-5753becd026d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:52.122250 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6a976718-6ef2-4f67-807d-5753becd026d None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:52.123567 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6a976718-6ef2-4f67-807d-5753becd026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:52.204499 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1425/2862] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jul 28 05:40:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:40:52.364893 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09172010-955f-4ef7-8f10-6dae67150fcc admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:52.366710 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-09172010-955f-4ef7-8f10-6dae67150fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:52.478025 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09172010-955f-4ef7-8f10-6dae67150fcc admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:52.485034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546498ab-bed2-40e5-8b73-e5768f25dc4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:52.485903 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546498ab-bed2-40e5-8b73-e5768f25dc4a service swift] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:52.486223 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546498ab-bed2-40e5-8b73-e5768f25dc4a service swift] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:52.486597 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546498ab-bed2-40e5-8b73-e5768f25dc4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:52.498489 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546498ab-bed2-40e5-8b73-e5768f25dc4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:52.500514 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546498ab-bed2-40e5-8b73-e5768f25dc4a service swift] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:52.516641 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1438/2863] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:40:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:40:52.919150 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e54267-5e53-40e9-bc4d-813c520b0579 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:52.919440 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e54267-5e53-40e9-bc4d-813c520b0579 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:52.919742 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e54267-5e53-40e9-bc4d-813c520b0579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:52.953014 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b7e54267-5e53-40e9-bc4d-813c520b0579 None None] MFA Rules not processed for user `60c8a29bb3494032b746ee0141f52964`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:52.954358 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b7e54267-5e53-40e9-bc4d-813c520b0579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:53.037171 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1426/2864] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:52 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:40:53.052551 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546498ab-bed2-40e5-8b73-e5768f25dc4a service swift] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:53.054148 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-546498ab-bed2-40e5-8b73-e5768f25dc4a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:53.117904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:53.139603 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546498ab-bed2-40e5-8b73-e5768f25dc4a service swift] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:53.145689 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a98c52-bedb-43ea-a48c-35d30b128ed7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:53.146315 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a98c52-bedb-43ea-a48c-35d30b128ed7 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:53.146599 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a98c52-bedb-43ea-a48c-35d30b128ed7 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:53.146876 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a98c52-bedb-43ea-a48c-35d30b128ed7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:53.208273 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a98c52-bedb-43ea-a48c-35d30b128ed7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:53.210358 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a98c52-bedb-43ea-a48c-35d30b128ed7 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:53.225665 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1439/2865] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:53.511139 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c78e6-0c6b-4ed9-94b4-91ca2c95c94c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:53.511671 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c78e6-0c6b-4ed9-94b4-91ca2c95c94c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:53.511786 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c78e6-0c6b-4ed9-94b4-91ca2c95c94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:53.527333 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:53.537251 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a18c78e6-0c6b-4ed9-94b4-91ca2c95c94c None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:53.538599 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a18c78e6-0c6b-4ed9-94b4-91ca2c95c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:53.545962 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1427/2866] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jul 28 05:40:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:53.559099 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a98c52-bedb-43ea-a48c-35d30b128ed7 service nova] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:53.572325 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a98c52-bedb-43ea-a48c-35d30b128ed7 service nova] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:53.577386 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc33053-fd9d-4c31-8e8f-8a714eb64d25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:53.578077 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc33053-fd9d-4c31-8e8f-8a714eb64d25 service swift] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:53.578362 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc33053-fd9d-4c31-8e8f-8a714eb64d25 service swift] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:53.578633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc33053-fd9d-4c31-8e8f-8a714eb64d25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:53.588155 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc33053-fd9d-4c31-8e8f-8a714eb64d25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:53.589803 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc33053-fd9d-4c31-8e8f-8a714eb64d25 service swift] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:53.599383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1440/2867] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:40:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:40:54.390442 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025413b-9ef5-46be-a31d-19f66fec8b11 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:54.390748 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025413b-9ef5-46be-a31d-19f66fec8b11 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:54.391019 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025413b-9ef5-46be-a31d-19f66fec8b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:54.414399 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-5025413b-9ef5-46be-a31d-19f66fec8b11 None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:54.415631 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5025413b-9ef5-46be-a31d-19f66fec8b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:54.423257 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1428/2868] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jul 28 05:40:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:54.437396 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc33053-fd9d-4c31-8e8f-8a714eb64d25 service swift] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:54.449118 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc33053-fd9d-4c31-8e8f-8a714eb64d25 service swift] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:54.454528 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d748718-0ffb-4a09-b400-f9415e2c0159 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:54.455228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d748718-0ffb-4a09-b400-f9415e2c0159 service swift] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:54.455589 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d748718-0ffb-4a09-b400-f9415e2c0159 service swift] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:54.456381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d748718-0ffb-4a09-b400-f9415e2c0159 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:54.464686 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d748718-0ffb-4a09-b400-f9415e2c0159 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:54.466466 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d748718-0ffb-4a09-b400-f9415e2c0159 service swift] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:54.475839 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1441/2869] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:40:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:40:55.213096 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c356-f647-4177-aaf3-0d1933c0288b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:55.213625 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c356-f647-4177-aaf3-0d1933c0288b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:55.213863 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c356-f647-4177-aaf3-0d1933c0288b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:55.232990 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-abd7c356-f647-4177-aaf3-0d1933c0288b None None] MFA Rules not processed for user `2d45700d35664abaae5eb8b42e2e05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:55.234350 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-abd7c356-f647-4177-aaf3-0d1933c0288b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:55.243083 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1429/2870] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jul 28 05:40:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:40:55.276972 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d748718-0ffb-4a09-b400-f9415e2c0159 service swift] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:55.288301 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d748718-0ffb-4a09-b400-f9415e2c0159 service swift] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:55.293725 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88062a8-9a64-40bc-84b7-48844e01e6d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb89e2ac885f42eb95fe3b67f3808ba9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:55.294403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88062a8-9a64-40bc-84b7-48844e01e6d1 service swift] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:55.294674 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88062a8-9a64-40bc-84b7-48844e01e6d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:55.294944 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88062a8-9a64-40bc-84b7-48844e01e6d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:55.304826 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88062a8-9a64-40bc-84b7-48844e01e6d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:55.306459 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88062a8-9a64-40bc-84b7-48844e01e6d1 service swift] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:55.316131 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1442/2871] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jul 28 05:40:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:40:56.186122 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eabffc-a712-495b-bcd4-6b6adfe82abe None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:56.186382 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eabffc-a712-495b-bcd4-6b6adfe82abe None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:56.186726 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eabffc-a712-495b-bcd4-6b6adfe82abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:56.208360 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-02eabffc-a712-495b-bcd4-6b6adfe82abe None None] MFA Rules not processed for user `2d005ca3fb6a40d2850c9d34a5ab7096`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:56.209549 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-02eabffc-a712-495b-bcd4-6b6adfe82abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:56.216635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1430/2872] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:58.249002 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88062a8-9a64-40bc-84b7-48844e01e6d1 service swift] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:58.250430 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-a88062a8-9a64-40bc-84b7-48844e01e6d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:58.319383 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88062a8-9a64-40bc-84b7-48844e01e6d1 service swift] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:58.324102 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eac5ff-d3d8-4035-bbcc-09ed6890258d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:58.324759 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eac5ff-d3d8-4035-bbcc-09ed6890258d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:58.325045 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eac5ff-d3d8-4035-bbcc-09ed6890258d admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:58.325403 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eac5ff-d3d8-4035-bbcc-09ed6890258d admin admin] PATH_INFO: `/v3/users/48fbe830d1e74e49a869802f8094be90` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:58.326596 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eac5ff-d3d8-4035-bbcc-09ed6890258d admin admin] RBAC: Authorizing `identity:delete_user(user_id=48fbe830d1e74e49a869802f8094be90)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:58.328817 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eac5ff-d3d8-4035-bbcc-09ed6890258d admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:58.512048 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-a7eac5ff-d3d8-4035-bbcc-09ed6890258d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48fbe830d1e74e49a869802f8094be90'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:58.512709 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-a7eac5ff-d3d8-4035-bbcc-09ed6890258d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48fbe830d1e74e49a869802f8094be90'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:58.516402 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:58.587453 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-a7eac5ff-d3d8-4035-bbcc-09ed6890258d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48fbe830d1e74e49a869802f8094be90'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:58.594749 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-a7eac5ff-d3d8-4035-bbcc-09ed6890258d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48fbe830d1e74e49a869802f8094be90'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:58.607254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-a7eac5ff-d3d8-4035-bbcc-09ed6890258d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48fbe830d1e74e49a869802f8094be90'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:58.614012 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1443/2873] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:58 2022] DELETE /identity/v3/users/48fbe830d1e74e49a869802f8094be90 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:58.619145 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859802e3-2ba4-42ec-b415-63b65afb3543 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:58.624066 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859802e3-2ba4-42ec-b415-63b65afb3543 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:58.624066 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859802e3-2ba4-42ec-b415-63b65afb3543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:58.639288 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-859802e3-2ba4-42ec-b415-63b65afb3543 None None] MFA Rules not processed for user `40170d20cf2e4d67929f88ba378a2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:58.640661 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-859802e3-2ba4-42ec-b415-63b65afb3543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:58.702662 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1431/2874] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:58.713456 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eac5ff-d3d8-4035-bbcc-09ed6890258d admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:58.714914 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-a7eac5ff-d3d8-4035-bbcc-09ed6890258d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:58.776236 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eac5ff-d3d8-4035-bbcc-09ed6890258d admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:58.779980 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca749f26-3c9c-436e-843b-cf3a4bb1bc7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:58.780604 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca749f26-3c9c-436e-843b-cf3a4bb1bc7f service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:58.780888 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca749f26-3c9c-436e-843b-cf3a4bb1bc7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:58.781166 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca749f26-3c9c-436e-843b-cf3a4bb1bc7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:58.790130 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca749f26-3c9c-436e-843b-cf3a4bb1bc7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:58.791553 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca749f26-3c9c-436e-843b-cf3a4bb1bc7f service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:58.801244 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1444/2875] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:59.055772 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859802e3-2ba4-42ec-b415-63b65afb3543 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:59.064817 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-859802e3-2ba4-42ec-b415-63b65afb3543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:59.072274 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859802e3-2ba4-42ec-b415-63b65afb3543 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:59.077372 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebe856-37f7-430d-a74f-303a3869e42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:59.078092 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebe856-37f7-430d-a74f-303a3869e42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:59.078376 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebe856-37f7-430d-a74f-303a3869e42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:59.078653 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebe856-37f7-430d-a74f-303a3869e42d admin admin] PATH_INFO: `/v3/projects/2a92cc42de224a0290e6328adb1e1924` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:59.079952 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebe856-37f7-430d-a74f-303a3869e42d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a92cc42de224a0290e6328adb1e1924)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:59.081898 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebe856-37f7-430d-a74f-303a3869e42d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:59.208231 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13ebe856-37f7-430d-a74f-303a3869e42d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a92cc42de224a0290e6328adb1e1924', 'request_id': 'req-13ebe856-37f7-430d-a74f-303a3869e42d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:59.279277 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13ebe856-37f7-430d-a74f-303a3869e42d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a92cc42de224a0290e6328adb1e1924', 'request_id': 'req-13ebe856-37f7-430d-a74f-303a3869e42d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:59.286913 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13ebe856-37f7-430d-a74f-303a3869e42d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a92cc42de224a0290e6328adb1e1924', 'request_id': 'req-13ebe856-37f7-430d-a74f-303a3869e42d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:59.297428 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13ebe856-37f7-430d-a74f-303a3869e42d admin admin] The token cache is being invalidate because project 2a92cc42de224a0290e6328adb1e1924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:59.297839 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13ebe856-37f7-430d-a74f-303a3869e42d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:59.298592 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13ebe856-37f7-430d-a74f-303a3869e42d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:59.300165 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1432/2876] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:59 2022] DELETE /identity/v3/projects/2a92cc42de224a0290e6328adb1e1924 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:41:08.796902 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=38,keystone:DELETE=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:41:09.294322 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:41:25.593776 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca749f26-3c9c-436e-843b-cf3a4bb1bc7f service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:41:25.595248 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ca749f26-3c9c-436e-843b-cf3a4bb1bc7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:41:25.607369 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca749f26-3c9c-436e-843b-cf3a4bb1bc7f service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:41:25.657572 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83ba77-9cc4-4414-970c-563fd071cbf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:41:25.658196 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83ba77-9cc4-4414-970c-563fd071cbf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:41:25.658477 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83ba77-9cc4-4414-970c-563fd071cbf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:41:25.658753 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83ba77-9cc4-4414-970c-563fd071cbf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:41:25.660489 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9e83ba77-9cc4-4414-970c-563fd071cbf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:41:25.731396 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83ba77-9cc4-4414-970c-563fd071cbf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:41:25.732821 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83ba77-9cc4-4414-970c-563fd071cbf6 service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:41:25.744524 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1445/2877] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:41:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:41:30.722352 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebe856-37f7-430d-a74f-303a3869e42d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:41:30.723865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-13ebe856-37f7-430d-a74f-303a3869e42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:41:30.736087 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebe856-37f7-430d-a74f-303a3869e42d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:41:30.739643 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d31d4-e767-4901-8f3d-639e04719ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:41:30.740247 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d31d4-e767-4901-8f3d-639e04719ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:41:30.740524 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d31d4-e767-4901-8f3d-639e04719ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:41:30.740794 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d31d4-e767-4901-8f3d-639e04719ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:41:30.742472 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-920d31d4-e767-4901-8f3d-639e04719ce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:41:30.805733 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d31d4-e767-4901-8f3d-639e04719ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:41:30.807080 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d31d4-e767-4901-8f3d-639e04719ce1 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:41:30.816714 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1433/2878] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:41:30 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:41:35.738914 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=54 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:41:40.812427 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=30 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:42:37.469257 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83ba77-9cc4-4414-970c-563fd071cbf6 service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:42:37.470723 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-9e83ba77-9cc4-4414-970c-563fd071cbf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:42:37.485863 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83ba77-9cc4-4414-970c-563fd071cbf6 service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:42:37.492350 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b8754-ea8e-4d96-9d4f-ce118915cb14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:42:37.493006 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b8754-ea8e-4d96-9d4f-ce118915cb14 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:37.493289 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b8754-ea8e-4d96-9d4f-ce118915cb14 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:37.493605 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b8754-ea8e-4d96-9d4f-ce118915cb14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:37.495501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f46b8754-ea8e-4d96-9d4f-ce118915cb14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:42:37.509195 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b8754-ea8e-4d96-9d4f-ce118915cb14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:42:37.510853 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b8754-ea8e-4d96-9d4f-ce118915cb14 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:42:37.527794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1446/2879] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:42:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:42:39.643319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00092d-bf93-470e-9da5-a380bb0fbe1c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:39.643941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00092d-bf93-470e-9da5-a380bb0fbe1c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:39.643941 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00092d-bf93-470e-9da5-a380bb0fbe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:39.664167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3b00092d-bf93-470e-9da5-a380bb0fbe1c None None] MFA Rules not processed for user `09217832f8e74db38d990d25faee4305`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:42:39.665378 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3b00092d-bf93-470e-9da5-a380bb0fbe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:42:39.718918 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1434/2880] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:42:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:42:40.028770 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b8754-ea8e-4d96-9d4f-ce118915cb14 service nova] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:42:40.038746 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b8754-ea8e-4d96-9d4f-ce118915cb14 service nova] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:42:40.042434 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daefbc-31d1-4d42-a81c-b69a629c392d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:42:40.043071 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daefbc-31d1-4d42-a81c-b69a629c392d service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:40.043356 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daefbc-31d1-4d42-a81c-b69a629c392d service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:40.043633 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daefbc-31d1-4d42-a81c-b69a629c392d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:40.045357 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f7daefbc-31d1-4d42-a81c-b69a629c392d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:42:40.055241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daefbc-31d1-4d42-a81c-b69a629c392d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:42:40.056660 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daefbc-31d1-4d42-a81c-b69a629c392d service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:42:40.064937 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1447/2881] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:42:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:42:41.871445 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00092d-bf93-470e-9da5-a380bb0fbe1c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:42:41.872859 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3b00092d-bf93-470e-9da5-a380bb0fbe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:42:41.943261 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00092d-bf93-470e-9da5-a380bb0fbe1c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:42:41.948909 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d567a47-40bf-4b4e-a8ea-b00f2bce1e63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aae5b2e7bf74805b04d01df47693ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:42:41.949560 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d567a47-40bf-4b4e-a8ea-b00f2bce1e63 service placement] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:41.949845 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d567a47-40bf-4b4e-a8ea-b00f2bce1e63 service placement] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:41.950127 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d567a47-40bf-4b4e-a8ea-b00f2bce1e63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:41.951884 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5d567a47-40bf-4b4e-a8ea-b00f2bce1e63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:42:41.964510 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d567a47-40bf-4b4e-a8ea-b00f2bce1e63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:42:41.966201 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d567a47-40bf-4b4e-a8ea-b00f2bce1e63 service placement] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:42:41.976808 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1435/2882] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:42:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:42:44.247927 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daefbc-31d1-4d42-a81c-b69a629c392d service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:42:44.249662 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-f7daefbc-31d1-4d42-a81c-b69a629c392d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:42:44.260974 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daefbc-31d1-4d42-a81c-b69a629c392d service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:42:44.264778 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ca085-10f9-4902-863b-20020c64f38c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:42:44.265705 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ca085-10f9-4902-863b-20020c64f38c service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:44.265992 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ca085-10f9-4902-863b-20020c64f38c service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:44.266269 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ca085-10f9-4902-863b-20020c64f38c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:44.268254 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-5e7ca085-10f9-4902-863b-20020c64f38c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:42:44.279283 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ca085-10f9-4902-863b-20020c64f38c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:42:44.280738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ca085-10f9-4902-863b-20020c64f38c service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:42:44.290554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1448/2883] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:42:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:42:51.972441 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=57 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:42:54.286587 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=18 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:42:59.187416 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d567a47-40bf-4b4e-a8ea-b00f2bce1e63 service placement] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:42:59.200446 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d567a47-40bf-4b4e-a8ea-b00f2bce1e63 service placement] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:42:59.206183 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932fae2-6523-4eff-9ca3-5d2261ecbbf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:42:59.206804 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932fae2-6523-4eff-9ca3-5d2261ecbbf2 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:59.207216 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932fae2-6523-4eff-9ca3-5d2261ecbbf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:59.207514 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932fae2-6523-4eff-9ca3-5d2261ecbbf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:59.209940 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0932fae2-6523-4eff-9ca3-5d2261ecbbf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:42:59.222199 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932fae2-6523-4eff-9ca3-5d2261ecbbf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:42:59.224151 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932fae2-6523-4eff-9ca3-5d2261ecbbf2 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:42:59.234562 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1436/2884] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:42:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:43:03.897570 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ca085-10f9-4902-863b-20020c64f38c service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:43:03.911023 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ca085-10f9-4902-863b-20020c64f38c service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:43:03.917339 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaad95-12c0-4184-a94e-e17a1ab6e003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d8c709e6f4462c98c055cb03eebf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:43:03.918084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaad95-12c0-4184-a94e-e17a1ab6e003 service nova] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:03.918311 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaad95-12c0-4184-a94e-e17a1ab6e003 service nova] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:03.918588 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaad95-12c0-4184-a94e-e17a1ab6e003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:03.920412 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-42aaad95-12c0-4184-a94e-e17a1ab6e003 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:03.933017 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aaad95-12c0-4184-a94e-e17a1ab6e003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:43:03.934613 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aaad95-12c0-4184-a94e-e17a1ab6e003 service nova] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:43:03.946003 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1449/2885] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:43:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:43:09.230063 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=6 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:43:13.941698 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=6 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:43:42.959701 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932fae2-6523-4eff-9ca3-5d2261ecbbf2 service nova] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:43:42.970120 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932fae2-6523-4eff-9ca3-5d2261ecbbf2 service nova] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:43:42.973852 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d089df-b19f-479f-868d-67234c71fe3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:43:42.974467 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d089df-b19f-479f-868d-67234c71fe3c service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:42.974754 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d089df-b19f-479f-868d-67234c71fe3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:42.975060 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d089df-b19f-479f-868d-67234c71fe3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:42.976987 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-84d089df-b19f-479f-868d-67234c71fe3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:42.987337 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d089df-b19f-479f-868d-67234c71fe3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:43:42.988838 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d089df-b19f-479f-868d-67234c71fe3c service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:43:42.997336 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1437/2886] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:43:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:43:43.073953 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaad95-12c0-4184-a94e-e17a1ab6e003 service nova] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:43:43.084104 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaad95-12c0-4184-a94e-e17a1ab6e003 service nova] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:43:43.087693 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57532aa8-2c55-4cc1-aa99-c5728e4820ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:43:43.089440 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57532aa8-2c55-4cc1-aa99-c5728e4820ce service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:43.089786 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57532aa8-2c55-4cc1-aa99-c5728e4820ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:43.090096 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57532aa8-2c55-4cc1-aa99-c5728e4820ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:43.091937 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-57532aa8-2c55-4cc1-aa99-c5728e4820ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:43.106268 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57532aa8-2c55-4cc1-aa99-c5728e4820ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:43:43.108241 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57532aa8-2c55-4cc1-aa99-c5728e4820ce service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:43:43.119358 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1450/2887] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:43:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:43:52.993461 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=6 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:43:53.114297 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=6 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:40.248176 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d089df-b19f-479f-868d-67234c71fe3c service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:40.249641 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-84d089df-b19f-479f-868d-67234c71fe3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:40.306491 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d089df-b19f-479f-868d-67234c71fe3c service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:40.310029 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82534126-920f-46c7-8275-9749a2b5e4b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae981c7273843d4ac734dd876bebe5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:40.310635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82534126-920f-46c7-8275-9749a2b5e4b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:40.310914 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82534126-920f-46c7-8275-9749a2b5e4b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:40.311182 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82534126-920f-46c7-8275-9749a2b5e4b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:40.312900 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-82534126-920f-46c7-8275-9749a2b5e4b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:40.323910 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82534126-920f-46c7-8275-9749a2b5e4b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:40.325319 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82534126-920f-46c7-8275-9749a2b5e4b4 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:40.334124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1438/2888] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:40.445904 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85f7f5-71b6-457f-b07e-58cc0bcb219f None None] REQUEST_METHOD: `POST` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:40.446421 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85f7f5-71b6-457f-b07e-58cc0bcb219f None None] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:40.446534 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85f7f5-71b6-457f-b07e-58cc0bcb219f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:40.466157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.auth.core [None req-2f85f7f5-71b6-457f-b07e-58cc0bcb219f None None] MFA Rules not processed for user `09217832f8e74db38d990d25faee4305`. Rule list: `[]` (Enabled: `True`). {{(pid=80268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:40.467381 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2f85f7f5-71b6-457f-b07e-58cc0bcb219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:40.475196 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1451/2889] 10.222.0.33 () {58 vars in 958 bytes} [Thu Jul 28 05:44:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:50.330105 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=26 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:50.461034 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=3 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:19.847521 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82534126-920f-46c7-8275-9749a2b5e4b4 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:19.859227 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82534126-920f-46c7-8275-9749a2b5e4b4 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:19.864279 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf8620-c4fe-4a6b-b061-6280ffe6454b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aae5b2e7bf74805b04d01df47693ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:19.864893 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf8620-c4fe-4a6b-b061-6280ffe6454b service placement] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:19.865177 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf8620-c4fe-4a6b-b061-6280ffe6454b service placement] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:19.865455 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf8620-c4fe-4a6b-b061-6280ffe6454b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:19.867444 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1fbf8620-c4fe-4a6b-b061-6280ffe6454b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:19.879320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf8620-c4fe-4a6b-b061-6280ffe6454b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:19.883277 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf8620-c4fe-4a6b-b061-6280ffe6454b service placement] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:19.891983 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1439/2890] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:45:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:45:25.218415 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85f7f5-71b6-457f-b07e-58cc0bcb219f None None] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:25.221068 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2f85f7f5-71b6-457f-b07e-58cc0bcb219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:25.235734 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85f7f5-71b6-457f-b07e-58cc0bcb219f None None] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:25.240872 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7aa5a-678a-4a82-925f-450bfbdd1bcd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aae5b2e7bf74805b04d01df47693ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:25.241535 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7aa5a-678a-4a82-925f-450bfbdd1bcd service placement] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:25.241850 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7aa5a-678a-4a82-925f-450bfbdd1bcd service placement] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:25.242203 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7aa5a-678a-4a82-925f-450bfbdd1bcd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:25.244038 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-edb7aa5a-678a-4a82-925f-450bfbdd1bcd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:25.256175 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7aa5a-678a-4a82-925f-450bfbdd1bcd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:25.259278 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7aa5a-678a-4a82-925f-450bfbdd1bcd service placement] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:25.270738 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1452/2891] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:45:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:45:28.819714 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf8620-c4fe-4a6b-b061-6280ffe6454b service placement] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:28.831572 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf8620-c4fe-4a6b-b061-6280ffe6454b service placement] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:28.837320 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7988f2-e05b-4970-b6d3-0e3a251a7584 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aae5b2e7bf74805b04d01df47693ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:28.837968 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7988f2-e05b-4970-b6d3-0e3a251a7584 service placement] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:28.838252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7988f2-e05b-4970-b6d3-0e3a251a7584 service placement] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:28.838529 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7988f2-e05b-4970-b6d3-0e3a251a7584 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:28.840329 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0f7988f2-e05b-4970-b6d3-0e3a251a7584 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:28.853550 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7988f2-e05b-4970-b6d3-0e3a251a7584 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:28.855256 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7988f2-e05b-4970-b6d3-0e3a251a7584 service placement] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:28.865297 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1440/2892] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:45:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:45:28.916636 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7aa5a-678a-4a82-925f-450bfbdd1bcd service placement] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:28.922719 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-edb7aa5a-678a-4a82-925f-450bfbdd1bcd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:28.987245 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7aa5a-678a-4a82-925f-450bfbdd1bcd service placement] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:28.991732 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca00aa6-73e9-458f-af12-9273ee14a47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:28.993035 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca00aa6-73e9-458f-af12-9273ee14a47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:28.993313 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca00aa6-73e9-458f-af12-9273ee14a47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:28.993625 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca00aa6-73e9-458f-af12-9273ee14a47d admin admin] PATH_INFO: `/v3/users/2d005ca3fb6a40d2850c9d34a5ab7096` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:28.994794 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca00aa6-73e9-458f-af12-9273ee14a47d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d005ca3fb6a40d2850c9d34a5ab7096)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:28.996715 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca00aa6-73e9-458f-af12-9273ee14a47d admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:29.179783 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2ca00aa6-73e9-458f-af12-9273ee14a47d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d005ca3fb6a40d2850c9d34a5ab7096'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:29.180431 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2ca00aa6-73e9-458f-af12-9273ee14a47d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d005ca3fb6a40d2850c9d34a5ab7096'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:29.240924 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2ca00aa6-73e9-458f-af12-9273ee14a47d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d005ca3fb6a40d2850c9d34a5ab7096'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:29.248539 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2ca00aa6-73e9-458f-af12-9273ee14a47d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d005ca3fb6a40d2850c9d34a5ab7096'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:29.260398 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-2ca00aa6-73e9-458f-af12-9273ee14a47d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d005ca3fb6a40d2850c9d34a5ab7096'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:29.266800 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1453/2893] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:45:28 2022] DELETE /identity/v3/users/2d005ca3fb6a40d2850c9d34a5ab7096 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:45:29.512678 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7988f2-e05b-4970-b6d3-0e3a251a7584 service placement] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:29.524450 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7988f2-e05b-4970-b6d3-0e3a251a7584 service placement] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:29.597517 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:29.598170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:29.598448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:29.598721 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2 admin admin] PATH_INFO: `/v3/projects/42f0cd3e66ff4f08bcabdd66f24995ff` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:29.599865 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42f0cd3e66ff4f08bcabdd66f24995ff)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:29.602186 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:29.722240 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42f0cd3e66ff4f08bcabdd66f24995ff', 'request_id': 'req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:29.801529 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42f0cd3e66ff4f08bcabdd66f24995ff', 'request_id': 'req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:29.808469 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42f0cd3e66ff4f08bcabdd66f24995ff', 'request_id': 'req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:29.818767 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2 admin admin] The token cache is being invalidate because project 42f0cd3e66ff4f08bcabdd66f24995ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:45:29.819057 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:29.819714 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:29.821890 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1441/2894] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:45:29 2022] DELETE /identity/v3/projects/42f0cd3e66ff4f08bcabdd66f24995ff => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:45:29.825971 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca00aa6-73e9-458f-af12-9273ee14a47d admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:29.830797 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-2ca00aa6-73e9-458f-af12-9273ee14a47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:29.841170 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca00aa6-73e9-458f-af12-9273ee14a47d admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:29.896264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5aba50-0163-4181-9cc8-f8e1d03d0fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:29.896903 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5aba50-0163-4181-9cc8-f8e1d03d0fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:29.897184 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5aba50-0163-4181-9cc8-f8e1d03d0fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:29.897458 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5aba50-0163-4181-9cc8-f8e1d03d0fbf admin admin] PATH_INFO: `/v3/users/60c8a29bb3494032b746ee0141f52964` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:29.899437 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5aba50-0163-4181-9cc8-f8e1d03d0fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c8a29bb3494032b746ee0141f52964)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:29.901342 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5aba50-0163-4181-9cc8-f8e1d03d0fbf admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:29.906543 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:30.143115 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ae5aba50-0163-4181-9cc8-f8e1d03d0fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c8a29bb3494032b746ee0141f52964'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:30.144346 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ae5aba50-0163-4181-9cc8-f8e1d03d0fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c8a29bb3494032b746ee0141f52964'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:30.235434 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ae5aba50-0163-4181-9cc8-f8e1d03d0fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c8a29bb3494032b746ee0141f52964'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:30.243228 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ae5aba50-0163-4181-9cc8-f8e1d03d0fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c8a29bb3494032b746ee0141f52964'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:30.255054 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-ae5aba50-0163-4181-9cc8-f8e1d03d0fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c8a29bb3494032b746ee0141f52964'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:30.262634 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1454/2895] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:45:29 2022] DELETE /identity/v3/users/60c8a29bb3494032b746ee0141f52964 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:45:30.495056 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:30.498766 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:30.511687 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374d6d8-bffe-42bd-ae94-87e3f7ed84b2 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:30.573737 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9bbc0-6a39-4997-b34d-cf2366f827b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:30.574374 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9bbc0-6a39-4997-b34d-cf2366f827b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:30.574745 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9bbc0-6a39-4997-b34d-cf2366f827b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:30.574963 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9bbc0-6a39-4997-b34d-cf2366f827b7 admin admin] PATH_INFO: `/v3/projects/c76b4d6891ab46e389c696871666825f` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:30.576124 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9bbc0-6a39-4997-b34d-cf2366f827b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76b4d6891ab46e389c696871666825f)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:30.578103 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9bbc0-6a39-4997-b34d-cf2366f827b7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:30.584399 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:30.687194 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-34d9bbc0-6a39-4997-b34d-cf2366f827b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76b4d6891ab46e389c696871666825f', 'request_id': 'req-34d9bbc0-6a39-4997-b34d-cf2366f827b7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:30.744233 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-34d9bbc0-6a39-4997-b34d-cf2366f827b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76b4d6891ab46e389c696871666825f', 'request_id': 'req-34d9bbc0-6a39-4997-b34d-cf2366f827b7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:30.750679 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-34d9bbc0-6a39-4997-b34d-cf2366f827b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76b4d6891ab46e389c696871666825f', 'request_id': 'req-34d9bbc0-6a39-4997-b34d-cf2366f827b7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:30.761302 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-34d9bbc0-6a39-4997-b34d-cf2366f827b7 admin admin] The token cache is being invalidate because project c76b4d6891ab46e389c696871666825f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:45:30.761623 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-34d9bbc0-6a39-4997-b34d-cf2366f827b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:30.762533 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-34d9bbc0-6a39-4997-b34d-cf2366f827b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:30.764170 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1442/2896] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:45:30 2022] DELETE /identity/v3/projects/c76b4d6891ab46e389c696871666825f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:45:40.257554 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:40.859195 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:46:42.800557 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5aba50-0163-4181-9cc8-f8e1d03d0fbf admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:42.803337 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ae5aba50-0163-4181-9cc8-f8e1d03d0fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:42.863317 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5aba50-0163-4181-9cc8-f8e1d03d0fbf admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:42.913230 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b8374-a9d4-400a-97d5-03f731f0b3da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:42.913897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b8374-a9d4-400a-97d5-03f731f0b3da service neutron] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:42.914178 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b8374-a9d4-400a-97d5-03f731f0b3da service neutron] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:42.914452 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b8374-a9d4-400a-97d5-03f731f0b3da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:42.916189 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-363b8374-a9d4-400a-97d5-03f731f0b3da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:42.988143 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b8374-a9d4-400a-97d5-03f731f0b3da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:42.989704 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b8374-a9d4-400a-97d5-03f731f0b3da service neutron] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:43.001801 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1455/2897] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:46:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:46:52.996321 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=74 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:46:55.632833 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9bbc0-6a39-4997-b34d-cf2366f827b7 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:55.634327 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-34d9bbc0-6a39-4997-b34d-cf2366f827b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:55.647252 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9bbc0-6a39-4997-b34d-cf2366f827b7 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:55.650997 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05dc532-ce36-438b-ba35-cd5d89bd5c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6907d8a429404b1c92805b364900ba60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:55.651606 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dc532-ce36-438b-ba35-cd5d89bd5c1a service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:55.651886 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dc532-ce36-438b-ba35-cd5d89bd5c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:55.652157 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dc532-ce36-438b-ba35-cd5d89bd5c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:55.653921 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d05dc532-ce36-438b-ba35-cd5d89bd5c1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:55.717741 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05dc532-ce36-438b-ba35-cd5d89bd5c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:55.719167 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05dc532-ce36-438b-ba35-cd5d89bd5c1a service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:55.728887 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1443/2898] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:46:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:47:02.757999 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b8374-a9d4-400a-97d5-03f731f0b3da service neutron] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:02.757999 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-363b8374-a9d4-400a-97d5-03f731f0b3da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:02.771450 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b8374-a9d4-400a-97d5-03f731f0b3da service neutron] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:02.776084 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406361ec-fd74-4118-adb6-68c322788f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:02.776731 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406361ec-fd74-4118-adb6-68c322788f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:02.777024 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406361ec-fd74-4118-adb6-68c322788f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:02.777300 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406361ec-fd74-4118-adb6-68c322788f36 admin admin] PATH_INFO: `/v3/users/09217832f8e74db38d990d25faee4305` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:02.778501 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406361ec-fd74-4118-adb6-68c322788f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09217832f8e74db38d990d25faee4305)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:02.780414 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406361ec-fd74-4118-adb6-68c322788f36 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:02.944177 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-406361ec-fd74-4118-adb6-68c322788f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09217832f8e74db38d990d25faee4305'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:02.944762 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-406361ec-fd74-4118-adb6-68c322788f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09217832f8e74db38d990d25faee4305'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:03.022215 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-406361ec-fd74-4118-adb6-68c322788f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09217832f8e74db38d990d25faee4305'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:03.029264 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-406361ec-fd74-4118-adb6-68c322788f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09217832f8e74db38d990d25faee4305'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:03.041515 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-406361ec-fd74-4118-adb6-68c322788f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09217832f8e74db38d990d25faee4305'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:03.048083 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1456/2899] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:47:02 2022] DELETE /identity/v3/users/09217832f8e74db38d990d25faee4305 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:03.287230 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05dc532-ce36-438b-ba35-cd5d89bd5c1a service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:03.298700 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05dc532-ce36-438b-ba35-cd5d89bd5c1a service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:03.355872 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa335c-bda3-4b02-b11a-a04fcf5a3994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:03.356517 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa335c-bda3-4b02-b11a-a04fcf5a3994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:03.356801 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa335c-bda3-4b02-b11a-a04fcf5a3994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:03.357079 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa335c-bda3-4b02-b11a-a04fcf5a3994 admin admin] PATH_INFO: `/v3/projects/049ba77de43b4702832529d687f5f7a3` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:03.358263 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa335c-bda3-4b02-b11a-a04fcf5a3994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=049ba77de43b4702832529d687f5f7a3)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:03.361016 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa335c-bda3-4b02-b11a-a04fcf5a3994 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:03.468448 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-befa335c-bda3-4b02-b11a-a04fcf5a3994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '049ba77de43b4702832529d687f5f7a3', 'request_id': 'req-befa335c-bda3-4b02-b11a-a04fcf5a3994'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:03.542172 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-befa335c-bda3-4b02-b11a-a04fcf5a3994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '049ba77de43b4702832529d687f5f7a3', 'request_id': 'req-befa335c-bda3-4b02-b11a-a04fcf5a3994'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:03.548786 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-befa335c-bda3-4b02-b11a-a04fcf5a3994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '049ba77de43b4702832529d687f5f7a3', 'request_id': 'req-befa335c-bda3-4b02-b11a-a04fcf5a3994'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:03.559071 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-befa335c-bda3-4b02-b11a-a04fcf5a3994 admin admin] The token cache is being invalidate because project 049ba77de43b4702832529d687f5f7a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:47:03.559364 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-befa335c-bda3-4b02-b11a-a04fcf5a3994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:03.559985 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-befa335c-bda3-4b02-b11a-a04fcf5a3994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:03.561576 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1444/2900] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:47:03 2022] DELETE /identity/v3/projects/049ba77de43b4702832529d687f5f7a3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:03.566177 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406361ec-fd74-4118-adb6-68c322788f36 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:03.567581 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-406361ec-fd74-4118-adb6-68c322788f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:03.581994 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406361ec-fd74-4118-adb6-68c322788f36 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:03.637512 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f35927-5c5d-4835-99b4-c665e02b6ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:03.638157 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35927-5c5d-4835-99b4-c665e02b6ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:03.638442 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35927-5c5d-4835-99b4-c665e02b6ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:03.638724 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35927-5c5d-4835-99b4-c665e02b6ca6 admin admin] PATH_INFO: `/v3/users/ab870422b4864127a015f520e33e8678` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:03.639898 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f35927-5c5d-4835-99b4-c665e02b6ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab870422b4864127a015f520e33e8678)` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:03.642428 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f35927-5c5d-4835-99b4-c665e02b6ca6 admin admin] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:03.819372 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-62f35927-5c5d-4835-99b4-c665e02b6ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab870422b4864127a015f520e33e8678'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:03.820105 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-62f35927-5c5d-4835-99b4-c665e02b6ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab870422b4864127a015f520e33e8678'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:03.867928 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-62f35927-5c5d-4835-99b4-c665e02b6ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab870422b4864127a015f520e33e8678'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:03.875945 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-62f35927-5c5d-4835-99b4-c665e02b6ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab870422b4864127a015f520e33e8678'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:03.884033 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:03.888889 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.notifications [None req-62f35927-5c5d-4835-99b4-c665e02b6ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab870422b4864127a015f520e33e8678'} {{(pid=80268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:03.895187 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1457/2901] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Jul 28 05:47:03 2022] DELETE /identity/v3/users/ab870422b4864127a015f520e33e8678 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:04.115658 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa335c-bda3-4b02-b11a-a04fcf5a3994 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:04.117161 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-befa335c-bda3-4b02-b11a-a04fcf5a3994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:04.130857 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa335c-bda3-4b02-b11a-a04fcf5a3994 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:04.152035 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:04.190108 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1437781-72d4-498d-bcb7-745156c490e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40170d20cf2e4d67929f88ba378a2373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44e83cd79a56499f92e288b2c69de397', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:04.190755 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1437781-72d4-498d-bcb7-745156c490e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:04.191032 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1437781-72d4-498d-bcb7-745156c490e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:04.191304 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1437781-72d4-498d-bcb7-745156c490e3 admin admin] PATH_INFO: `/v3/projects/f1af514c436e4628ab4aa1745a2b74d0` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:04.192487 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1437781-72d4-498d-bcb7-745156c490e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1af514c436e4628ab4aa1745a2b74d0)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:04.194492 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1437781-72d4-498d-bcb7-745156c490e3 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:04.325635 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-a1437781-72d4-498d-bcb7-745156c490e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1af514c436e4628ab4aa1745a2b74d0', 'request_id': 'req-a1437781-72d4-498d-bcb7-745156c490e3'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:04.393828 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-a1437781-72d4-498d-bcb7-745156c490e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1af514c436e4628ab4aa1745a2b74d0', 'request_id': 'req-a1437781-72d4-498d-bcb7-745156c490e3'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:04.400309 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-a1437781-72d4-498d-bcb7-745156c490e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1af514c436e4628ab4aa1745a2b74d0', 'request_id': 'req-a1437781-72d4-498d-bcb7-745156c490e3'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:04.412283 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-a1437781-72d4-498d-bcb7-745156c490e3 admin admin] The token cache is being invalidate because project f1af514c436e4628ab4aa1745a2b74d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:47:04.412579 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-a1437781-72d4-498d-bcb7-745156c490e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:04.413218 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-a1437781-72d4-498d-bcb7-745156c490e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:04.414787 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1445/2902] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Jul 28 05:47:04 2022] DELETE /identity/v3/projects/f1af514c436e4628ab4aa1745a2b74d0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:13.982121 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:14.409248 dv-cinder-799871-48-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:50:51.897253 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f35927-5c5d-4835-99b4-c665e02b6ca6 admin admin] Authenticating user token {{(pid=80268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:50:51.898683 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-62f35927-5c5d-4835-99b4-c665e02b6ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:50:52.035679 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f35927-5c5d-4835-99b4-c665e02b6ca6 admin admin] Validating token access rules against request {{(pid=80268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:50:52.093240 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c7e68-9a00-4634-a59d-604b0aa4e798 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aae5b2e7bf74805b04d01df47693ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '089d8f58fc104484b617ec4a1317dbeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:50:52.093897 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c7e68-9a00-4634-a59d-604b0aa4e798 service placement] REQUEST_METHOD: `GET` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:50:52.094198 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c7e68-9a00-4634-a59d-604b0aa4e798 service placement] SCRIPT_NAME: `/identity` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:50:52.094471 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c7e68-9a00-4634-a59d-604b0aa4e798 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:50:52.096233 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.fernet_utils [None req-ac1c7e68-9a00-4634-a59d-604b0aa4e798 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:50:52.107322 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c7e68-9a00-4634-a59d-604b0aa4e798 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:50:52.109615 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c7e68-9a00-4634-a59d-604b0aa4e798 service placement] RBAC: Authorization granted {{(pid=80268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:50:52.119566 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: [pid: 80268|app: 0|req: 1458/2903] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jul 28 05:50:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:51:02.115331 dv-cinder-799871-48-iscsi devstack@keystone.service[80268]: DEBUG dbcounter [-] [80268] Writing DB stats keystone:SELECT=89 {{(pid=80268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}